Forum Discussion
Data Model: Using Reference tables to merge in Categorizations for Dimension usage
- 6 years ago
Anonymous
I looked at the model and I could recomment couple of approaches.
1. Bring Product segment to facts and join the segment dimension directly to facts intead on top of tax. The tax should join to facts as well. With this tax and segment both filter facts.
But for a single row in fact, if a segment tagged to core is different than a segment tagged to platform, we can't go for this appraoch.
2. Create bridge or linker table between tax and facts. This should have all the combination for segment, tax(core,product, platform etc) and facts. All 7 tax and segment dimension connects to bridge and the bridge connects to facts.
In any case, you can't join the dimension to seperate tax unless you merge them togeather.
Let us know.
Anonymous
Looking at the pictures, I believe you have two options.
1. Merge the reference to fact if doesn't explode the rows.
2. Merge all the reference tables into 1 and define the relationship from Dimension->Reference->facts.
Again, I need to see the data(sample data) and the key columns to suggest anything.
Two million rows is not a big deal even for dimension. So don't worry about the record counts.
Even if you don't have access to create views in database, You could still use the sql to transform the data apart from Power BI transformations
I have been doing #1 merge for some time but performance has gotten out of control. I am testing pulling the data to Excel and acache\transform there and it seams to be performing much better with a vlookup.
I have modeled #2 but have granularity issues I have tried to work through with establishing keys and hierarchical structure if not the lowest level on every Taxonomy.
For the SQL, I can create my table selection to merge the fact tables but will still have the Categorization with the 7 meta-Taxonomies.
- VasTg6 years agoMemorable Member
Anonymous
I looked at the model and I could recomment couple of approaches.
1. Bring Product segment to facts and join the segment dimension directly to facts intead on top of tax. The tax should join to facts as well. With this tax and segment both filter facts.
But for a single row in fact, if a segment tagged to core is different than a segment tagged to platform, we can't go for this appraoch.
2. Create bridge or linker table between tax and facts. This should have all the combination for segment, tax(core,product, platform etc) and facts. All 7 tax and segment dimension connects to bridge and the bridge connects to facts.
In any case, you can't join the dimension to seperate tax unless you merge them togeather.
Let us know.
- VasTg6 years agoMemorable Member
Anonymous
I had a deep look at the data. Given that its a mock up file, i see prodseg is in both CORE and Item.
Verify the fact to have single segment based on all 7 categorization and if it does it better to bring in the segment and join the dimension to fact.
If it helps mark it as a solution
Kudos are nice too
- Anonymous6 years agoNot applicable
The cross over duplication is a result of my anonomizing the data manually. Not a issue in the actual data sets. Or at least it is my intent to correct these if they exist to have a smooth rollup.
- Anonymous6 years agoNot applicable
I think I have ended up at the conclusion to just merge in the tax to the fact table at the ProdSeg level and use normal diminetions tables. It is impossible to process in Power BI, but I have a Excel Cached model that I may take to a db at somepoint. In Excel i will do these merges where it is more managable.
- VasTg6 years agoMemorable Member
Anonymous
Before you start to do it in Excel, when you merged in Power BI, did you uncheck the "Enable Load" for all the 7 taxonamies tables? Otherwise, it would have loaded the table twice and caused it to run longer.
Just a thought.