Forum Discussion
Agg Table Efficiency Min Date
In my specific case...the view is the fastest method to refreshing data and getting the groupings necessary. Unfortunately the underlying data has several columns that need grouping and Power Query wasn't providing the needed efficiency. I've improved the sql code for the view and can run sql directly in the model for 2 fact tables ~20mil rows with about 25 columns in 52mins. Hoping this will improve even more once the view is in place and I can push changes to Oracle. Thanks lbendlin for trying to assist!!
I've now have the SQL as an aggregated view table on our warehouse...so PBI is just pulling the aggregated view. Every change I make in Power Query seems to trigger another call back to the warehouse such as removing time from a date field. Is this normal behavior? Also..I lost query folding after extracting the date. I was under the impression query folding would continue since I'm not running the native query in PBI. Thoughts?
You need to distinguish your developer experience from the end user experience when they interact with the report.
You're not using Direct Query, right?
lbendlin correct...I'm using import. Our end user slices and dices the data for analytics...it's not just support for specific visuals. We have slicers that allow the end user to look at the data several different ways. That said...One report page could have 7 slicers coming from 7 different columns in the data....state, vendor, product, date, inv date, trade, company for example. It seems pulling the view is just as slow to refresh as if I were using sql directly in PBI.
In my specific case...the view is the fastest method to refreshing data and getting the groupings necessary. Unfortunately the underlying data has several columns that need grouping and Power Query wasn't providing the needed efficiency. I've improved the sql code for the view and can run sql directly in the model for 2 fact tables ~20mil rows with about 25 columns in 52mins. Hoping this will improve even more once the view is in place and I can push changes to Oracle. Thanks lbendlin for trying to assist!!
