Forum Discussion
Filter Based on Parameter Taking a Long Time to Process and large model size being generated.
Hi folks,
I have a query that is referencing a table in Excel, full file size of workbook is only 1mb. The table itself is only 1800 rows of data and 29 columns. I am having 2 issues and I think they are interelated which is why I have grouped them together:
- Firstly I have a filter based on a parameter to filter a date coulmn and it takes a long time (about 45mins) to process when I refresh or change the data.
- When some of the other steps are carried out power query loads a model of of 15GB from my initial source of 1mb. I do have 6 merged tables (2 columns for each merge) based from the inital data source (Excel table) merged back on to this query, could this be causing the excessive model size being loaded back into power query?
Hopefully this makes sense. Any help or pointing in the right direction would be appreciated.
Thanks very much,
Use the Power Query Diagnostics. That will help you identify the real culprit. My money is on the Table.Nestedjoin step. Generally you do not want to do any joins in Power Query. let the data model do the work for you.
2 Replies
Use the Power Query Diagnostics. That will help you identify the real culprit. My money is on the Table.Nestedjoin step. Generally you do not want to do any joins in Power Query. let the data model do the work for you.
Hi Ibendlin, I accepted this as the sloution as it helped reaffirm my suspciouns. It was the couple of joins that seem to be the biggest culprits as suggested. I carried out the transformations in a different way rather than using joins and it has sped up the query. Thanks for your time!
