cancel
Showing results for 
Search instead for 
Did you mean: 
Reply
eager_to_learn2
Frequent Visitor

Filter Based on Parameter Taking a Long Time to Process and large model size being generated.

Hi folks,

I have a query that is referencing a table in Excel, full file size of workbook is only 1mb. The table itself is only 1800 rows of data and 29 columns. I am having 2 issues and I think they are interelated which is why I have grouped them together:

  1. Firstly I have a filter based on a parameter to filter a date coulmn and it takes a long time (about 45mins) to process when I refresh or change the data.eager_to_learn2_1-1678969035514.png
  2. When some of the other steps are carried out power query loads a model of of 15GB from my initial source of 1mb. I do have 6 merged tables (2 columns for each merge) based from the inital data source (Excel table) merged back on to this query, could this be causing the excessive model size being loaded back into power query? 

 eager_to_learn2_2-1678969635348.png

Hopefully this makes sense. Any help or pointing in the right direction would be appreciated.

Thanks very much,

 

 

 

 

 

1 ACCEPTED SOLUTION
lbendlin
Super User
Super User

Use the Power Query Diagnostics. That will help you identify the real culprit.  My money is on the Table.Nestedjoin step.  Generally you do not want to do any joins in Power Query. let the data model do the work for you.

View solution in original post

2 REPLIES 2
lbendlin
Super User
Super User

Use the Power Query Diagnostics. That will help you identify the real culprit.  My money is on the Table.Nestedjoin step.  Generally you do not want to do any joins in Power Query. let the data model do the work for you.

Hi Ibendlin, I accepted this as the sloution as it helped reaffirm my suspciouns. It was the couple of joins that seem to be the biggest culprits as suggested. I carried out the transformations in a different way rather than using joins and it has sped up the query. Thanks for your time!

Helpful resources

Announcements
Join Arun Ulag at MPPC23

Join Arun Ulag at MPPC23

Get a sneak peek into this year's Power Platform Conference Keynote.

PBI Sept Update Carousel

Power BI September 2023 Update

Take a look at the September 2023 Power BI update to learn more.

Learn Live

Learn Live: Event Series

Join Microsoft Reactor and learn from developers.

Dashboard in a day with date

Exclusive opportunity for Women!

Join us for a free, hands-on Microsoft workshop led by women trainers for women where you will learn how to build a Dashboard in a Day!

Top Solution Authors
Top Kudoed Authors