Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
Anonymous
Not applicable

Query dependencies - avoid full refresh

Hi

 

Say I have a FACT table, which takes a long time to refresh. I also have a lookup table, which does not take a long time to refresh.

The very last step of the FACT table query is joining FACT and lookup - one column from lookup into FACT.

 

Question: Can I somehow make changes to the lookup table, and update the FACT table accordingly, without refreshing the entire FACT table again, which as previously mentioned, takes a very long time?

 

Thanks

/Henrik

 

1 ACCEPTED SOLUTION

No. Power Query has to process the entire dataset when it loads it into the model. The only way around this is using Incremental Refresh, and that is only availble in data sources that support it. Flatfiles, text, excel, SharePoint Lists definitely do not. Relational databases may. SQL Server does for example, as does PostGRE SQL, but MySQL does not. It depends on your dataset. 

 

That said, Incremental Refresh is a service side thing. It won't help you when you are developing in Power BI Desktop. What you could do is temporarly create a filter on the big data table to limit to a few thousand records, then remove the filter when you are ready to look at the entire dataset and publish.



Did I answer your question? Mark my post as a solution!
Did my answers help arrive at a solution? Give it a kudos by clicking the Thumbs Up!

DAX is for Analysis. Power Query is for Data Modeling


Proud to be a Super User!

MCSA: BI Reporting

View solution in original post

4 REPLIES 4
artemus
Microsoft Employee
Microsoft Employee

Maybe... depends on what your data source kind is. E.g. is it SQL, Azure Tables, or GBQ? Something else?

Anonymous
Not applicable

The data source is our business warehouse. Coud be converted to a flatfile.

No. Power Query has to process the entire dataset when it loads it into the model. The only way around this is using Incremental Refresh, and that is only availble in data sources that support it. Flatfiles, text, excel, SharePoint Lists definitely do not. Relational databases may. SQL Server does for example, as does PostGRE SQL, but MySQL does not. It depends on your dataset. 

 

That said, Incremental Refresh is a service side thing. It won't help you when you are developing in Power BI Desktop. What you could do is temporarly create a filter on the big data table to limit to a few thousand records, then remove the filter when you are ready to look at the entire dataset and publish.



Did I answer your question? Mark my post as a solution!
Did my answers help arrive at a solution? Give it a kudos by clicking the Thumbs Up!

DAX is for Analysis. Power Query is for Data Modeling


Proud to be a Super User!

MCSA: BI Reporting
Greg_Deckler
Community Champion
Community Champion

Not that I am aware. Perhaps if you implemented a measure.



Follow on LinkedIn
@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
DAX For Humans

DAX is easy, CALCULATE makes DAX hard...

Helpful resources

Announcements
FabCon Global Hackathon Carousel

FabCon Global Hackathon

Join the Fabric FabCon Global Hackathon—running virtually through Nov 3. Open to all skill levels. $10,000 in prizes!

October Power BI Update Carousel

Power BI Monthly Update - October 2025

Check out the October 2025 Power BI update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.

Top Kudoed Authors