Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn a 50% discount on the DP-600 certification exam by completing the Fabric 30 Days to Learn It challenge.

Reply
Anonymous
Not applicable

Power BI Incremental Refresh

Hi.

 

I have souce from on prem sql and source from excel file in sharepoint and when publishing to service gateway is approved for SQL.

I also have an MS Flow that refreshes power bi dataset every 5minutes. My problem is  2 fold :

 

1. Incremental refresh -Issues around query folding

2. AI text Analytics reruns for entire dataset every time refresh is done.

 

How can I refresh only what was updated and AI text analytics only work with new rows added to the excel file and not the entire dataset? Based on my current set up I need a solution please or guidance towards one

5 REPLIES 5

Hi @Anonymous,

 

can you identify the added rows by a date column in Excel?

 

Take a look at this too.

https://www.thinkbi.de/2020/03/29/incremental-refresh-with-subqueries/

 

Did I answer your question?
Please mark my post as solution, this will also help others.
Please give Kudos for support.

Marcus Wegener works as Full Stack Power BI Engineer at BI or DIE.
His mission is clear: "Get the most out of data, with Power BI."
twitter - LinkedIn - YouTube - website - podcast


Anonymous
Not applicable

Hi

 

Yes, however can this be applied to an sharepoint excel file ? Will query folding be an issue?

 

Thanks

Hi,

you can apply the filter, it just won't be query folded to the source.

You do not get any speed advantage, but you can reduce the calls to AI text analytics to the new rows.

 

Did I answer your question?
Please mark my post as solution, this will also help others.
Please give Kudos for support.

Marcus Wegener works as Full Stack Power BI Engineer at BI or DIE.
His mission is clear: "Get the most out of data, with Power BI."
twitter - LinkedIn - YouTube - website - podcast


Anonymous
Not applicable

Hi

 

Thank you, will this be incremental refresh or power query setting on filtering the rows? and if I can dynamically pull the rows will historic data remain and only latest gets refresh or new rows added? 

 

Thanks

Hi @Anonymous,

 

in my view, it's an incremental refresh that you need to set up through Power Query Filter.

The historical data remain and only the defined refresh range is updated.

https://docs.microsoft.com/en-us/power-bi/admin/service-premium-incremental-refresh

 

I wrote a blog post on a similar topic.

https://community.powerbi.com/t5/Community-Blog/Incremental-Refresh-with-Subqueries/ba-p/1003337

 

Did I answer your question?
Please mark my post as solution, this will also help others.
Please give Kudos for support.

Marcus Wegener works as Full Stack Power BI Engineer at BI or DIE.
His mission is clear: "Get the most out of data, with Power BI."
twitter - LinkedIn - YouTube - website - podcast


Helpful resources

Announcements
RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.

MayPowerBICarousel

Power BI Monthly Update - May 2024

Check out the May 2024 Power BI update to learn about new features.

LearnSurvey

Fabric certifications survey

Certification feedback opportunity for the community.