Check your eligibility for this 50% exam voucher offer and join us for free live learning sessions to get prepared for Exam DP-700.
Get StartedDon't miss out! 2025 Microsoft Fabric Community Conference, March 31 - April 2, Las Vegas, Nevada. Use code MSCUST for a $150 discount. Prices go up February 11th. Register now.
Hi.
I have souce from on prem sql and source from excel file in sharepoint and when publishing to service gateway is approved for SQL.
I also have an MS Flow that refreshes power bi dataset every 5minutes. My problem is 2 fold :
1. Incremental refresh -Issues around query folding
2. AI text Analytics reruns for entire dataset every time refresh is done.
How can I refresh only what was updated and AI text analytics only work with new rows added to the excel file and not the entire dataset? Based on my current set up I need a solution please or guidance towards one
Hi @Anonymous,
can you identify the added rows by a date column in Excel?
Take a look at this too.
https://www.thinkbi.de/2020/03/29/incremental-refresh-with-subqueries/
Marcus Wegener works as Full Stack Power BI Engineer at BI or DIE.
His mission is clear: "Get the most out of data, with Power BI."
twitter - LinkedIn - YouTube - website - podcast - Power BI Tutorials
Hi
Yes, however can this be applied to an sharepoint excel file ? Will query folding be an issue?
Thanks
Hi,
you can apply the filter, it just won't be query folded to the source.
You do not get any speed advantage, but you can reduce the calls to AI text analytics to the new rows.
Marcus Wegener works as Full Stack Power BI Engineer at BI or DIE.
His mission is clear: "Get the most out of data, with Power BI."
twitter - LinkedIn - YouTube - website - podcast - Power BI Tutorials
Hi
Thank you, will this be incremental refresh or power query setting on filtering the rows? and if I can dynamically pull the rows will historic data remain and only latest gets refresh or new rows added?
Thanks
Hi @Anonymous,
in my view, it's an incremental refresh that you need to set up through Power Query Filter.
The historical data remain and only the defined refresh range is updated.
https://docs.microsoft.com/en-us/power-bi/admin/service-premium-incremental-refresh
I wrote a blog post on a similar topic.
https://community.powerbi.com/t5/Community-Blog/Incremental-Refresh-with-Subqueries/ba-p/1003337
Marcus Wegener works as Full Stack Power BI Engineer at BI or DIE.
His mission is clear: "Get the most out of data, with Power BI."
twitter - LinkedIn - YouTube - website - podcast - Power BI Tutorials
March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Prices go up Feb. 11th.
Check out the January 2025 Power BI update to learn about new features in Reporting, Modeling, and Data Connectivity.
User | Count |
---|---|
145 | |
79 | |
63 | |
52 | |
47 |
User | Count |
---|---|
217 | |
89 | |
76 | |
67 | |
60 |