Incremental Refresh from Salesforce-DataLake Gen 2 Connection

[common763]

I have created a report from Salesforce that is sent over to the Azure Data Lake.  It was created inside Power BI using the Gen 2 connection.  It is a rather large report so want to do an incremental refresh.  I went ahead and did that, but was notified in the incremental refresh window that states "Unable to confirm if the M query can be folded...".  

A co-worker mentioned using Synapse but not sure of what resources I have available for that and this is becoming more complicated than I believe it should be.  Is there a way to do an incremental refresh using the Salesforce (parquet) to Data Lake connection inside Power BI?  Maybe editing M or doing something?  Any information would be appreciated as this may be a weird thing to begin with sending data from SF to PBI.  Thanks. 

[Anonymous · Accepted solution]

Hi @common763 ,

If you see this warning and want to verify the necessary query folding is occurring, use the Power Query Diagnostics feature, or trace queries by using a tool supported by the data source, such as SQL Profiler. If query folding isn't occurring, verify the filter logic is included in the query being passed to the data source. If not, it's likely the query includes a transformation that prevents folding.

Before configuring your incremental refresh solution, be sure to thoroughly read and understand Query folding guidance in Power BI Desktop and Power Query query folding. These articles can help you determine whether your data source and queries support query folding.

And I agree with your co-worker.Incremental refresh and real-time data works best for structured, relational data sources like SQL Database and Azure Synapse.

For your requirement, I found this blog for your reference:

Parquet, ADLS Gen2, ETL, and Incremental Refresh i... - Microsoft Fabric Community

Here's the official doc:

Incremental refresh for semantic models and real-time data in Power BI - Power BI | Microsoft Learn

Best Regards,

Stephen Tao

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[common763]

Thanks Stephen.  I will look at this now.  Appreciate it.