Forum Discussion

jigneshpatel's avatar
jigneshpatel
Regular Visitor
1 year ago
Solved

Dataflow from saleforce object to warehouse with incremental refresh not working

Hi,   I want to bring data from salesforce object to data warehouse in fabric workspace. I am using datalfow gen2 for this.    When I set "Incremental refresh" on source table I get following err...
data engineering
  • goldenarm253's avatar
    goldenarm253
    1 year ago

    Hi,

     

    To my knowledge incremental refresh for Salesforce in a Gen2 dataflow is not possible at this time in fabric.  It seems the incremental refresh is only possible with Power Bi desktop application.

goldenarm253's avatar
goldenarm253
Frequent Visitor
1 year ago

Hi,

reference: Validating Findings on Optimizing Incremental Refresh with Microsoft Fabric 

 

Last week, I conducted tests and observed that Salesforce objects are incompatible with Gen2 incremental refresh in Microsoft Fabric. If query folding isn't enabled, scheduled refresh times can triple. The issue stems from Salesforce using SOQL rather than standard SQL. A better approach might be setting up a pipeline to handle SOQL efficiently.

 

 

I’m also attaching a link to my post. Nono Chen shared some best practice ideas in the discussion, which might provide additional insights.

I hope this helps!