Forum Discussion
Dataflow Incremental Refresh Update Specific Partitions
Hi, Anonymous
You can check it:
Can't you see the partition when you turn it on?
Did I answer your question? Please mark my reply as solution. Thank you very much.
If not, please feel free to ask me.
Best Regards,
Community Support Team _ Janey
This is the error message using SQL Database connection:
And there are only two visible options for the Analysis Services connector:
- v-janeyg-msft4 years agoCommunity Support
Hi, Anonymous
In this doc:
incremental-refresh-implementation-details
More details:
What's the data source of your dataflow?
- Anonymous4 years agoNot applicable
Thanks for the link, v-janeyg-msft
The Incremental Dataflow sits between an initial Dataflow and the final Datasets. The Initial Dataflow is import a JSON file and transforms it into a couple of Tables. These initial dataflow tables are limited to 30 days of activity. The Incremental Dataflow is working as designed. Each day is reads the last 30 days of activity, but only updates the last 14 days. My Incremental load contains data back through Oct 2021. If was hoping to have the flexibity to update some of the old partitions to add, remove or replace them.- v-janeyg-msft4 years agoCommunity Support
Anonymous
What ‘s your refresh history? Does your json file support query folding?
- Anonymous4 years agoNot applicable
v-janeyg-msft
It is another Dataflow in the same workspace. The JSON file is loading into a Standard Dataflow. The Incremental Dataflow is reading from this initial Dataflow. Are both the Standard and Incremental Dataflows not considered "Azure Data Lake Storage". Would the Workspace need to be configured to use Gen 2 storage?Or do both the dataflow need to be switched to "Enhanced Compute Engine" (I thought be default this would be on because the Dataflows are linked?):
- v-janeyg-msft4 years agoCommunity Support
Anonymous
The incrementally refreshed partitions should not be visible in the service and need to use external tools like ssms. Your data source may not support.
Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Docs
Best Regards,
Community Support Team _ Janey