Deployment Pipelines - Support Incremental Refresh with Detect Data Changes
We are leveraging Power BI models configured with Incremental Refresh and Detect Data Changes (IRDDC), using monthly partitions and a polling expression to track the maximum 'last update' date via a refreshBookmark. While Deployment Pipelines streamline model promotion, they currently lack the ability to control partition settings or manage the refreshBookmark during deployment.
We request the addition of deployment options that allow us to:
- Preserve or overwrite the refreshBookmark based on deployment context.
- Exclude partition metadata from deployments when necessary to avoid unintended refresh behavior.
- Strategically update semantic models without disrupting incremental refresh logic.
Existing 3rd Party Tools such as ALM Toolkit and TE3 provide the following options to achieve this:
These capabilities are essential for maintaining data integrity and operational efficiency in enterprise environments using IRDDC. While tools like ALM Toolkit and Tabular Editor offer workarounds, native support in Deployment Pipelines would significantly enhance governance and automation.
2 Comments
- Michaeldias
Helper I
Yes please. Doing this manually instead of going through our pipeline of 10 workspaces is risky indeed - Michaeldias
Helper I
Yes please. Doing this manually instead of going through our pipeline of 10 workspaces is risky indeed
Recent ideas
Dynamic ForEach Parallel Batch Count Based on Runtime Capacity
We would like Microsoft Fabric Data Factory to support dynamic configuration of the ForEach activity's parallel batch count at runtime. Currently, the ForEach batchCount is effectively configured as...Motasim094 minutes agoNew MemberNew0Views0likes0CommentsMake Workspace-Level Surge Protection Limit Visible to Workspace Users
Please make the applicable workspace-level surge protection limit visible in the workspace settings. Currently, when surge protection is applied by Capacity Admins, workspace users don't get visibil...frithjof_v2 hours agoCommunity ChampionNew23Views0likes0CommentsAllow Custom Recipient Settings for Gateway Expiry Notifications
Now, during the final 90 days before the gateway version end-of-support date, operations continue, but semantic model contacts users can receive warnings in email The warning message is: "The on-prem...YuanMao3 hours agoNew MemberNew5Views0likes0CommentsHow to Back Up and Restore a Fabric Lakehouse for Debugging
Is there a way to clone a Lakehouse, including its data, in Microsoft Fabric? When we encounter a data issue in Production, our usual approach is to take a backup of the database, restore it to a se...gsrinivasan8 hours agoNew MemberNew40Views0likes1Comment