Deployment Pipelines - Support Incremental Refresh with Detect Data Changes
We are leveraging Power BI models configured with Incremental Refresh and Detect Data Changes (IRDDC), using monthly partitions and a polling expression to track the maximum 'last update' date via a refreshBookmark. While Deployment Pipelines streamline model promotion, they currently lack the ability to control partition settings or manage the refreshBookmark during deployment.
We request the addition of deployment options that allow us to:
- Preserve or overwrite the refreshBookmark based on deployment context.
- Exclude partition metadata from deployments when necessary to avoid unintended refresh behavior.
- Strategically update semantic models without disrupting incremental refresh logic.
Existing 3rd Party Tools such as ALM Toolkit and TE3 provide the following options to achieve this:
These capabilities are essential for maintaining data integrity and operational efficiency in enterprise environments using IRDDC. While tools like ALM Toolkit and Tabular Editor offer workarounds, native support in Deployment Pipelines would significantly enhance governance and automation.
2 Comments
- Michaeldias
Helper I
Yes please. Doing this manually instead of going through our pipeline of 10 workspaces is risky indeed - Michaeldias
Helper I
Yes please. Doing this manually instead of going through our pipeline of 10 workspaces is risky indeed
Recent ideas
Allow us to rename fabric data agents published to m365
If we use deployment pipelines to promote fabric data agents between dev, test/UAT, and prod fabric workspaces, we need to keep the name of the fabric agent the same in each workspace. If we want to ...PeterDaniels2 hours agoAdvocate IIINew178Views0likes2CommentsMake workspace and item session persistence optional
Description The new persistent session behavior in Microsoft Fabric should be optional rather than forced. Currently, Fabric remembers the workspaces and items that were open in my previous session...TeemuMultanen3 hours agoAdvocate INew292Views47likes2CommentsSupport Encrypted Sensitivity-Labeled Excel Files in Power Query
Description Currently, Power Query Online and Power Query in Excel are unable to access encrypted Excel files. Excel files with sensitivity types other than Public or Non-Business can be encrypted a...ewarstdhyjugkhi4 hours agoMicrosoft EmployeeNew17Views6likes0Comments