Deployment Pipelines - Support Incremental Refresh with Detect Data Changes
We are leveraging Power BI models configured with Incremental Refresh and Detect Data Changes (IRDDC), using monthly partitions and a polling expression to track the maximum 'last update' date via a refreshBookmark. While Deployment Pipelines streamline model promotion, they currently lack the ability to control partition settings or manage the refreshBookmark during deployment.
We request the addition of deployment options that allow us to:
- Preserve or overwrite the refreshBookmark based on deployment context.
- Exclude partition metadata from deployments when necessary to avoid unintended refresh behavior.
- Strategically update semantic models without disrupting incremental refresh logic.
Existing 3rd Party Tools such as ALM Toolkit and TE3 provide the following options to achieve this:
These capabilities are essential for maintaining data integrity and operational efficiency in enterprise environments using IRDDC. While tools like ALM Toolkit and Tabular Editor offer workarounds, native support in Deployment Pipelines would significantly enhance governance and automation.
2 Comments
- Michaeldias
Helper I
Yes please. Doing this manually instead of going through our pipeline of 10 workspaces is risky indeed - Michaeldias
Helper I
Yes please. Doing this manually instead of going through our pipeline of 10 workspaces is risky indeed
Recent ideas
Power Query Parameter create/use when connecting to a dataflow
In power query when you connect to a table in a dataflow there are no options to create or use a parameter for that dataflow. When connecting to SQL there is an option when setting up the connection ...ben_holmes52 minutes agoNew MemberNeed Clarification202Views3likes2CommentsMake Copilot Approval status for semantic model available through API
In recent versions fabric allowed to mark a semantic model as approved for copilot to reduce AI adoption friction. However there is no specific way for external governance application to analyse whi...FrançoisD1 hour agoFrequent VisitorNew2Views0likes0CommentsClone a workspace, including its data, to a new workspace
Description: Today there's no way to fully clone a Fabric workspace: git sync and Deployment Pipelines move item definitions only, not the underlying data; Warehouse's zero-copy CREATE TABLE ... AS ...gclements2 hours agoHelper IINew6Views1like0CommentsAllow NotebookUtils getSecret() to authenticate with Workspace Identity
Current behavior In Microsoft Fabric, notebookutils.credentials.getSecret() authenticates against Azure Key Vault using the identity of the user who executes the notebook. This behavior appli...tmihara7 hours agoNew MemberNew7Views0likes0CommentsSupport Synonyms in Fabric Warehouse
Microsoft SQL Server has a very powerful feature by the way of "synonyms." It allows users and DBAs to do all sorts of powerful magic such as rewiring objects under the hood (e.g. run the code agains...matthias-bi11 hours agoRegular VisitorNew1.3KViews18likes2Comments