Deployment Pipelines - Support Incremental Refresh with Detect Data Changes
We are leveraging Power BI models configured with Incremental Refresh and Detect Data Changes (IRDDC), using monthly partitions and a polling expression to track the maximum 'last update' date via a refreshBookmark. While Deployment Pipelines streamline model promotion, they currently lack the ability to control partition settings or manage the refreshBookmark during deployment.
We request the addition of deployment options that allow us to:
- Preserve or overwrite the refreshBookmark based on deployment context.
- Exclude partition metadata from deployments when necessary to avoid unintended refresh behavior.
- Strategically update semantic models without disrupting incremental refresh logic.
Existing 3rd Party Tools such as ALM Toolkit and TE3 provide the following options to achieve this:
These capabilities are essential for maintaining data integrity and operational efficiency in enterprise environments using IRDDC. While tools like ALM Toolkit and Tabular Editor offer workarounds, native support in Deployment Pipelines would significantly enhance governance and automation.
2 Comments
- Michaeldias
Helper I
Yes please. Doing this manually instead of going through our pipeline of 10 workspaces is risky indeed - Michaeldias
Helper I
Yes please. Doing this manually instead of going through our pipeline of 10 workspaces is risky indeed
Recent ideas
Support Synonyms in Fabric Warehouse
Microsoft SQL Server has a very powerful feature by the way of "synonyms." It allows users and DBAs to do all sorts of powerful magic such as rewiring objects under the hood (e.g. run the code agains...matthias-bi3 hours agoRegular VisitorNew1.3KViews18likes2CommentsExpose Refresh Warnings and Informational Messages via Notifications and API
When a Power BI semantic model refresh completes successfully, the status shows Completed, even when the refresh details contain warnings or informational messages that require attention. Please pro...Jashwanth_K5 hours agoMicrosoft EmployeeNew21Views6likes0CommentsInvoke Pipeline Task - Workspace Identity Authentication
Currently, the Fabric Data Factory Invoke Pipeline task uses the user's credentials who saved the pipeline to then authenticate to the Azure Data Factory to execute the ADF pipeline. When that user'...dzebrowitz9 hours agoAdvocate IPlanned1.8KViews61likes5CommentsFabric Pipeline should run as workspace identity
Currently, Microsoft Fabric pipelines run under the identity of the last user who modified them, which can cause disruptions when tenant administrators make changes to security policies, such as enab...pellitteris9 hours agoAdvocate IINew1.4KViews27likes3CommentsBring Back separating Power BI artifacts on a per web page basis
Previously, the ability to have different artifacts open on different web tabs was enabled. This was beneficial if you wanted to differentiate what environments you were in, working across three diff...zoe-dean11 hours agoNew MemberNew56Views8likes0Comments