Deployment Pipelines - Support Incremental Refresh with Detect Data Changes
We are leveraging Power BI models configured with Incremental Refresh and Detect Data Changes (IRDDC), using monthly partitions and a polling expression to track the maximum 'last update' date via a refreshBookmark. While Deployment Pipelines streamline model promotion, they currently lack the ability to control partition settings or manage the refreshBookmark during deployment.
We request the addition of deployment options that allow us to:
- Preserve or overwrite the refreshBookmark based on deployment context.
- Exclude partition metadata from deployments when necessary to avoid unintended refresh behavior.
- Strategically update semantic models without disrupting incremental refresh logic.
Existing 3rd Party Tools such as ALM Toolkit and TE3 provide the following options to achieve this:
These capabilities are essential for maintaining data integrity and operational efficiency in enterprise environments using IRDDC. While tools like ALM Toolkit and Tabular Editor offer workarounds, native support in Deployment Pipelines would significantly enhance governance and automation.
2 Comments
- Michaeldias
Helper I
Yes please. Doing this manually instead of going through our pipeline of 10 workspaces is risky indeed - Michaeldias
Helper I
Yes please. Doing this manually instead of going through our pipeline of 10 workspaces is risky indeed
Recent ideas
Restore "no-reply" option for Power BI Subscriptions
Please add a setting in the Power BI Subscription pane to choose the sender identity. With the recent update the platform forces emails to route through the subscription owner's personal Exchange On...LenaFid46 minutes agoNew MemberNew90Views13likes4CommentsAdd a hash or checksum function to Power Query (M)
In Power Query (M) in both Power BI and Dataflows there is no checksum or hash function. This means that you have to concatenate and compare columns as a large string which is slow and inefficient. T...Joe_Edwards11 hour agoNew MemberNeeds Votes4.2KViews20likes3CommentsSchedule Data Pipeline to run as a Service Principal
Please make a UI (user interface) option to schedule a Data Pipeline to run in the user context (security context) of a Service Principal instead of my personal user. This should also have the ...frithjof_v1 hour agoCommunity ChampionPlanned6.3KViews93likes9CommentsWorkspace Identity support in On-premise and VNet Data Gateways
We need the ability to use the Workspace Identity feature via On-premise and VNet Data Gateways. There is little detail on the Microsoft Learn about this limitation or an indication on Fabric Roadma...Anonymous2 hours agoNot applicableNew619Views5likes1CommentPipeline: Activity-level Run Conditions (No IF Container Required)
We need the ability to add a "Run if" condition directly to every pipeline activity. Like, in each acticity's settings. One of the biggest readability issues in Fabric Pipelines is that conditional ...frithjof_v2 hours agoCommunity ChampionNew47Views5likes2Comments