Forum Discussion
Request: Deployments pipelines should support centralized datasets
- 5 years ago
Hi Anonymous ,
Reports can be managed in pipelines even is they are connected to external datasets.
whenever you deploy report update across the stages, it will keep pointing to the same shared dataset.
You can also manage 'central datasets' WS in pipelines.
However, managing both datasets and connected reports in separate pipelines is still not working in an optimal way, as there's no built-in way to connect each dataset in each stage with the correlated reports in each stage.
We recommend that for now, you connect all reports in all stages to the Prod dataset. in the 'central datasets' pipeline, keep few reports for testing in each stage, so that any change in datasets will be verified on reports before hitting Prod.
If you still encounter problems in some reports, you can use the dev/ test stages to fix it in each pipeline, and deploy to Prod.
Hope it was clear.
Hi Anonymous ,
Reports can be managed in pipelines even is they are connected to external datasets.
whenever you deploy report update across the stages, it will keep pointing to the same shared dataset.
You can also manage 'central datasets' WS in pipelines.
However, managing both datasets and connected reports in separate pipelines is still not working in an optimal way, as there's no built-in way to connect each dataset in each stage with the correlated reports in each stage.
We recommend that for now, you connect all reports in all stages to the Prod dataset. in the 'central datasets' pipeline, keep few reports for testing in each stage, so that any change in datasets will be verified on reports before hitting Prod.
If you still encounter problems in some reports, you can use the dev/ test stages to fix it in each pipeline, and deploy to Prod.
Hope it was clear.
This is not an acceptable solution, in my honest opinion. Here is an example of where the Deployment Pipeline functionality breaks down.
Let's say I have my "Finance Dataset" in the Production centralized workspace "Certified Datasets", and a "Finance" app with an associated deployment pipeline. Within that pipeline, there is a P&L report. I want to test an update we just made one of our database views, to fix an issue in the existing production P&L report. I obviously don't do this immediately in the production Finance Dataset, I want to do it in a test dataset. So I deploy the test dataset with my dataset updates to our "Test Datasets" workspace.
What I would like to have, is the ability to set a "Dataset rule" for my P&L front-end .pbix file so that when I deploy it from Test workspace to the Prod workspace, it can switch the connection from the Finance Dataset in the Test Datasets workspace, to the Finance Dataset in the Certified Datasets workspace.
Right now, that isn't possible. I only have the option of retaining the connection that was established in the Test version of the P&L report throughout the deployment pipeline process.
What is even more frustrating is the lack of clarity on Microsoft's part for how to handle this situation (which many customers will run into, if they are following Microsoft's documented guidance on an Enterprise Power BI deployment).
If this functionality is not planned on coming to Deployment Pipelines, what is the recommended solution?
- Nimrod_Shalit5 years agoPower BI Team
daxman thanks for the thorough explanation. We understand the difficulties in implementing the desired use case. I can share that we are planning to address this issue and have multiple pipelines be 'aware' of each other when different items are connected across pipelines.
We will start working on it this year, but i don't have a timeline to share yet.
- daxman5 years agoAdvocate II
Thank you for keeping everyone in the loop! Your quick response is much appreciated. Cheers
- daamruth4 years agoHelper II
Hi Nimrod_Shalit ,
we just decided to introduce Power BI Premium at our company and are stumbling upon quite some missing features in Power Bi (compared to other BI products from other vendors). Amongst that is the missing support of your propagated centralized datasets and the deployment pipelines as mentioned by Anonymous. This is a critical issue for us.
Can you give us an update on the issue, please? Is there an idea available to vote on or can you point us to another solutio0n based on Powershell scripts e.g.?
And I do not understand how this question can be declared as "Solved", since it is not!
Thanks
Daniel
- Nimrod_Shalit4 years agoPower BI Team
We are now working to support this scenario.
It is part of the release notes for the Oct-Apr 22 timeframe.
See here- Deployment pipelines - multiple pipelines working together | Microsoft Docs