rhysjohnlewis
1 year agoNew Member
Status:
New
Enable Configurable Deployment Order for Initial Sync from Repo to Workspace in Microsoft Fabric
Issue Summary:
Fabric pipelines cannot be deployed in a specific order, leading to dependency conflicts. This requires manual intervention to ensure pipelines correctly reference each other.
Recommended Workaround:
- Temporarily rename all .platform files for pipelines with dependencies to platform to prevent automatic sync and deployment.
- Deploy pipelines sequentially, ensuring dependencies are deployed first.
- For the pipeline you're deploying:
- Rename its corresponding platform file back to .platform.
- Update the pipeline-content.json file to use the correct pipeline ID of its dependency (retrievable from the URL in Fabric).
- Select Update to sync the pipeline from the repository to Fabric.
- Delete the existing pipeline folder from the repository to avoid conflicts.
- Commit the updated pipeline from Fabric to the repository, choosing Keep current content.
(Note: This process works even if the pipeline ID in the .platform file remains outdated.)
4 Comments
- echaintreau
Advocate II
I completely agree on this udpate it need to be done, we can not work with this sync that failed on regular basis - fuzzboneRegular VisitorThis issue seems to be true across multiple toolchains - Git Sync as well as Deployment Pipelines (and possibly others). Also make sure that it behaves the same way whether triggered from Fabric UI, REST API, etc.
- ProdwareSaM
Advocate I
Suggestion File in git Folder:
.deployment
Content:
MyLH1.Warehouse/.platform
--MyLH2.Warehouse/.platform -- skip because of Issue #23
MyLH2.Warehouse/.platform -- must be deployed before MyWH
MyNotebook1/.platform
MyPipeline1/.platform
MyWH.Warehouse/.platform
MyNotebook3..platform
MySemanticModel/.platform
MyReport/.platform
<SkipOther>consider:
- what do do with artifacts not specified in the File
- respect comments -- and block quote /* */ and #
- allow Commands to either Skips Other Artefacts or deploy other artefacts in standard order
Additional Idea Post Deployment Tasks, e.g.
- Replace Adjust Connections
- Run MyNotebook1.platform with parameters 1,2,3
- Run MyPipeline1.platform with parameters 1,2,3
- Process MySemanticModel/.platform
if you need to decide then Run MyPipeline1.platform would have highest benefit as you can Run Notebooks and Process MySemanticModel with that.
- ProdwareSaM
Advocate I
PS: This Deployment Order should be respected by git sync and fabric deployment pipelines
Recent ideas
Support dbt --vars in the dbt job and in the pipeline dbt activity
The sink of a dbt job (warehouse or lakehouse) can already be configured per environment through Variable Libraries. The source cannot. The source name must be written directly in sources.yml, and ou...vpolianskyi3 hours agoNew MemberNew16Views2likes0CommentsSupport dbt vars in Fabric dbt job item and Data Pipeline dbt activity
Problem The dbt job in Fabric can't be made environment-agnostic. The sink (target warehouse or lakehouse) is already configurable through Variable Libraries, so the same job definition can be promo...vpolianskyi4 hours agoNew MemberNew3Views0likes0CommentsPurview support for scanning tables and columns in Lakehouse, KQL database and Data warehouse
For all Fabric items besides Power BI: Only item-level metadata and lineage will be captured, scanning metadata and lineage of sub-level items like Lakehouse tables or files isn't supported. ...Manu_CohenYasha4 hours agoNew MemberNew1.3KViews24likes3CommentsVisual header icon improvements: Options for permanent visibility on per-icon basis, weblinks etc.
Current problem: Visual header icons like the 'Help tooltip' icon are potentially incredibly useful, however they rarely pass muster for our needs as so many of our report owners/authors insist on th...D_M_25 hours agoAdvocate INew5Views0likes0CommentsFeature Request: Cross-Workspace Enterprise Reporting Hub with Org App
Hi Microsoft team, We would like to propose a new capability for Microsoft Org Apps to support an enterprise reporting hub across multiple independently managed workspaces. Proposal: Enterprise Rep...SvetlanaSura6 hours agoNew MemberNew16Views0likes0Comments