DevOps with Fabric items not in Github

[-Blair-]

I am in the process of building out a DevOps solution for Microsoft Fabric. It needs to have an IaC component and a CI/CD component. The workspaces are all synced with GitHub to a branch for each environment.

With most of the items, I can create them manually and get the definitions from the repo for the IaC deployment, and then use the updates in the repo for the CI/CD, however there is a few items, such as Event Stream which do not sync back to the repo. What's the best aproach to get the definitions for these?

I started going down the aproach of building a python script to call POST https://api.fabric.microsoft.com/v1/workspaces/{workspace_id}/items/{item_id}/getDefinition, and using the service principal for authentication, but aparantly that's not supported. I tried executing it under a local acount and hit permissions issues.

[datacoffee]

Hello again

This is just announced from Microsoft - Eventstream in CI/CD

Link

enjoy 😊

cheers

[-Blair-]

If you can't get the definition out, how do you deploy the items which are not in GitHub across the environments?

Also, how would you perform a pull request to merge from a feature branch into developement and deploy the updates to these items across the environments if you can't get out the code base.

I really hope the answer is not 'recreate them manually or deploy code manually in each environment'

Below are the items I am using which are either 'unsuported' or '-' with Github.

• Eventhouse
• Eventhouse - KQL database
• Eventstream
• Lakehouse - Semantic Model
• Lakehouse - SQL Analytics Endpoint
• Reflex

[datacoffee · Accepted solution]

As of this moment in time, there is a lack of CI/CD capabilities in Real-Time Intelligence.

Frank Geisler has a PowerShell plugin which can do all the things that are available for deployment and configuration. He is building this with help from the product group in Microsoft. So when APIs and features become available, the module will be updated.

Frank-Geisler/powerrti: This is a PowerShell Module that can help automate tasks with Fabric Real-Ti...

Until more news are coming, this is what we have to work with

[-Blair-]

Thanks, I'll check that out.

Well that's interesting. This morning my reflex item asked to be commited. I don't see anything around Data Activator and GitHub in the release schedule, so hope it's here to stay.

The Eventhouse is sycned as well now.

It looks to be just the Event Stream which isn't working with Github.

[-Blair-]

I am in the process of building out a DevOps solution for Microsoft Fabric. It needs to have an IaC component and a CI/CD component. The workspaces are all synced with GitHub to a branch for each environment.

With most of the items, I can create them manually and get the definitions from the repo for the IaC deployment, and then use the updates in the repo for the CI/CD, however there is a few items, such as Event Stream which do not sync back to the repo. What's the best aproach to get the definitions for these?

I started going down the aproach of building a python script to call POST https://api.fabric.microsoft.com/v1/workspaces/{workspace_id}/items/{item_id}/getDefinition, and using the service principal for authentication, but aparantly that's not supported. I tried executing it under a local acount and hit permissions issues.

[datacoffee]

Hello

Right now the Eventstream item in Fabric cannot be synced in a CI/CD setup. The underlying elements of the Eventstream is still in the making of being translated to a "readable" language. 

I hope something will happen with these items in the near future

Cheers, Brian