topic Re: fabric ci/cd release pipeline in Data Engineering

fabric ci/cd release pipeline

arkiboys2 — Fri, 17 Jan 2025 09:04:52 GMT

hello,

I am in the process of setting-up the releas epipeline from dev to test.

in the dev workspace which has data factory, etc.), the connections are to dev sql server.

how can I make sure in test the connections are pointing to test sql server?

thank you

Re: fabric ci/cd release pipeline

Srisakthi — Fri, 17 Jan 2025 09:13:21 GMT

Hi arkiboys2 ,

You can utilise Fabric deployment pipeline for deploying from one environment to another. There you have an option of pointing to target db by using deployment rules.

Reference : https://learn.microsoft.com/en-us/fabric/cicd/deployment-pipelines/create-rules?tabs=new-ui

Regards,

Srisakthi

Re: fabric ci/cd release pipeline

nilendraFabric — Fri, 17 Jan 2025 10:19:08 GMT

Hello arkiboys2 ,

Srisakthi pointed you to right direction, here is step by step guide to create rules:

Open your deployment pipeline in Fabric.
Click on the settings icon (gear) in the upper-right corner of the pipeline.
In the settings pane, select the "Rules" tab.
Click on "New rule" to create a rule.
Configure the rule:
- Choose the item type (e.g., "SQL Server connection")
- Select the specific items or "All items" of that type
- Choose the action (e.g., "Update connection string")
- For connection string updates:
  - In the "Find" field, enter the part of the connection string to be replaced
  - In the "Replace" field, enter the new value
  - In the "Find" field, enter the dev SQL Server details (e.g., Server=dev-sql-server.database.windows.net).
  - In the "Replace" field, enter the test SQL Server details (e.g., Server=test-sql-server.database.windows.net).
- Select which stage to apply the rule to (e.g., "Apply to Test stage")
- Name your rule
Click "Create" to save the rule.
The new rule will appear in the list of rules for the pipeline.

This process allows you to automatically update connection strings when deploying from dev to test, ensuring that your connections point to the correct SQL server in each environment.

Re: fabric ci/cd release pipeline

arkiboys2 — Fri, 17 Jan 2025 10:59:49 GMT

Hi,in your step number 3, I am unable to locate the rules tab in the settings.

I can access the create rules via the deployment screen with a little lightning icon at the bottom.

Question. I am unable to set rules for pipelines eventhough the pipelines use the copy activity and connect to sql server instance.

any suggestions why it does not allow rules ? thank you

Re: fabric ci/cd release pipeline

nilendraFabric — Fri, 17 Jan 2025 11:44:46 GMT

Hello arkiboys2 ,

Please check the screenshots

Re: fabric ci/cd release pipeline

arkiboys2 — Fri, 17 Jan 2025 11:49:10 GMT

Question. I am unable to set rules for pipelines eventhough the pipelines use the copy activity and connect to sql server instance.

any suggestions why it does not allow rules ? thank you

Re: fabric ci/cd release pipeline

nilendraFabric — Fri, 17 Jan 2025 11:54:09 GMT

Please share the screenshot here , so that I can have a look what you are trying to do

Re: fabric ci/cd release pipeline

arkiboys2 — Fri, 17 Jan 2025 13:17:26 GMT

there is no option for each of these pipelines to change the sql server connection

Re: fabric ci/cd release pipeline

Srisakthi — Mon, 20 Jan 2025 13:24:02 GMT

Hi arkiboys2 ,

Currently deployment rules for data pipeline is not supported.

Regards,

Srisakthi

Re: fabric ci/cd release pipeline

v-aatheeque — Wed, 22 Jan 2025 06:49:24 GMT

Hi arkiboys2

If nilendraFabric Srisakthi 's response helped you resolve your issue, please consider marking it as the accepted answer. If you found this information helpful, I would greatly appreciate your kudos. Thank you!

If you still encounter any issues, don’t hesitate to reach out for further assistance!

Re: fabric ci/cd release pipeline

arkiboys2 — Wed, 22 Jan 2025 06:57:59 GMT

Do you mean my data factory pipeline pointing to dev can not be updated to point to prod using the fabric ci/cd pipeline deployment rules?

Thanks

Re: fabric ci/cd release pipeline

nilendraFabric — Wed, 22 Jan 2025 07:01:45 GMT

Hi arkiboys2

Deployment rules in Fabric deployment pipelines do not currently support changing data source connections for data factory pipelines. This means that a pipeline pointing to a dev data source cannot be automatically updated to point to a prod data source during deployment.