Parameterize a data connection using copy data activity when extracting data from GBQ to Lakehouse

[sumanthkakarla]

Hello,

I am trying to extract the data from google BQ to lakeshoue, however i have parametarized the google BD SQL, in the same way i would like to parametarize the connection name as well, how can i parametarize the connection name, i tried this below and getting error, any help is greatly appriciated. 

In source connection if i select my connection from dropdown list its working as expected, but not with the parametarized connection.

[v-pgoloju]

Hi @sumanthkakarla,

Just checking in to see if the information shared was helpful in addressing your query regarding parameterizing the connection name in your Google BigQuery to Lakehouse setup. As noted, parameterized connections aren’t currently supported in Fabric pipelines.

Best regards,
Prasanna Kumar

[v-pgoloju]

Hi @sumanthkakarla,

Just checking in to see if the suggested workaround using a PowerShell script in your DevOps pipeline helped with parameterizing the connection name in Fabric pipelines. Let me know if you need any further support or clarification.

Best regards,
Prasanna Kumar

[sumanthkakarla]

Thank you @v-pgoloju 

Do you have any sample powershell script that i can use for this request ? i can refine it as per my requirement.

[v-pgoloju]

Hi @sumanthkakarla,

Thank you for reaching out to the Microsoft Fabric Forum Community.

Currently, fabric pipelines do not support direct parameterization. As an alternative, you can use a PowerShell script within your DevOps pipeline to update the environment connection string with the new value before deploying.

Best regards,
Prasanna Kumar

[GilbertQ]

Hi @sumanthkakarla 

As far as I'm aware, currently parameterized connections are not supported. You can create or vote for the idea here. https://community.fabric.microsoft.com/t5/Fabric-Ideas/idb-p/fbc_ideas 

[sumanthkakarla]

Thank you @GilbertQ , the parametrised connection is working for me as expected, we can close the thread.

The only problem i am facing right now is creating a deployment rules for data pipeline, what i heard from Microsoft was deployment rules are not supported for data pipelines, its a manual effort once we migrate the data pipeline to stage or prod workspace to update all the pipeline parameter values.

Thank you @v-pgoloju , like you said may be i can give it a try using  power shell script to update the pipeline parameter values.

[sumanthkakarla]

Thank you @GilbertQ , its real surprising that it wont support parameterized connections, so always there is some manual intervenion is needed after deployment, hum... there should be another way...