topic Re: Dynamic connection to sources in Fabric in Pipelines

Dynamic connection to sources in Fabric

Don-Bot — Mon, 06 Jan 2025 14:26:23 GMT

Hi, I'm looking at converting my data pipelines over to Fabric and I was wondering if there is an ability to use parameters like we can in Azure Data Factory and Synapse in Fabric Data Pipelines?

I found this link from a year ago stating it wasn't supported yet: Dynamic Connections

But I haven't found anything since.

Below is a sample of what i want to parameterize.

This is the connection used in the initial Lookup activity.

Re: Dynamic connection to sources in Fabric

Anonymous — Tue, 07 Jan 2025 01:33:51 GMT

Hi Don-Bot

You can now use parameters in Fabric Data Pipelines, just like in Azure Data Factory and Synapse.

This feature allows you to create dynamic and flexible data pipelines by passing external values into pipeline resources. You can use parameters alone or as part of an expression.

For example, you can parameterize connection details such as server name, database name, and authentication type.

The following links are the latest content on parameterization:

Parameters - Microsoft Fabric | Microsoft Learn

I hope this helps. If you have any further questions about this issue, please let me know.

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Re: Dynamic connection to sources in Fabric

Don-Bot — Tue, 07 Jan 2025 14:13:32 GMT

Thank you for the reply Anonymous ,

You stated that it works just like in Synapse and Data Factory Pipelines but I see a difference when I try to work with parameters in a connection.

In Synapse you see what i have above. Where I can set the parameters for things like ServerName, Database Name and what not for the Linked Service Properties.

For Fabric it looks like I'm restricted to the connection. Which may not be a deal breaker but I wanted to confirm that I can't pass more than that through.

And is the ability to use dynamic content for connections limited to the lakehouse and other fabric offerings? And not a connection to something like SQL Server? Which I believe was

Re: Dynamic connection to sources in Fabric

NandanHegde — Tue, 07 Jan 2025 14:29:05 GMT

Don-Bot

Unfortunately , that level of parameterization of connection details is yet not available in fabirc as of today.

Fabric lacks dyanmic aspects of connections details and Key vault linkage as of today.

The only thing that can be parameterized is the connection name within the source/sink but not the connection aspect details like server name etc

Re: Dynamic connection to sources in Fabric

Anonymous — Wed, 08 Jan 2025 01:30:31 GMT

Hi Don-Bot

Thanks to NandanHegde for helping explain. Please forgive me for any mistakes in expression.

You can pass parameters for the connection itself, but not for individual properties like ServerName or DatabaseName within the connection.

The use of dynamic content is indeed more limited. I am sure you have realized this during your testing.

Apologies again!

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.