topic Re: Dynamically set source connection in copy activity and connection in lookup, script activity in Pipelines

Dynamically set source connection in copy activity and connection in lookup, script activity

Anonymous — Fri, 18 Oct 2024 09:24:09 GMT

Wanted to understand how we can provide the source connection dynamically rather than manually selecting from the dropdown for copy activity, lookup, script, get metadata activity, etc. as we have to deploy the pipeline to other workspaces which uses different connection name (DEV/QA/UAT/PROD).

Re: Dynamically set source connection in copy activity and connection in lookup, script activity

FabianSchut — Fri, 18 Oct 2024 10:32:03 GMT

Unfortunately, that is not possible yet. One workaround is to create a switch on the workspace id and duplicate your activity with the correct connection for that environment. I'm fully aware that that is not maintainable in the long run, but could be a short term workaround until parameters are possible.

Re: Dynamically set source connection in copy activity and connection in lookup, script activity

AngryFabricUser — Thu, 20 Feb 2025 08:15:06 GMT

I personnaly solved this problem by creating a dummy connection to "https://" (nothing else). This is accepted by Fabric.

I can then set the dynamic url using the relative url part.

Re: Dynamically set source connection in copy activity and connection in lookup, script activity

mario91 — Fri, 07 Mar 2025 04:50:16 GMT

Can you please expand with an example? I am looking to do this same thing

Re: Dynamically set source connection in copy activity and connection in lookup, script activity

AngryFabricUser — Fri, 07 Mar 2025 12:21:08 GMT

Hello.

I answered too fast about this one... Fabric does accept to create a "dummy" connection for url "https://" , and it does accept you to add a dynamic relative url to fill the missing part.... BUT this does NOT work .... configuration is "accepted", but when you run the pipeline with the copy data activity it just fails... with a cryptic error.. so.. non.. no way to do that for now.... (was soooo easy in ADF or synapse... Fabric is a dramatic rollback 5 years ago for us...)

Re: Dynamically set source connection in copy activity and connection in lookup, script activity

javito — Thu, 16 Apr 2026 10:29:44 GMT

I solved this creating a REST connection source (I tested with an HTTP connection and it also works) type with a regular url like https://google.com then, in the relative URL driection, I used the URL I want to connect, in my case I tested an API that gives a JSON, the destiny I used was a lakehouse file. When I run the pipeline, my empty file was full of the JSON I wanted to.