Fabric Pipeline: Join result of Lookup activity to Copy activity

fadimac — Fri, 19 Apr 2024 04:44:01 GMT

Hi,
I am building a simple Fabric data factory pipeline. The pipeline consist of only 2 activities:
1- Lookup activity which get dataset from SQL server database table

2- Copy activity which get data from table from different SQL server database and will save it different SQL server table.

I am trying to join the columns from Lookup activity to columns from copy activity and then save it to destination table.
Is there a way in Fabric data pipeline to do this similar to join activity in Azure data factory? if not is there a workaround?

Regards
Fadi

Re: Fabric Pipeline: Join result of Lookup activity to Copy activity

NandanHegde — Fri, 19 Apr 2024 04:53:31 GMT

Unfortunately based on my understanding there is no direct way via Data pipelines in fabric to join on multiple data.Data pipelines are for data movements as is.

For data transformations like JOIN scenarios, you can make use of Dataflow Gen2 in factory experience.

Or notebooks as well if need be

topic Re: Fabric Pipeline: Join result of Lookup activity to Copy activity in Pipelines

Fabric Pipeline: Join result of Lookup activity to Copy activity

Re: Fabric Pipeline: Join result of Lookup activity to Copy activity