- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Fabric Pipeline: Join result of Lookup activity to Copy activity
Hi,
I am building a simple Fabric data factory pipeline. The pipeline consist of only 2 activities:
1- Lookup activity which get dataset from SQL server database table
2- Copy activity which get data from table from different SQL server database and will save it different SQL server table.
I am trying to join the columns from Lookup activity to columns from copy activity and then save it to destination table.
Is there a way in Fabric data pipeline to do this similar to join activity in Azure data factory? if not is there a workaround?
Regards
Fadi
Solved! Go to Solution.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Unfortunately based on my understanding there is no direct way via Data pipelines in fabric to join on multiple data.Data pipelines are for data movements as is.
For data transformations like JOIN scenarios, you can make use of Dataflow Gen2 in factory experience.
Or notebooks as well if need be
----------------------------------------------------------------------------------------------
Nandan Hegde (MSFT Data MVP)
LinkedIn Profile : www.linkedin.com/in/nandan-hegde-4a195a66
GitHUB Profile : https://github.com/NandanHegde15
Twitter Profile : @nandan_hegde15
MSFT MVP Profile : https://mvp.microsoft.com/en-US/MVP/profile/8977819f-95fb-ed11-8f6d-000d3a560942
Topmate : https://topmate.io/nandan_hegde
Blog :https://datasharkx.wordpress.com
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Unfortunately based on my understanding there is no direct way via Data pipelines in fabric to join on multiple data.Data pipelines are for data movements as is.
For data transformations like JOIN scenarios, you can make use of Dataflow Gen2 in factory experience.
Or notebooks as well if need be
----------------------------------------------------------------------------------------------
Nandan Hegde (MSFT Data MVP)
LinkedIn Profile : www.linkedin.com/in/nandan-hegde-4a195a66
GitHUB Profile : https://github.com/NandanHegde15
Twitter Profile : @nandan_hegde15
MSFT MVP Profile : https://mvp.microsoft.com/en-US/MVP/profile/8977819f-95fb-ed11-8f6d-000d3a560942
Topmate : https://topmate.io/nandan_hegde
Blog :https://datasharkx.wordpress.com

Helpful resources
Subject | Author | Posted | |
---|---|---|---|
08-28-2024 03:58 PM | |||
05-08-2024 02:36 AM | |||
11-04-2024 01:13 AM | |||
03-25-2024 08:04 AM | |||
12-01-2024 07:03 PM |
User | Count |
---|---|
7 | |
6 | |
6 | |
3 | |
3 |