Forum Discussion
CopyJob - add to Invoke Pipeline?
- Anonymous1 year ago
Hi fb200 ,
The roadmap does not see a rollout plan for the feature to use copy jobs (preview) in the data pipeline at the moment:
What's new and planned for Data Factory in Microsoft Fabric - Microsoft Fabric | Microsoft Learn
You can give feedback on Home.
Data Factory Dataflow Gen2 also offers incremental importing. This feature allows you to load only new or updated data, thus increasing the efficiency of data loading. This is similar to the incremental import feature of Copy Job.
For more information and examples, please refer to the official documentation below:
Incremental refresh in Dataflow Gen2 - Microsoft Fabric | Microsoft Learn
Pattern to incrementally amass data with Dataflow Gen2 - Microsoft Fabric | Microsoft Learn
If you have any other questions please feel free to contact me.
Best Regards,
Yang
Community Support TeamIf there is any post helps, then please consider Accept it as the solution to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!
Hi fb200 ,
The roadmap does not see a rollout plan for the feature to use copy jobs (preview) in the data pipeline at the moment:
What's new and planned for Data Factory in Microsoft Fabric - Microsoft Fabric | Microsoft Learn
You can give feedback on Home.
Data Factory Dataflow Gen2 also offers incremental importing. This feature allows you to load only new or updated data, thus increasing the efficiency of data loading. This is similar to the incremental import feature of Copy Job.
For more information and examples, please refer to the official documentation below:
Incremental refresh in Dataflow Gen2 - Microsoft Fabric | Microsoft Learn
Pattern to incrementally amass data with Dataflow Gen2 - Microsoft Fabric | Microsoft Learn
If you have any other questions please feel free to contact me.
Best Regards,
Yang
Community Support Team
If there is any post helps, then please consider Accept it as the solution to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!
Hi Yang,
I really appreciate your support. I tried the OData connector in Gen2, but the authentication options were only anonymous and basic. It seems this has been updated.
I will give this a try again.
Thanks
Florian