Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Be one of the first to start using Fabric Databases. View on-demand sessions with database experts and the Microsoft product team to learn just how easy it is to get started. Watch now

Reply
joakimfenno
Helper V
Helper V

Template or code generation of data pipelines

I am new to data factory and data pipelines in fabric. 

I will use data pipelines for iongestion and possibly transform as well

 

1)

what options/techniques are available for creating template pipelines? I have seen the predefined templates that comes with fabric but is it possbile to create your own tempates?

 

2)

Is it possbile to genearet data pipelines from code?

if yes, what developments tools can be used? how can the code be deployed to fabric?

1 ACCEPTED SOLUTION
NandanHegde
Super User
Super User

1)You can create the pipeline/template yourself as per your personal use case as per normal data pipeline development :

https://techcommunity.microsoft.com/t5/fasttrack-for-azure/metadata-driven-pipelines-for-microsoft-f...

 

2)Pipelines at the backend are basically JSON code. You can manage/update the JSON code and deploy it via Git sync or Fabric deployment pipelines




----------------------------------------------------------------------------------------------
Nandan Hegde (MSFT Data MVP)
LinkedIn Profile : www.linkedin.com/in/nandan-hegde-4a195a66
GitHUB Profile : https://github.com/NandanHegde15
Twitter Profile : @nandan_hegde15
MSFT MVP Profile : https://mvp.microsoft.com/en-US/MVP/profile/8977819f-95fb-ed11-8f6d-000d3a560942
Topmate : https://topmate.io/nandan_hegde
Blog :https://datasharkx.wordpress.com

View solution in original post

1 REPLY 1
NandanHegde
Super User
Super User

1)You can create the pipeline/template yourself as per your personal use case as per normal data pipeline development :

https://techcommunity.microsoft.com/t5/fasttrack-for-azure/metadata-driven-pipelines-for-microsoft-f...

 

2)Pipelines at the backend are basically JSON code. You can manage/update the JSON code and deploy it via Git sync or Fabric deployment pipelines




----------------------------------------------------------------------------------------------
Nandan Hegde (MSFT Data MVP)
LinkedIn Profile : www.linkedin.com/in/nandan-hegde-4a195a66
GitHUB Profile : https://github.com/NandanHegde15
Twitter Profile : @nandan_hegde15
MSFT MVP Profile : https://mvp.microsoft.com/en-US/MVP/profile/8977819f-95fb-ed11-8f6d-000d3a560942
Topmate : https://topmate.io/nandan_hegde
Blog :https://datasharkx.wordpress.com

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!

ArunFabCon

Microsoft Fabric Community Conference 2025

Arun Ulag shares exciting details about the Microsoft Fabric Conference 2025, which will be held in Las Vegas, NV.

December 2024

A Year in Review - December 2024

Find out what content was popular in the Fabric community during 2024.