Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Don't miss out! 2025 Microsoft Fabric Community Conference, March 31 - April 2, Las Vegas, Nevada. Use code MSCUST for a $150 discount. Prices go up February 11th. Register now.

Reply
joakimfenno
Helper V
Helper V

Template or code generation of data pipelines

I am new to data factory and data pipelines in fabric. 

I will use data pipelines for iongestion and possibly transform as well

 

1)

what options/techniques are available for creating template pipelines? I have seen the predefined templates that comes with fabric but is it possbile to create your own tempates?

 

2)

Is it possbile to genearet data pipelines from code?

if yes, what developments tools can be used? how can the code be deployed to fabric?

1 ACCEPTED SOLUTION
NandanHegde
Super User
Super User

1)You can create the pipeline/template yourself as per your personal use case as per normal data pipeline development :

https://techcommunity.microsoft.com/t5/fasttrack-for-azure/metadata-driven-pipelines-for-microsoft-f...

 

2)Pipelines at the backend are basically JSON code. You can manage/update the JSON code and deploy it via Git sync or Fabric deployment pipelines




----------------------------------------------------------------------------------------------
Nandan Hegde (MSFT Data MVP)
LinkedIn Profile : www.linkedin.com/in/nandan-hegde-4a195a66
GitHUB Profile : https://github.com/NandanHegde15
Twitter Profile : @nandan_hegde15
MSFT MVP Profile : https://mvp.microsoft.com/en-US/MVP/profile/8977819f-95fb-ed11-8f6d-000d3a560942
Topmate : https://topmate.io/nandan_hegde
Blog :https://datasharkx.wordpress.com

View solution in original post

1 REPLY 1
NandanHegde
Super User
Super User

1)You can create the pipeline/template yourself as per your personal use case as per normal data pipeline development :

https://techcommunity.microsoft.com/t5/fasttrack-for-azure/metadata-driven-pipelines-for-microsoft-f...

 

2)Pipelines at the backend are basically JSON code. You can manage/update the JSON code and deploy it via Git sync or Fabric deployment pipelines




----------------------------------------------------------------------------------------------
Nandan Hegde (MSFT Data MVP)
LinkedIn Profile : www.linkedin.com/in/nandan-hegde-4a195a66
GitHUB Profile : https://github.com/NandanHegde15
Twitter Profile : @nandan_hegde15
MSFT MVP Profile : https://mvp.microsoft.com/en-US/MVP/profile/8977819f-95fb-ed11-8f6d-000d3a560942
Topmate : https://topmate.io/nandan_hegde
Blog :https://datasharkx.wordpress.com

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Prices go up Feb. 11th.

JanFabricDE_carousel

Fabric Monthly Update - January 2025

Explore the power of Python Notebooks in Fabric!

JanFabricDW_carousel

Fabric Monthly Update - January 2025

Unlock the latest Fabric Data Warehouse upgrades!