Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
spencer_sa
Frequent Visitor

Calling Spark Job Definitions from within Fabric pipelines

Is anyone aware of any plans to allow Fabric pipelines to call Spark Job Definitions?
Currently there's no activity for it nor anything in the roadmap suggesting it will happen.

Full-fat ADF does have this ability, so I'm wondering if this is planned?

1 ACCEPTED SOLUTION
v-nikhilan-msft
Community Support
Community Support

Hi @spencer_sa 
Thanks for using Fabric Community.
As you have mentioned, activities to call Spark Job Definitions from pipelines are not available. But this is planned for future. We do not have any ETA yet. I will keep you posted regarding the updates.

Hope this helps. Please let me know if you have any further questions.

View solution in original post

2 REPLIES 2
kuldeep_jaimini
New Member

Hi, As I understood from your response and Fabric documentation that Spark Job definition is not avaialble as an activity in Fabric data pipeleine yet. But is there any documentation which shows that, how to trigger a Fabric data pipeline from Spark Job definition?

v-nikhilan-msft
Community Support
Community Support

Hi @spencer_sa 
Thanks for using Fabric Community.
As you have mentioned, activities to call Spark Job Definitions from pipelines are not available. But this is planned for future. We do not have any ETA yet. I will keep you posted regarding the updates.

Hope this helps. Please let me know if you have any further questions.

Helpful resources

Announcements
Europe Fabric Conference

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

AugFabric_Carousel

Fabric Monthly Update - August 2024

Check out the August 2024 Fabric update to learn about new features.

September Hackathon Carousel

Microsoft Fabric & AI Learning Hackathon

Learn from experts, get hands-on experience, and win awesome prizes.

Sept NL Carousel

Fabric Community Update - September 2024

Find out what's new and trending in the Fabric Community.