Forum Discussion

Dinosauris's avatar
Dinosauris
Icon for Helper I rankHelper I
2 years ago
Solved

Running a Fabric Notebook as Spark Job.

Hello,   I am interested in converting a Fabric notebook that I’ve created, containing multiple transformation steps, into a Spark job. However, I’m struggling to find comprehensive documentation o...
data engineering
  • Dinosauris's avatar
    Dinosauris
    2 years ago

    Hello!

     

    In the meantime we decided to run the Fabric notebooks via pipelines for the use case.

     

    Thank you anyways for the help! 🙂

Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi Dinosauris 
Apologies for the issue you have been facing.
You can also run your notebooks using Notebook activity in pipelines. Pipeline has more powerful features. And some mssparkutils APIs are not supported in Spark Job Definition.
For more information please refer to this link:
Notebook activity - Microsoft Fabric | Microsoft Learn
Scheduling Notebooks in Microsoft Fabric + Reading JSON from Dynamic File Paths (youtube.com)

Hope this helps. Please let me know if you have any further questions.


Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi Dinosauris 
Apologies for the delay in response. 

Please go ahead and raise a support ticket to reach our support team: Link 

After creating a Support ticket please provide the ticket number as it would help us to track for more information.

Thanks.