Fabric notebook when run via ADF pipeline trigger run issue

[ati_puri]

We are invoking our fabric notebook from ADF pipeline(web activity), when it is run manually the notebook writes data to the bronze table, however, when it is triggered/scheduled it runs successfully but does not write a single line to the table. Anyone faced this issue? Parameters etc are all correct.

[v-priyankata]

Hi @ati_puri 

Thank you for reaching out to the Microsoft Fabric Forum Community.

@apturlov @BhaveshPatel Thanks you so much for your inputs.

The users' suggestions are quite helpful. Have you been able to try the super user's recommendations? If possible, could you share the points they mentioned so we can better understand and address the issue?

If I misunderstand your needs or you still have problems on it, please feel free to let us know.  

Thanks.

[v-priyankata]

Hi @ati_puri 
Have you had a chance to try the super user’s guidance? If you could share the points they mentioned, it would help us understand the issue better.

If I misunderstand your needs or you still have problems on it, please feel free to let us know.  

Thanks.

[BhaveshPatel]

Hi @ati_puri 

You should check why it is running on the first instance in Delta Lake ( Bronze tables ). You need to share some screenshots. 

[apturlov]

Hi @ati_puri, in your scenario you invoke a Fabric Notebook using Fabric's REST API through external ADF pipeline using a Web activity. Key difference here is that the Notebook is invoked via Fabric's REST API compared to a manual Notebook run via Fabric's UI. I don't have hands-on experienc like that but from your description it looks like the Notebook does not have a Lakehouse destination set when invoked via API. I assume you know that a Notebook in Fabric must have a default Lakehouse to run successfully. Can you check what Lakehouse the Notebook is connected to when invoked via REST API? Also I would want to eliminate potential impact of the ADF's Web activity and try and trigger a Notebook using a REST API directly without ADF from a REST Client, for example.