Forum Discussion

ati_puri's avatar
ati_puri
Icon for Resolver III rankResolver III
1 year ago
Solved

Fabric notebook when run via ADF pipeline trigger run issue

We are invoking our fabric notebook from ADF pipeline(web activity), when it is run manually the notebook writes data to the bronze table, however, when it is triggered/scheduled it runs successfully...
  • ati_puri's avatar
    1 year ago

    Thanks apturlov and BhaveshPatel  for the inputs. The underlying issue was related to the DDL creation issue of one of the staging tables. However, as we used webactivity to invoke fabric notebooks, we could see some timeout issues, due to presence of parent and multiple child notebooks. We did increase the timeout in webactivity in ADF as well as in the child notebook call. This helped us to run the child notebooks completely and successfully. The ideal way will always be utilizing fabric pipelines and its notebooks so that the compute and connection strings remain in one environment to avoid the integreations issues. As webactivity coming out of ADF can have fabric notebook API call limitations which is be avoided in fabric.

     

    Hope this helps other users who are working on the similar objectives.