Forum Discussion
Super UserNotebook activity in Data Pipeline
As you stated that the notebooks need to be executed in a particular sequence,so you need to maintain the sequnce config somewhere.
In case if the requirement is to execute the notebooks in any sequnce but sequentailly, you can try the below route (which iI have not tested myself)
Get list of all notebooks within the workspace via REST API leveraging the web activity
pass that array to foreach activity
Super UserYou can design a meta data driven framework rather than multiple notebook activities as you have the option of callng the notebook dynamically:
So you can follow the below frame :
1) Create a parameter called NotebookSeq
and it would have notebook values semicolon seperated as below :
abc;def,ghi
2) use for each activity and make it sequential
and expression would be @split(parameter,';')
3) within for each, use the notebook activity and in notebook add dynamic expression as Item()
So whenever there are new notebooks or deletions or change of sequence, you just need to update the parameter value