Forum Discussion

DebbieE's avatar
DebbieE
Icon for Community Champion rankCommunity Champion
2 years ago

Pipeline containing 5 notebooks. can it be parameterised

I have the following pipeline   They have to be run asynchrnously in this order   I wonder if there was a way to parameterise so you only need one notebook that runs for each item?    I g...
data engineering
data pipeline
frithjof_v's avatar
frithjof_v
Icon for Community Champion rankCommunity Champion
2 years ago

Any particular reason why you don't process all the tables inside one notebook?

  • DebbieE's avatar
    DebbieE
    Icon for Community Champion rankCommunity Champion
    2 years ago

    Yes. To keep each notebook as simple as possible, Otherwise it would be really long. In the same way as I would process each as a stored procedure