Bulk passing of values as notebook parameters

[PedroCSeq]

Hello all!

I'm having some troubles finding a more effecient solution than running the same notebook after each pipeline.
Here is the problem:

I'm trying to log the execution of this pipeline, which itself invoques the same pipeline parameterized many times. The logs notebook is parameterized, obviouslly, with pipeline return values and outputs. As you most likelly know, initialyzing a notebook is not instantaneous and doing that about 10 times in a run just sounds wastefull, excluding the levyCapacity issue that prevents me from having more than 2 (sometimes 2 is too much, fabric is a bit bipolar) spark sessions concurrently fails the execution of the notebook which in this case is very relevant, as the pipelines I'm creating a log of are composed of multiple notebooks themselves.

(the picuture abouve is a visual representation of the solution I want to avoid. It is ok in this case because only the first pipeline invoqued includes notebooks, "solving" the levycapacity problem)
With all the background context given, here goes the actual question:

Is is possible to pass an array of output values(for intance all the 

@activity('').status values for each of these pipelines)

as a single parameter to the notebook in a configuration similar to this?

[Anonymous]

Hi @PedroCSeq ,

Yes, instead of logging this output immediately after each pipeline run, you can collect all pipeline outputs into a list or array and pass this aggregated list to the logging notebook at the end of the main pipeline execution.

Did you encounter any issues or reported errors during the process, you can share your screenshots of the issues and errors with us. This will allow us to better understand and resolve the issues you are experiencing.

Best Regards,

Ada Wang

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[PedroCSeq]

I'm having trouble finding out what pipeline activity I should use to create the list, can you give an example? Also, the notebook's base parameter only have options for types String, Int, Float and Bool, Wouldn't this be a problem?