Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Enhance your career with this limited time 50% discount on Fabric and Power BI exams. Ends August 31st. Request your voucher.

Reply
PedroCSeq
Frequent Visitor

Bulk passing of values as notebook parameters

Hello all!

I'm having some troubles finding a more effecient solution than running the same notebook after each pipeline.
Here is the problem:

PedroCSeq_0-1720719454107.png

I'm trying to log the execution of this pipeline, which itself invoques the same pipeline parameterized many times. The logs notebook is parameterized, obviouslly, with pipeline return values and outputs. As you most likelly know, initialyzing a notebook is not instantaneous and doing that about 10 times in a run just sounds wastefull, excluding the levyCapacity issue that prevents me from having more than 2 (sometimes 2 is too much, fabric is a bit bipolar) spark sessions concurrently fails the execution of the notebook which in this case is very relevant, as the pipelines I'm creating a log of are composed of multiple notebooks themselves.

PedroCSeq_1-1720720071783.png

(the picuture abouve is a visual representation of the solution I want to avoid. It is ok in this case because only the first pipeline invoqued includes notebooks, "solving" the levycapacity problem)
With all the background context given, here goes the actual question:

PedroCSeq_2-1720720421357.png

 


Is is possible to pass an array of output values(for intance all the 

@activity('').status values for each of these pipelines)

as a single parameter to the notebook in a configuration similar to this?

2 REPLIES 2
Anonymous
Not applicable

Hi @PedroCSeq ,

Yes, instead of logging this output immediately after each pipeline run, you can collect all pipeline outputs into a list or array and pass this aggregated list to the logging notebook at the end of the main pipeline execution.


Did you encounter any issues or reported errors during the process, you can share your screenshots of the issues and errors with us. This will allow us to better understand and resolve the issues you are experiencing.

 

Best Regards,

Ada Wang

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

I'm having trouble finding out what pipeline activity I should use to create the list, can you give an example? Also, the notebook's base parameter only have options for types String, Int, Float and Bool, Wouldn't this be a problem?

PedroCSeq_0-1720772980844.png

 

Helpful resources

Announcements
July 2025 community update carousel

Fabric Community Update - July 2025

Find out what's new and trending in the Fabric community.

June FBC25 Carousel

Fabric Monthly Update - June 2025

Check out the June 2025 Fabric update to learn about new features.