Item snapshots in spark session monitoring are not working properly

[Ostrzak]

Hi everyone,

I have a pipeline combining several notebooks. Sometimes when I get an error, I would like to access the item snapshot to see exactly what went wrong and where. For some reason though, only the first notebook's snapshot is loading. I can choose others in the left-hand menu, but it still loads the snapshot of the first one. 

Could someone help me with it? Is it a known issue maybe? It's a pretty small nuisance for opening the support ticket right now.

Thanks 

[anuyogam]

Are you running on high concurrency mode?

[Ostrzak]

Hi, Thank you for answering @jankuc and @jwinchell40 

I will raise a ticket with MS Support, as I currently cannot step away from chaining notebooks in a pipeline. Will see how it goes.

[v-shex-msft]

HI @Ostrzak ,

Any update on this? Did this issue fix or still appeared on your side?

BTW, this issue seems more related to azure pipeline snapshot. If fabric support not helps, you can also report them on azure support side.

Regards,

Xiaoxin Sheng

[jwinchell40]

@Ostrzak - I moved away from chaining together multiple notebooks in a Pipeline.  If I have to run more than 1 or 2 notebooks, I am using a DAG and the RunMultiple() option to orchestrate Notebook processing.  That has seemed to help with being able to dig into item snapshots because there is 1 Snapshot for the DAG but then it allows me to navigate to each individual notebook.  Seems like it works better or at least in my head it is working better.

[jankuc]

We are seeing this problem for about a month now. When we run multiple child notebooks from a data pipeline and try to see the resulting snapshots from the monitoring page, we always see the snapshot only of the first notebook. 

[v-shex-msft]

Hi @Ostrzak ,

Can you please share some more detail information about this issue? They should help us clarify your scenario and test to troubleshoot.

Regards,

Xiaoxin Sheng

[SivaReddy24680]

Hi @v-shex-msft 

We also came across the same issue. Hope these will help in understading the issue. 

We are running multiple notebooks in a single Fabric Pipeline. If one of the notebook is failed and when we try to look at the snapshot to find the where the issue is, it is showing someother table snapshot.

Issue Table(MARC) :

Showing someother tables snapshot(EKKO) :

Note: It is opening the same EKKO snapshot for all the tables irrespective of the table status(success/fail)

[FabianSchut]

I've come across this issue with running pipelines with child activities too. For me it worked to open one acitivity in the monitor and change the url to the notebook and activity you want to watch. You can find these ID's often in the monitor. I haven't checked this for notebook snapshots, but it may work there too. 

[SivaReddy24680]

It is not working from the activites aswell. I can see some notebooks were repeated for some tables