topic Re: Querying pipeline run history data in Pipelines

Querying pipeline run history data

MarkBurgess — Wed, 08 May 2024 09:48:25 GMT

Due to the restrictions with the scheduling options of pipelines, we have ended up with a master pipeline that kicks off individual runs of our other pipelines using an invoke pipeline activity. The runs invoked this way don't appear in the the Monitoring Hub, making it quite difficult to debug individual runs.

Is there a way of querying the pipeline run history data directly so we can pull together our own report were we can see everything we need in one place?

Many thanks

Mark

Re: Querying pipeline run history data

Anonymous — Wed, 08 May 2024 18:01:00 GMT

Hi MarkBurgess ,

Thanks for using Fabric Community.
At this time, we are reaching out to the internal team to get some help on this .
We will update you once we hear back from them.

Re: Querying pipeline run history data

Anonymous — Thu, 09 May 2024 07:34:19 GMT

Hi MarkBurgess ,

Response from Internal Team -

The issue is fixed, and rolling out to all regions soon. Tentative ETA end of month.

Hope this is helpful. Please let me know incase of further queries.

Re: Querying pipeline run history data

MarkBurgess — Thu, 09 May 2024 08:16:39 GMT

HI Anonymous , that's great news, thank you.

Regarding the question around accessing the history data behind the monitoring hub, is that a 'no'?

Re: Querying pipeline run history data

Anonymous — Fri, 10 May 2024 07:14:04 GMT

Hi MarkBurgess ,

At present we don't have any such kind of option.

Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

Hope this helps. Please let me know if you have any further queries.

Re: Querying pipeline run history data

jpeetsma — Tue, 16 Jul 2024 06:54:18 GMT

Hi Anonymous,

What was the fix exactly? Is there a way to query the pipeline runs history now?

Thanks.

Re: Querying pipeline run history data

mashru — Mon, 22 Jul 2024 14:17:20 GMT

I am having the same issue right now. I believe the fix has not been rolled out yet. Can you please confirm?

Re: Querying pipeline run history data

FabricPoC — Thu, 27 Mar 2025 14:27:05 GMT

Well, when invoking another pipeline with [Invoke Pipeline (Legacy)] the runs do not show up in the monitor. They are assigned a pipelineRunId as can be seen in the output tab. However the link does not work.

In case of using [Invoke Pipeline (Preview)] the runs show up in the monitor, however they are not shown as downstream runs (opposed to ADF or Synapse pipelines).

Wondering if the fix is applied already?