Forum Discussion

MarkBurgess's avatar
MarkBurgess
Icon for Advocate I rankAdvocate I
2 years ago
Solved

Querying pipeline run history data

Due to the restrictions with the scheduling options of pipelines, we have ended up with a master pipeline that kicks off individual runs of our other pipelines using an invoke pipeline activity. The runs invoked this way don't appear in the the Monitoring Hub, making it quite difficult to debug individual runs. 

 

Is there a way of querying the pipeline run history data directly so we can pull together our own report were we can see everything we need in one place?

 

Many thanks

Mark

  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi MarkBurgess ,

    Response from Internal Team -


    The issue is fixed, and rolling out to all regions soon. Tentative ETA end of month.



    Hope this is helpful. Please let me know incase of further queries.

7 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable

    Hi MarkBurgess ,

    Thanks for using Fabric Community.
    At this time, we are reaching out to the internal team to get some help on this .
    We will update you once we hear back from them.

    • Anonymous's avatar
      Anonymous
      Not applicable

      Hi MarkBurgess ,

      Response from Internal Team -


      The issue is fixed, and rolling out to all regions soon. Tentative ETA end of month.



      Hope this is helpful. Please let me know incase of further queries.

      • jpeetsma's avatar
        jpeetsma
        New Member

        Hi Anonymous,

         

        What was the fix exactly? Is there a way to query the pipeline runs history now? 

        Thanks.

    • MarkBurgess's avatar
      MarkBurgess
      Icon for Advocate I rankAdvocate I

      HI Anonymous , that's great news, thank you.

       

      Regarding the question around accessing the history data behind the monitoring hub, is that a 'no'?

      • Anonymous's avatar
        Anonymous
        Not applicable

        Hi MarkBurgess ,

        At present we don't have any such kind of option.

        Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

         

        Hope this helps. Please let me know if you have any further queries.

  • FabricPoC's avatar
    FabricPoC
    Regular Visitor

    Well, when invoking another pipeline with [Invoke Pipeline (Legacy)] the runs do not show up in the monitor. They are assigned a pipelineRunId as can be seen in the output tab. However the link does not work.

    In case of using [Invoke Pipeline (Preview)] the runs show up in the monitor, however they are not shown as downstream runs (opposed to ADF or Synapse pipelines). 

    Wondering if the fix is applied already?