Dataflow activity - Extracting "Status Details" in Output error

[JT2003]

Hi, 

I would like to extract the "Status Details" from the refresh of a dataflow when it fails, without having to go to the workspace and download the csv or view from the UI. I have the pipeline as below, and the refresh "status details" in the shot of the csv below that . 

I can't find any documentation on how to do this - any advice greatly appreciated ! Thanks JT

[v-menakakota · Accepted solution]

Hi @JT2003 ,
Thank you for reaching out to us on the Microsoft Fabric Community Forum.

Answering to your query on ”extract the Status Details from the refresh of a dataflow when it fails”, Yes, you can use Power Automate to automatically check and store the refresh status of a Dataflow without any manual intervention.

Steps to Monitor and Store Dataflow Refresh Status with Power Automate :

 To create a New Flow in Power Automate do this :

• Go to Power Automate and create a new Scheduled Flow.
• Set the flow to run at the frequency  (e.g., every hour, daily, etc.).

• In your flow, add the "Power BI – Get Dataflow Refresh History" action.
• Sign in to Power BI and provide the necessary permissions.
• Select the Workspace and Dataflow whose refresh status you want to monitor.

Doing this will retrieve the refresh history for the selected dataflow.

To check the Status of the Latest Refresh :

• The Get Dataflow Refresh History action returns an array of refresh records.
• Then filter and select the most recent refresh record.
• To do this  use a Filter Array action to extract the most recent record based on the lastUpdated field.
• Or use "Sort" and "Top" actions to get the latest refresh details.

Now to store the Refresh Status

• After retrieving the latest refresh status (e.g., Succeeded, Failed), you can store it in a variety of locations like SharePoint list or Excel or SQL DB or even teams or email.
  
  If this post was helpful, please give us Kudos and consider marking Accept as solution to assist other members in finding it more easily.
  
  Thank you.
  
  
  

[v-menakakota · Accepted solution]

Hi @JT2003 ,
Thank you for reaching out to us on the Microsoft Fabric Community Forum.

Answering to your query on ”extract the Status Details from the refresh of a dataflow when it fails”, Yes, you can use Power Automate to automatically check and store the refresh status of a Dataflow without any manual intervention.

Steps to Monitor and Store Dataflow Refresh Status with Power Automate :

 To create a New Flow in Power Automate do this :

• Go to Power Automate and create a new Scheduled Flow.
• Set the flow to run at the frequency  (e.g., every hour, daily, etc.).

• In your flow, add the "Power BI – Get Dataflow Refresh History" action.
• Sign in to Power BI and provide the necessary permissions.
• Select the Workspace and Dataflow whose refresh status you want to monitor.

Doing this will retrieve the refresh history for the selected dataflow.

To check the Status of the Latest Refresh :

• The Get Dataflow Refresh History action returns an array of refresh records.
• Then filter and select the most recent refresh record.
• To do this  use a Filter Array action to extract the most recent record based on the lastUpdated field.
• Or use "Sort" and "Top" actions to get the latest refresh details.

Now to store the Refresh Status

• After retrieving the latest refresh status (e.g., Succeeded, Failed), you can store it in a variety of locations like SharePoint list or Excel or SQL DB or even teams or email.
  
  If this post was helpful, please give us Kudos and consider marking Accept as solution to assist other members in finding it more easily.
  
  Thank you.
  
  
  

[v-menakakota]

Hi @JT2003 ,

I just wanted to kindly follow up to see if you had a chance to review the previous response provided by me.Please let me know if it was helpful. If yes, please Accept the answer so that it will be helpful to others to find it quickly.

Thank you.

[v-menakakota]

Hi @JT2003 ,

I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions. If my response has addressed your query, please accept it as a solution and give a 'Kudos' so other members can easily find it.

Thank you.

[v-menakakota]

Hi @JT2003 ,

I wanted to check if you had the opportunity to review the information provided. If my response has addressed your query, please accept it as a solution and give a 'Kudos' so other members can easily find it.

Thank you.

[lbendlin · Accepted solution]

In your flow, add the "Power BI – Get Dataflow Refresh History" action.

That is not a commonly available action. Most likely you created your own custom connector for REST API calls. You would still need to handle the CSV file somehow.