Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get certified in Microsoft Fabric—for free! For a limited time, the Microsoft Fabric Community team will be offering free DP-600 exam vouchers. Prepare now

Reply
Pfisterbi
Advocate I
Advocate I

Output details for a Dataflow Gen2 in a Data Pipeline

Hi there
In ADF (legacy) we are able to see the ouput of each step. For example, how many rows have been read, written, etc. 
While this works for a Copy Data activity in Fabric, there are no infos for a Dataflow Gen 2 about the number of rows read, written etc. 
This is what we got in a Data Pipeline by using a Dataflow Gen 2:
{
"transactionId": "61410b1a-1c8c-4d67-88ff-0066149b68d3$1xxxxxxx",
"executionDuration": 46
}

Are there any plans to deliver this infos?

 

1 ACCEPTED SOLUTION
LuitwielerMSFT
Microsoft Employee
Microsoft Employee

Hello! 🙂 

 

We are planning to extend the info provided in the json returned in the pipeline. However, if you want to know more about the number of rows, you can open the refresh history of the dataflow in the workspace:
An overview of refresh history and monitoring for dataflows. - Microsoft Fabric | Microsoft Learn

View solution in original post

2 REPLIES 2
LuitwielerMSFT
Microsoft Employee
Microsoft Employee

Hello! 🙂 

 

We are planning to extend the info provided in the json returned in the pipeline. However, if you want to know more about the number of rows, you can open the refresh history of the dataflow in the workspace:
An overview of refresh history and monitoring for dataflows. - Microsoft Fabric | Microsoft Learn

Thank you @LuitwielerMSFT for your reply.

I am glad that this information will be provided (soon?) as it is really needed in a pro DWH.

The refresh history is not very helpful in our case, as the information needs to be stored in the audit log within the DWH.

I am looking forward to the implementation. Keep up the great work you are doing.

 

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Early Bird pricing ends December 9th.

Oct Fabric Update Carousel

Fabric Monthly Update - October 2024

Check out the October 2024 Fabric update to learn about new features.

October NL Carousel

Fabric Community Update - October 2024

Find out what's new and trending in the Fabric Community.