Currently, when refreshing multiple Dataflow Gen2 instances through the Dataflow activity in Microsoft Fabric pipelines, the activity returns a generic error message for all failures. However, the specific error messages are logged in the Dataflow Gen2 refresh history. It would greatly enhance troubleshooting and efficiency if the Dataflow activity could relay these specific error messages instead of the generic ones. This improvement would allow users to identify and resolve issues more quickly and accurately within the pipeline process.
It would also be beneficial to maintain a metadata repository for Dataflow Gen2, such as system tables containing a list of Dataflow Gen2 instances and their corresponding Dataflow IDs within the workspace. This would enable dynamic access to the list of dataflows in the data pipeline, improving automation and management of Dataflow Gen2 instances.
makromer
on:
Fabric Data Pipeline should be able to execute dbt...
on:
Customers should ereceive notifications for all th...
miguel
on:
Recent Data and Recent Connections