Dataflow refresh transaction failed with status 22

[alozovoy]

Executing a dataflow within a Fabric pipeline frequently fails with the following error message:

Error code 20302 link directs to this page: Troubleshoot connectors - Azure Data Factory & Azure Synapse | Microsoft Learn

The dataflow copies a table from an Excel file on Sharepoint to a fabric lakehouse table. The Excel file typically does not change between each dataflow run. The dataflow runs successfully ~90% of the time, but sometimes fails with the above error message.

Has anyone else run into a similar error message?

[Max_]

Hi All - This might not be the solution for @alozovoy  issue, but I came across this post as I had the same issue in one of my pipelines. However, I discovered that the dataflow itself failed. Opening the "Recent runs" overview for the dataflow via the workspace gave a specific error message. With that, I was able to solve the error, so the dataflow and pipeline can be refreshed again. 

[Shubham04]

Hi, 
I'm facing this exact issue and seems there is no workaround mentioned anywhere. Do we have solution to this yet?

Thanks

Shubham

[paul_hasell]

Hi, I raised a support call with MS and they are working on a fix but no ETA on it I'm afraid. The only 'reliable' workaround we have found is to forego the use of Lakehouse tables and use Azure SQL as the source/target instead. We're hoping that when the issue is final resolved we can use Lakehouse as it's a cleaner solution.

[ericb_123]

(Appears to be the) Same issue experienced - ingestion from SQL Managed Instance, via On-premise Gateway.

Will submit a support ticket and hope they can provide more information.

[Anonymous]

Hi @alozovoy 

Apologies for the inconvenience.

Please reach out to our support team to gain deeper insights and explore potential solutions. It's highly recommended that you reach out to our support team. Their expertise will be invaluable in suggesting the most appropriate approach.

Please go ahead and raise a support ticket to reach our support team:

https://support.fabric.microsoft.com/support

After creating a Support ticket please provide the ticket number as it would help us to track for more information.

Thank you.

[paul_hasell]

Hi, this is happening frequently but randomly for a customer, it's not workload or CU dependent, it's making the use of Fabric impossible for production workloads of even the lightest order. We'll likely have to revert to SQL/ADF for reliability despite MS promoting Fabric as an alternative.

[Anonymous]

Hi @alozovoy 
We haven’t heard from you on the last response and was just checking back to see if your query got resolved. Otherwise, will respond back with the more details and we will try to help.
Thanks

[JeffGray]

I experienced exactly the same failure this morning, with exactly the same use case. . . Dataflow Gen 2 retrieving data from an Excel file on Sharepoint.  Ran succesfully each hour previous to this one run since the schedule was launched yesterday morning.  Failed at 12:42AM and then has run succesfully every hour since.

[JeffGray]

Prior successful pipeline run id is: 14563582-ca01-46a9-bbfd-b5394cb61312

failed run id is: 75ed2f1e-ca19-4e8e-94e8-40b695ea3b20

subsequent successful run id: is 2cdd4d07-8264-4646-87bf-1c45ba12652d