Data Flow Gen 02 refresh error

[kasun_rumesh]

I have created Data Flow Gen 02 to transfer data from a data lakehouse to a data warehouse, with the data warehouse as the final destination.

"There was a problem refreshing the dataflow. Please review the error message(s) below, fix the problem, and try again. (Request ID:).

 

dimdate: Error Code: Mashup Exception Data Source Error, Error Details: Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: DataSource.Error: Microsoft SQL: Internal system error when attempting to open or create remotely stored delta log file. This error is usually intermittent. Please try the operation again and contact Customer Support Services if this persists. Statement ID:"

The 'failed reason' table is changing from time to time. Is there a way to fix this issue?

[TanmayPal52]

We have found out a solution which is working fine for us. You have to make sure that the owner of the Lakehouses and Datawarehouses logs in frequently. Else you can change the owner of Datawarehouse using PowerShell script. Check the owner of staging lakehouse and staging datawarehouse as well. Alternatively you can create new lakehouse and datawarehouse with your account and change the destination in dataflow to the new lakehouse/datawarehouse. This should resolve the issue.

[v-kongfanf-msft]

Hi @kasun_rumesh ,

Did @TanmayPal52  reply solve your problem? If so, please mark it as the correct solution, and point out if the problem persists.

Best regards,

Adamk Kong

[kasun_rumesh]

No, My data destination already setup as data warehouse. I clearly mentioned that when I raised the question. Copy funaction no useful in my case. Could this be a bug on Microsoft's end?

[TanmayPal52]

I am facing exactly the same issue since last 1 week. I have raised a MS Support Ticket but there has been no progress at all from their end.

I have found a workaround meanwhile. You have to disable staging for each table in dataflow and change the destination from lakehouse to warehouse. Then you can use the copy function in Data pipeline to copy the data from lakehouse to warehouse

[lbendlin]

If you have a Pro license you can open a Pro ticket at https://admin.powerplatform.microsoft.com/newsupportticket/powerbi
Otherwise you can raise an issue at https://community.fabric.microsoft.com/t5/Issues/idb-p/Issues .