topic Data Flow Gen 02 refresh error in Dataflow

Data Flow Gen 02 refresh error

kasun_rumesh — Thu, 12 Dec 2024 08:15:38 GMT

I have created Data Flow Gen 02 to transfer data from a data lakehouse to a data warehouse, with the data warehouse as the final destination.

"There was a problem refreshing the dataflow. Please review the error message(s) below, fix the problem, and try again. (Request ID:).

dimdate: Error Code: Mashup Exception Data Source Error, Error Details: Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: DataSource.Error: Microsoft SQL: Internal system error when attempting to open or create remotely stored delta log file. This error is usually intermittent. Please try the operation again and contact Customer Support Services if this persists. Statement ID:"

The 'failed reason' table is changing from time to time. Is there a way to fix this issue?

Re: Data Flow Gen 02 refresh error

lbendlin — Fri, 13 Dec 2024 00:15:53 GMT

If you have a Pro license you can open a Pro ticket at https://admin.powerplatform.microsoft.com/newsupportticket/powerbi
Otherwise you can raise an issue at https://community.fabric.microsoft.com/t5/Issues/idb-p/Issues .

Re: Data Flow Gen 02 refresh error

TanmayPal52 — Mon, 16 Dec 2024 10:19:59 GMT

I am facing exactly the same issue since last 1 week. I have raised a MS Support Ticket but there has been no progress at all from their end.

I have found a workaround meanwhile. You have to disable staging for each table in dataflow and change the destination from lakehouse to warehouse. Then you can use the copy function in Data pipeline to copy the data from lakehouse to warehouse

Re: Data Flow Gen 02 refresh error

Anonymous — Wed, 18 Dec 2024 07:36:21 GMT

Hi kasun_rumesh ,

Did TanmayPal52 reply solve your problem? If so, please mark it as the correct solution, and point out if the problem persists.

Best regards,

Adamk Kong

Re: Data Flow Gen 02 refresh error

TanmayPal52 — Wed, 18 Dec 2024 08:11:59 GMT

We have found out a solution which is working fine for us. You have to make sure that the owner of the Lakehouses and Datawarehouses logs in frequently. Else you can change the owner of Datawarehouse using PowerShell script. Check the owner of staging lakehouse and staging datawarehouse as well. Alternatively you can create new lakehouse and datawarehouse with your account and change the destination in dataflow to the new lakehouse/datawarehouse. This should resolve the issue.

Re: Data Flow Gen 02 refresh error

kasun_rumesh — Wed, 18 Dec 2024 09:04:55 GMT

No, My data destination already setup as data warehouse. I clearly mentioned that when I raised the question. Copy funaction no useful in my case. Could this be a bug on Microsoft's end?