topic Could not publish the dataflow to lakehouse. in Dataflow

Could not publish the dataflow to lakehouse.

lincoln — Sat, 08 Jul 2023 18:46:50 GMT

Hi all,

I am trying to club many Excel files from SharePoint. For this, I chose data flow gen2. After I created a data flow by combining Excel files tried to publish the table to Lakehouse but this error occurs.

As I was trying to bring all worker's Excel files from SharePoint to Microsoft Fabric but for this I chose dataflow to concatenate all the workers' files in the dataflow/power query of Fabric. Please help find a proper workflow for this approach.

Thank you

Re: Could not publish the dataflow to lakehouse.

miguel — Tue, 11 Jul 2023 14:51:47 GMT

Are you able to reproduce this same behavior in a new workspace? If yes, please reach out to the support team by raising a support ticket so an engineer can take a closer look at it.

https://support.fabric.microsoft.com/support

Re: Could not publish the dataflow to lakehouse.

lincoln — Mon, 31 Jul 2023 05:53:51 GMT

Hi Miguel,

I Tried it in a different workspace but still had the same behavior in a new workspace.

Re: Could not publish the dataflow to lakehouse.

GiladZis — Tue, 01 Aug 2023 06:42:40 GMT

Hi lincoln ,

From what I can see in the logs, it seems that you have white space in one of the entities or attributes names.

Entity and attributes name cannot contain white space.

Hopefully deleting the white space can solve the issue

Re: Could not publish the dataflow to lakehouse.

lincoln — Tue, 01 Aug 2023 16:08:33 GMT

Hi GiladZis ,

As you said I checked if any whitespace is left in the entities, I found one and rectified this. The earlier issue is not showing. But I face this issue now.

It says : There was a problem refreshing your data flow.

I see these signs in my data flow. Please suggest ways to overcome this issue and successfully publish the Data flow to the destination.

Thanks ,

Lincoln.

Re: Could not publish the dataflow to lakehouse.

GiladZis — Wed, 02 Aug 2023 07:25:17 GMT

What do you see when you press on specific error? does it say the error info?
If not, please add RootActivityId so that I can look at the relevant logs

Re: Could not publish the dataflow to lakehouse.

lincoln — Wed, 02 Aug 2023 07:33:54 GMT

Hi GiladZis ,

I get these errors.

Dataflow name

Dataflow refresh status

Table name

Start time

End time

Duration

Engine

Refresh status

Status details

Dataflow 1

Failed

2023-08-01T15:55:17.113+00:00

2023-08-01T15:56:01.393+00:00

00:00:44

Failed

There was a problem refreshing the dataflow. Please review the error message(s) below, fix the problem, and try again. (Request ID: 8e48ba81-a776-4037-93d6-84491922329b).

Dataflow 1

Failed

Query

2023-08-01T15:55:22.607+00:00

2023-08-01T15:55:31.23+00:00

00:00:08

Failed

Error Code: Mashup Exception Data Source Error, Error Details: Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: DataSource.Error: Failed to insert a table. Details: 21-06-2021 (Request ID: 8e48ba81-a776-4037-93d6-84491922329b).

Dataflow name

Dataflow refresh status

Action

Start time

End time

Duration

Engine

Refresh status

Status details

Dataflow 1

Failed

WriteToDatabaseTableFrom_TransformForOutputToDatabaseTableFrom_Query

Idle

Thanks,
Lincoln

Re: Could not publish the dataflow to lakehouse.

miguel — Wed, 02 Aug 2023 22:50:39 GMT

lincoln could you please raise a support ticket through the link below and then share with us that ticket #?

https://support.fabric.microsoft.com/support

That way we can engage directly with you and look deeper into things