Could not publish the dataflow to lakehouse.

[lincoln]

Hi all,

I am trying to club many Excel files from SharePoint. For this, I chose data flow gen2. After I created a data flow by combining Excel files tried to publish the table to Lakehouse but this error occurs. 

As I was trying to bring all worker's Excel files from SharePoint to Microsoft Fabric but for this I chose dataflow to concatenate all the workers' files in the dataflow/power query of Fabric. Please help find a proper workflow for this approach.

Thank you

[miguel]

@lincoln could you please raise a support ticket through the link below and then share with us that ticket #?

https://support.fabric.microsoft.com/support

That way we can engage directly with you and look deeper into things

[lincoln]

Hi @GiladZis ,

As you said I checked if any whitespace is left in the entities, I found one and rectified this. The earlier issue is not showing. But I face this issue now.

It says : There was a problem refreshing your data flow.

I see these signs in my data flow. Please suggest ways to overcome this issue and successfully publish the Data flow to the destination.

Thanks ,

Lincoln.

[GiladZis]

What do you see when you press on specific error? does it say the error info?
If not, please add RootActivityId so that I can look at the relevant logs

[lincoln]

Hi @GiladZis ,

I get these errors.

Dataflow name

Dataflow refresh status

Table name

Start time

End time

Duration

Engine

Refresh status

Status details

Dataflow 1

Failed

NA

2023-08-01T15:55:17.113+00:00

2023-08-01T15:56:01.393+00:00

00:00:44

NA

Failed

There was a problem refreshing the dataflow. Please review the error message(s) below, fix the problem, and try again. (Request ID: 8e48ba81-a776-4037-93d6-84491922329b).

Dataflow 1

Failed

Query

2023-08-01T15:55:22.607+00:00

2023-08-01T15:55:31.23+00:00

00:00:08

NA

Failed

Error Code: Mashup Exception Data Source Error, Error Details: Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: DataSource.Error: Failed to insert a table. Details: 21-06-2021 (Request ID: 8e48ba81-a776-4037-93d6-84491922329b).

Dataflow name

Dataflow refresh status

Action

Start time

End time

Duration

Engine

Refresh status

Status details

Dataflow 1

Failed

WriteToDatabaseTableFrom_TransformForOutputToDatabaseTableFrom_Query

NA

NA

NA

NA

Idle

NA

Thanks,
Lincoln

[GiladZis]

Hi @lincoln ,

From what I can see in the logs, it seems that you have white space in one of the entities or attributes names.

Entity and attributes name cannot contain white space.

Hopefully deleting the white space can solve the issue

[lincoln]

Hi Miguel,

I Tried it in a different workspace but still had the same behavior in a new workspace. 

[miguel]

Are you able to reproduce this same behavior in a new workspace? If yes, please reach out to the support team by raising a support ticket so an engineer can take a closer look at it.

https://support.fabric.microsoft.com/support