Dataflow Gen 2: MashupException: The specified path already exists.

gopala000 — Tue, 07 Jan 2025 14:38:35 GMT

I'm evaluating Fabric to decide on the right product for data analytics. I have setup a single dataflow gen2 to move few tables from Azure Sql Database to Lakehouse using the gateway. Initial ingestion was successful. Subsequent run to upsert the changes gave below error on all the tables. I've not enabled staging. Please help to resolve the issue.

Thanks!

Exception details:

Mashup Exception Data Source Error Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: Error in replacing table's content with new data in a version: #{0}., InnerException: #{0} failed to get contents from '#{1}'. Status code: #{2}, description: '#{3}'., Underlying error: AzureDataLakeStorage failed to get contents from 'Url removed'. Status code: 409, description: 'The specified path already exists.'. Details: Reason = DataSource.Error;Microsoft.Data.Mashup.ErrorCode = Lakehouse036;Message = AzureDataLakeStorage failed to get contents from 'Url removed'. Status code: 409, description: 'The specified path already exists.'.;Detail = [DataSourceKind = "Lakehouse", DataSourcePath = "Lakehouse", DataSourceKind.2 = "AzureDataLakeStorage", DataSourcePath.2 = "Url removed", Url = "Url removed"];Message.Format = #{0} failed to get contents from '#{1}'. Status code: #{2}, description: '#{3}'.;Message.Parameters = {"AzureDataLakeStorage", "Url removed", 409, "The specified path already exists."};ErrorCode = 10266;Microsoft.Data.Mashup.Error.Context = User GatewayObjectId: 17c96e15-74d6-4112-a8af-d1348c20f4a6

Warning: Not applying Fast Copy for source below size threshold: (kind: NativeQuery)(complete: True)(rows: 3428)(bytesThreshold: 104857600)(rowsThreshold: 5000000) (RequestId: b6344f5d-c15d-4dfc-ae05-46cf2cfe2ec1)

Re: Dataflow Gen 2: MashupException: The specified path already exists.

Anonymous — Tue, 07 Jan 2025 09:16:21 GMT

Hi gopala000 ,

Is it possible to provide some screenshot information and describe it so that I can answer you as soon as possible.

Best regards,

Adamk Kong

Re: Dataflow Gen 2: MashupException: The specified path already exists.

gopala000 — Tue, 07 Jan 2025 14:39:52 GMT

Anonymous I've attached the screenshots to original post. Thanks!

Re: Dataflow Gen 2: MashupException: The specified path already exists.

gopala000 — Wed, 08 Jan 2025 15:24:08 GMT

Hi Anonymous , Do you have any update on this? It is blocking me currently to apply incremental changes.

topic Re: Dataflow Gen 2: MashupException: The specified path already exists. in Dataflow

Dataflow Gen 2: MashupException: The specified path already exists.

Re: Dataflow Gen 2: MashupException: The specified path already exists.

Re: Dataflow Gen 2: MashupException: The specified path already exists.

Re: Dataflow Gen 2: MashupException: The specified path already exists.