topic Re: Unable to publish Dataflow Gen2 - Throws Error: issue with the mashup document MashupException.E in Dataflow

Unable to publish Dataflow Gen2 - Throws Error: issue with the mashup document MashupException.Error

tulasirambalu — Sun, 12 Nov 2023 12:02:58 GMT

Hi All,

Yesterday, it workds fine. But today, I am getting this error while publishing the Dataflow Gen2.

Latest On Premise Gateway installed. 3000.198.9 (Nov 2023)

Error Code: 999999, Error Details: Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: The value is not updatable. Details: Reason = Expression.Error;Detail = #table({"Name", "Id", "Data", "Schema", "ItemKind", "ItemName", "IsLeaf"}, {});Microsoft.Data.Mashup.Error.Context = System GatewayObjectId: cdd60905-5e60-4cb1-93eb-a37abe625894 (Request ID: 7100eeed-31c7-4a0c-9581-e1c11f3c30da).

Re: Unable to publish Dataflow Gen2 - Throws Error: issue with the mashup document MashupException.E

miguel — Sun, 12 Nov 2023 12:11:10 GMT

Hi!

could you please raise a support ticket and share that number with us through here?

https://support.fabric.microsoft.com/support

Re: Unable to publish Dataflow Gen2 - Throws Error: issue with the mashup document MashupException.E

tulasirambalu — Sun, 12 Nov 2023 12:24:01 GMT

2311120030000485

Re: Unable to publish Dataflow Gen2 - Throws Error: issue with the mashup document MashupException.E

tulasirambalu — Sun, 12 Nov 2023 14:06:33 GMT

Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: Failed to insert a table., InnerException: Downstream service call to url '#{0}' failed with status code #{1} and error details '#{2}', Underlying error: Downstream service call to url 'https://wabi-india-central-a-primary-redirect.analysis.windows.net/v1.0/myorg/lhdatamarts/6a3ab958-1705-4207-b104-82da8c3f6ac8/batches/6a3ab958-1705-4207-b104-82da8c3f6ac8@54d1fba2-b57e-45ae-974c-9ecdcc95fbad$2023-11-12T13:09:39.3230950Z@252f8b99-ee0f-454a-bbe9-40fe6cb388ab' failed with status code 403 and error details 'Access token has expired, resubmit with a new access token' Details: Reason = DataSource.Error;Message = Downstream service call to url 'https://wabi-india-central-a-primary-redirect.analysis.windows.net/v1.0/myorg/lhdatamarts/6a3ab958-1705-4207-b104-82da8c3f6ac8/batches/6a3ab958-1705-4207-b104-82da8c3f6ac8@54d1fba2-b57e-45ae-974c-9ecdcc95fbad$2023-11-12T13:09:39.3230950Z@252f8b99-ee0f-454a-bbe9-40fe6cb388ab' failed with status code 403 and error details 'Access token has expired, resubmit with a new access token';Detail = [Error = "[code=TokenExpired,message=Access token has expired, resubmit with a new access token]", Errorode = "TokenExpired", RequestId = "b1e05eb5-e5ff-4ea9-88d5-ee910e5fd86a", RequestUrl = "https://wabi-india-central-a-primary-redirect.analysis.windows.net/v1.0/myorg/lhdatamarts/6a3ab958-1705-4207-b104-82da8c3f6ac8/batches/6a3ab958-1705-4207-b104-82da8c3f6ac8@54d1fba2-b57e-45ae-974c-9ecdcc95fbad$2023-11-12T13:09:39.3230950Z@252f8b99-ee0f-454a-bbe9-40fe6cb388ab"];Message.Format = Downstream service call to url '#{0}' failed with status code #{1} and error details '#{2}';Message.Parameters = {"https://wabi-india-central-a-primary-redirect.analysis.windows.net/v1.0/myorg/lhdatamarts/6a3ab958-1705-4207-b104-82da8c3f6ac8/batches/6a3ab958-1705-4207-b104-82da8c3f6ac8@54d1fba2-b57e-45ae-974c-9ecdcc95fbad$2023-11-12T13:09:39.3230950Z@252f8b99-ee0f-454a-bbe9-40fe6cb388ab", 403, "Access token has expired, resubmit with a new access token"};Microsoft.Data.Mashup.Error.Context = System GatewayObjectId: cdd60905-5e60-4cb1-93eb-a37abe625894 (Request ID: 1f887424-cf1e-4f87-9d52-21ce1304a840).

Re: Unable to publish Dataflow Gen2 - Throws Error: issue with the mashup document MashupException.E

tulasirambalu — Sun, 12 Nov 2023 14:12:01 GMT

I downgraded on premise Gateway to 3000.194.16 (Oct 2023) and tried publishing the Dataflow Gen2. Now it throws the above error "403, "Access token has expired, resubmit with a new access token".

Can anyone tell me how can I fix this issue.

Re: Unable to publish Dataflow Gen2 - Throws Error: issue with the mashup document MashupException.E

tulasirambalu — Mon, 13 Nov 2023 03:52:49 GMT

Now it is working fine without doing anything. I understand it may be due to it is under preview.

Re: Unable to publish Dataflow Gen2 - Throws Error: issue with the mashup document MashupException.E

v-cboorla-msft — Mon, 13 Nov 2023 05:27:19 GMT

Hi @tulasirambalu

Glad that your query got resolved. Please continue using Fabric Community for any help regarding your queries.

Re: Unable to publish Dataflow Gen2 - Throws Error: issue with the mashup document MashupException.E

MarioDiaz — Tue, 14 Nov 2023 16:24:58 GMT

Hi there,

I got the same issue when trying to use a Dataflow Gen2 pulling data from Azure Gen2 into a table.
Error Code: 999999, Error Details: The refresh for this entity was canceled. A task was canceled. (Request ID: 6a60f675-9602-4e58-8429-705783529f9d).

Regards,

Re: Unable to publish Dataflow Gen2 - Throws Error: issue with the mashup document MashupException.E

JP8991 — Tue, 21 Nov 2023 01:35:58 GMT

I am having the same issue too.

Re: Unable to publish Dataflow Gen2 - Throws Error: issue with the mashup document MashupException.E

tulasirambalu — Tue, 21 Nov 2023 01:44:05 GMT

Hi, For me, this issue go away on its own. But I tried the Install latest On premise Gateway if you already have it Please restart it and try one more time.

Later I came to know that some work is going on by microsoft on Dataflow Gen2 which may causes this issue becuase it is not consistent.

Re: Unable to publish Dataflow Gen2 - Throws Error: issue with the mashup document MashupException.E

JP8991 — Wed, 22 Nov 2023 23:57:24 GMT

I have restarted the Gateway, recreated the Dataflow and created a new test Datalake and I am still having the same problem.

Re: Unable to publish Dataflow Gen2 - Throws Error: issue with the mashup document MashupException.E

v-cboorla-msft — Fri, 24 Nov 2023 11:22:43 GMT

Hi @MarioDiaz

Thanks for using Fabric Community.

Apologies for the issue that you are facing here.

Try to upgrade the gateway version to latest, this might help me in resolving your issue.

For more details please refer Link.

I hope this helps. Please do let us know if you have any further questions.

Re: Unable to publish Dataflow Gen2 - Throws Error: issue with the mashup document MashupException.E

acitsme — Thu, 01 Feb 2024 10:52:23 GMT

Testing Fabric connecting it to on-premisis Oracle db. Enterprise gateway works with power BI with no issue at all.

Enterprise Gateway is the latest one: 3000.202.16.

Editing the DataflowGen2 connecting Oracle, I can see data in the oreview window but when I publish and refresh it I get this error in Fabric:

There was a problem refreshing the dataflow. Please review the error message(s) below, fix the problem, and try again. (Request ID: 6fcbe8f2-b8d7-4525-b368-6b5380b77f03).

Query: Error Code: 999999, Error Details: Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: External component has thrown an exception. Details: GatewayObjectId: 0da5bc6c-8063-4dd3-a60e-bee3274db1b7 (Request ID: 6fcbe8f2-b8d7-4525-b368-6b5380b77f03).

Here below is the error logged by Enterprise Gateway (just a portion ). Please Help!

Antonio

GatewayPipelineErrorCode=DM_GWPipeline_UnknownError
GatewayVersion=
InnerType=ErrorException
InnerMessage=<ccon>External component has thrown an exception.</ccon>
InnerToString=<ccon>System.Runtime.InteropServices.SEHException: External component has thrown an exception.
at ParquetSharp.RowGroupWriter.RowGroupWriter_Close(IntPtr rowGroupWriter)
at Microsoft.Mashup.Engine1.Library.Parquet.ParquetScalableTableWriter.WriteRowGroup(ParquetFileWriter writer, ParquetRecordWriter recordWriter, Func`2 addRows, Func`1 moveNext, Action accumulate, Int64& count)
at Microsoft.Mashup.Engine1.Library.Parquet.ParquetScalableTableWriter.Write(BinaryValue destination, Func`2 addRows, Func`1 moveNext, SchemaElement schema, WriterProperties properties, Action accumulate)
at Microsoft.Mashup.Engine1.Library.Parquet.ParquetScalableTableWriter.Write(BinaryValue destination, TableValue table, SchemaElement schema, WriterProperties properties, IAccumulator accumulator)
at Microsoft.Mashup.Engine1.Library.Parquet.ParquetQuery.<>c__DisplayClass33_1.<Replace>b__2()
at Microsoft.Mashup.Engine1.Library.Parquet.ParquetExceptionHandler.Invoke[T](Func`1 action)
at Microsoft.Mashup.Engine1.Runtime.ActionValue.BindActionValue.ExecuteBindings()
at Microsoft.Mashup.Engine1.Runtime.ActionValue.BindActionValue.ExecuteBindings()
at Microsoft.Mashup.Engine1.Runtime.ActionValue.BindActionValue.Execute()
at Microsoft.Mashup.Engine1.Library.PersistentCacheExtensions.ClearCacheActionValue.Execute()