topic Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document in Dataflow

Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

andyemiller — Fri, 10 Nov 2023 19:39:59 GMT

I am receiving the following error when my dataflow (gen 2) attempts to sync data from Salesforce to Lakehouse.

Error Code: 999999, Error Details: Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: DataSource.Error: Failed to insert a table., InnerException: Unable to create a table on the Lakehouse SQL catalog due to metadata refresh failure

I have deleted the original tables in the Lakehouse, but I am receiving the same error messages. I created a new dataflow (gen 2) with different data and received the same error message. I have created a new lakehouse altogether and tested the original dataflow (noted above) and new dataflow (gen 2) without success. I keep getting this metadata error.

Your assistance would be appreciated.

Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

v-cboorla-msft — Sat, 11 Nov 2023 05:52:47 GMT

Hi andyemiller

Thanks for using Fabric Community.

Sorry for the inconvenience that you are facing.

Currently there is ongoing bug with some similar issue "Couldn't refresh the entity because of an issue with the mashup document".

I will reach to the internal team on the issue. I will update you once I hear from them.

Meanwhile you can refer to the below links where OP has resolved the similar kind of issue with some workarounds.

Link1

Link2

Appreciate your patience.

Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

tdenbow — Sat, 11 Nov 2023 06:12:19 GMT

I am getting same error and neither of the workarounds worked for me.

Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

Cbrull — Tue, 14 Nov 2023 17:55:41 GMT

I have the same error. I need a solution.

Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

andyemiller — Tue, 14 Nov 2023 18:21:07 GMT

I had to recreate the Lakehouse and Warehouse to overcome the challenge.

Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

v-cboorla-msft — Fri, 24 Nov 2023 10:56:12 GMT

Hi andyemiller

Follow up to see you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others.

In case if the issue still persists please upgrade the gateway version to the latest, this might help me in resolving the issue.

Please refer to the Link for more details on the latest gateway version.

I hope this helps. Please do let us know if you have any further questions.

Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

v-cboorla-msft — Mon, 27 Nov 2023 04:21:30 GMT

Hi andyemiller

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others.
Otherwise, will respond back with the more details and we will try to help.

Thanks

Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

andyemiller — Mon, 27 Nov 2023 12:11:36 GMT

I had to rebuild the Lakehouse completely to resolve this issue. I used the same dataflow (gen 2) to achieve this outcome.

Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

frankmroberts — Fri, 02 Feb 2024 14:56:55 GMT

I am also getting the same error. Any ideas yet? Its been a few months. andyemiller when you say you had to "rebuild the Lakehouse completely". Did you do anything differnt in the creation of the new lakehouse that was differnt then the first one? Or is your hypothosis that perhaps MS has invoked some new capability the Lakehouse creation process behind the scenes and this was not a capability your old lake house had. Just grabbing at straws here to try to figure out what the issue could be. Thanks for your help!

Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

acitsme — Fri, 02 Feb 2024 16:54:18 GMT

I am also getting the same error when loading data from on-premises Oracle and Postgres databases through enterprise gateway.

For both sources the error raises when data are supposed to be pulled from local database to Fabric. What is weird it that data seems pulled out correctly by dataflow gen2 in both cases but fails with error

"Query: Error Code: 999999, Error Details: Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: Container exited unexpectedly with code 0x000000FF. PID: 2084. Details: GatewayObjectId: aff7bb2a-da8b-43d6-8746-97d3fff96e79 (Request ID: 68e6beea-3654-4f06-95f6-ff4e53724e8f)." when cache is enabled, while error

"There was a problem refreshing the dataflow. Please try again later. (Request ID: a164b6c5-bf5b-4bff-93f8-3516d388d381)." is thrown when staging is enabled at dataflow refresh time.

The error is shown both landing data in datawarehouse and datalake.

The power BI gateway works with no error when data are published to Power BI service.

Any clue?

Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

Anonymous — Mon, 05 Feb 2024 09:30:33 GMT

I am in the same situation as acitsme : I am trying to ingest data from an on-premises Oracle database via a gateway and I am not able to get anywhere so far, all my attempts at refreshing dataflows are returning errors ala:

Error Code: 999999, Error Details: Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: Container exited unexpectedly with code 0xC000001D. PID: 5384. Details: GatewayObjectId: c90672b7-2a7d-4bee-a4ae-bbff19f736ee (Request ID: ebb0b366-0baa-4235-8956-57b11e9511d8).

Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

Anonymous — Mon, 05 Feb 2024 10:35:33 GMT

I have created a new one and the same happens there.

Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

acitsme — Mon, 05 Feb 2024 12:36:51 GMT

the issue still there. I've tried to delete everything in the workspace and launching dataflow from pipeline. Non success. Someone here suggested not to publish the dataflow, wait 5 min and use it on a new pipeline.

I've tried but if the dataflow is not published you cannot pick it in the pipeline.

One piece of information missing: I'm testing fabric being in a trial enviroment. MICROSOFT PLEASE HELP

Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

Anonymous — Mon, 05 Feb 2024 12:46:52 GMT

I am also in a Trial environment...but I just found this one: https://community.fabric.microsoft.com/t5/Dataflows/MashupException-Error-The-value-is-not-updatable/m-p/3549552#M1260 and I have my tech guy downgrade the gw to the September version.

And my dataflows are running successfully now, ingesting data from on-premises Oracle to a lakehouse (with "staging enabled"). Need to test a lot more to build confidence in this platform.

johsm

Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

acitsme — Mon, 05 Feb 2024 13:52:42 GMT

Joshm,

save your time: september gw is too old

Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

Anonymous — Mon, 05 Feb 2024 13:56:23 GMT

Thanks for the info, but for me it now works (ie with the September one).

Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

miguel — Mon, 05 Feb 2024 16:13:30 GMT

Hi!

Whille the error message might be the same, the reasons that cause such error might be different from the one in this topic.

I'd highly recommend reaching out to our support team by raising a support ticket so an engineer can take a closer look at your situation:

https://support.fabric.microsoft.com/support

Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

acitsme — Mon, 05 Feb 2024 17:55:34 GMT

Hi Miguel,

I've downgraded gateway to Nov version 3000.198.17: now the query portion works but dataflows fails in the write side as you can see below. Any suggestion?

Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

andyemiller — Mon, 05 Feb 2024 18:09:53 GMT

In my case, I had to rebuild the Lakehouse to ingest data from a dataflow. Since this time, I have experienced Mashup issues when the field types are not consistent with the source and destination data. Usually, a change is made to the source data (Salesforce in my case) that has not been replicated to the Lakehouse. I usually edit the Lakehouse field by rebuilding the table structure, using an SQL statement, and then use the dataflow to rebuild the connection between the source and destination. The work takes a "hot minute," but has not been a hurdle since this earlier issue.

Re: Dataflow (gen2) error: Couldn't refresh the entity because of an issue with the mashup document

andyemiller — Mon, 05 Feb 2024 18:12:15 GMT

frankmroberts I really don't have a good answer other than I discovered the field types changed at my source and did not connect to the destination. A complete rebuild fixed the issue.