Dataflow Gen 2 Fails when copying Contact Entity From Dynamics

pws_flick — Tue, 03 Dec 2024 00:35:38 GMT

Hi Team,

Am constantly running into this issue and not sure how to resolve it ...

I created a Gen 2 dataflow which ingests data from our UAT Dataverse environment and writes it to a Warehouse in Fabric. I have no issues ingesting any other Dataverse entities in the same manner.

However, the Contact Entity will never copy and will always error out with this message:

There was a problem refreshing the dataflow. Please review the error message(s) below, fix the problem, and try again. (Request ID: 704f593a-1172-40ec-ac1c-3b0ad1147fd4).

contact: Error Code: FailedToInsertATable, Error Details: Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: DataSource.Error: Failed to insert a table., InnerException: #{0}: #{1}, Underlying error: Microsoft SQL: {"Message":"Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding."}
RequestId: TDS;78fea7ae-ef6a-49c1-9b3b-f2cdcd7a3c5a;20
Time: 2024-12-03T00:04:33.5610895Z Details: Reason = DataSource.Error;ErrorCode = Lakehouse036;Message = Microsoft SQL: {"Message":"Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding."}
RequestId: TDS;78fea7ae-ef6a-49c1-9b3b-f2cdcd7a3c5a;20
Time: 2024-12-03T00:04:33.5610895Z;Detail = [DataSourceKind = "CommonDataService", DataSourcePath = "xxxxxxxx", Message = "{""Message"":""Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.""}#(lf)RequestId: TDS;78fea7ae-ef6a-49c1-9b3b-f2cdcd7a3c5a;20#(lf)Time: 2024-12-03T00:04:33.5610895Z", ErrorCode = -2146232060, Number = 40000, Class = 16, State = 1];Message.Format = #{0}: #{1};Message.Parameters = {"Microsoft SQL", "{""Message"":""Execution Timeout Expired. The timeout period elapsed prior to completion of the operation or the server is not responding.""}#(lf)RequestId: TDS;78fea7ae-ef6a-49c1-9b3b-f2cdcd7a3c5a;20#(lf)Time: 2024-12-03T00:04:33.5610895Z"};ErrorCode = 10478;Microsoft.Data.Mashup.Error.Context = User (Request ID: 704f593a-1172-40ec-ac1c-3b0ad1147fd4).

Warning: contact: Fast Copy is not supported for any of the data sources in the expression: (RequestId: 704f593a-1172-40ec-ac1c-3b0ad1147fd4)

There are no transformations etc. done on the Contact Entity - Just trying to ingest 'as is'.

I would love to know what is causing this specific issue with the Contact Entity! Any information or assistance greatly appreciated.

Re: Dataflow Gen 2 Fails when copying Contact Entity From Dynamics

SudhavaniKolla3 — Wed, 04 Dec 2024 11:42:08 GMT

It may be because of the sensitive data. since contact info is sensitive data.

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly

Re: Dataflow Gen 2 Fails when copying Contact Entity From Dynamics

Anonymous — Thu, 05 Dec 2024 01:36:20 GMT

HI @pws_flick,

According to the error message, it seems related to fast copy in dataflow gen2, I'd like to suggest you take a look at the following document limitation part of your scenario meet to the limitations list.

Fast copy in Dataflows Gen2 - Microsoft Fabric | Microsoft Learn

Regards,

Xiaoxin Sheng

Re: Dataflow Gen 2 Fails when copying Contact Entity From Dynamics

Anonymous — Fri, 27 Dec 2024 08:32:16 GMT

Hi @pws_flick ,

Did the above suggestions help with your scenario? if that is the case, you can consider Kudo or Accept the helpful suggestions to help others who faced similar requirements.

If these also don't help, please share more detailed information and description to help us clarify your scenario to test.

How to Get Your Question Answered Quickly

Regards,

Xiaoxin Sheng

topic Dataflow Gen 2 Fails when copying Contact Entity From Dynamics in Data Engineering

Dataflow Gen 2 Fails when copying Contact Entity From Dynamics

Re: Dataflow Gen 2 Fails when copying Contact Entity From Dynamics

Re: Dataflow Gen 2 Fails when copying Contact Entity From Dynamics

Re: Dataflow Gen 2 Fails when copying Contact Entity From Dynamics