Dataflow Gen2 - failing to load into the lakehouse
Hello. I have a dataflow gen2, fetching data from an azure data factory environment and loading them into a Fabric Lakehouse. It has been working flawlessfly for the last 3 months, but since two weeks, on some of the tables, I get this error: "There was a problem refreshing the dataflow: "Something went wrong, please try again later. If the error persists, please contact support.". Error code: EntityUserFailure. (Request ID: 6d111afc-11ee-459f-9e31-db4d08c32c44)." "XXX - ABC Entity Management_WriteToDataDestination: There was a problem refreshing the dataflow: "Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: Error in creating lakehouse table in a version, InnerException: Tables can only contain uppercase or lowercase letters, numbers or the underscore character., Underlying error: Tables can only contain uppercase or lowercase letters, numbers or the underscore character. Details: Reason = Expression.Error;ErrorCode = Lakehouse036;Message = Tables can only contain uppercase or lowercase letters, numbers or the underscore character.;Message.Format = Tables can only contain uppercase or lowercase letters, numbers or the underscore character.;ErrorCode = Lakehouse019;InnerErrorCode = Lakehouse021,Lakehouse019;Microsoft.Data.Mashup.Error.Context = User GatewayObjectId: 1ee1c1a1-a11v-32bt-a19b-5ff6d874f432". Error code: 104100. (Request ID: 66d111afc-11ee-459f-9e31-db4d08c32c44)." The weird part is that there is no consistency between which tables go to error and which ones proceed to being loaded. Sometimes it works sometimes it does not. Also, there are no issue with the naming, as all the columns are respecting the requirements laid out from the error. And above all, it was working flawlessly until few weeks ago and nothing a
Required parameters are missing in the request data flow gen2 fabric
Hi Team, I have created a Dataflow Gen2 in Microsoft Fabric with Dataverse as the source. When I run the dataflow independently, it executes successfully. However, when I invoke the same dataflow from a pipeline and pass the Dataverse URL as a dynamic parameter, the execution fails. Below is the error message for reference: Error: Required parameters are missing in the request Dataflow refresh job failed with status: Failed.
Dataflow Gen2 Copying Old Data
I have a dataflow that is transforming data and then moving it to a staging table in a Silver Lakehouse. I keep having issues where the number of rows moved to that lakehouse doesnt match what I am seeing in the dataflow preview or what it should be. A simple example of this is that this should have read 2 and written 2 rows but instead it read and wrote 3 rows. Upon investigating this was the 3 rows from the previos time it ran, suggesting a caching issue! I have others where I have 578 new rows in my table within the dataflow and then in the Staging table it has 212 rows. I'm very confused as to what is going on and concerned I may need to convert to notebooks for my transformations?
