Dataflow Gen2 Start to fails after Enterprise Gateway Update (April 2024)

[alfBI]

Hi,

We have a couple of Dataflow gen2 that after been running properly for several weeks started to fail with same error message after the upgrade of Power BI Enterprise Gateway (we installed April 2024 version)

Both DF2 are copying a doze of tables from a SQL Server on premise to a Fabric Warehouse. Steps are extremely simple. No data transformatio. No added columns. Data just read and add to destination

See below error message. 

I am trying to build the DF2 now unsuccessfully but I am not longer able to make it work again. I have started with a single table and seems to work. But when a second table is added error appears (it is random, sometimes error comes from table A others from table B)

Has anyone noticed this weird behaviour of DF2 ? Might be some kind of bug introduced by the new version of Power BI Gateway?

Error Code: Mashup Exception Expression Error, Error Details: Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: Failed to insert a table., InnerException: We cannot apply operator & to types Number and Record., Underlying error: We cannot apply operator & to types Number and Record. Details: Reason = Expression.Error;Message = We cannot apply operator & to types Number and Record.;Detail = [Operator = "&", Left = 2, Right = [...]];Message.Format = We cannot apply operator #{0} to types #{1} and #{2}.;Message.Parameters = {"&", "Number", "Record"};Microsoft.Data.Mashup.Error.Context = System GatewayObjectId: 06f6710e-cfd9-4707-9644-c44118ae1fe1 (Request ID: 4e23ef16-834e-47b1-8e40-d4b392ebb77f).

Regards

[alfBI]

Hi,

I can confirm that the issue appeared after the upgrade from  February 2024 update (3000.210.13)

to April 2024 update (3000.218.7)

We have now installed May 2024 update (3000.222.5)

and these error have disappeared. Now these DF Gen2 using on premise sources works intermitently with following error (looks like some kind of problem on the internal lakehouse used by the DF)

Error Details: Error: Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: Failed to insert a table., InnerException: Unable to create a table on the Lakehouse SQL catalog after max retries as nothing is in progress

We are a bit upset about the inestability of DF Gen2 and we are seriously considering move them towards data copy activity (now on premise sources are available). Anyway I am not sure if we will face same problems if (as it looks like) problem is caused by the enterprise gateway changes on releases.

Alfons

[v-nikhilan-msft]

Hi @alfBI 
Apologies for the issue you have been facing.
At this time, we are reaching out to the internal team to get some help on this. We will update you once we hear back from them.
Thanks 

[v-nikhilan-msft]

Hi @alfBI 
Are you still facing this issue or is it resolved? Can you please confirm?

Thanks

[alfBI · Accepted solution]

Hi,

After upgrade to April release we have been finally able to manage all errors.

Thx

[ramiromejia]

I am also facing issues with Dataflow when I tried to publish an object. My error message says "Something went wrong"