topic Re: We cannot apply operator & to types Number and Record -Dataflow Gen2 in Dataflow

We cannot apply operator & to types Number and Record -Dataflow Gen2

rubayatyasmin — Fri, 16 Aug 2024 21:57:13 GMT

I am getting the following error while trying to refresh the dataflow.

Error:

Error Code: Mashup Exception Expression Error, Error Details: Couldn't refresh the entity because of an issue with the mashup document MashupException.Error: Failed to insert a table., InnerException: We cannot apply operator & to types Number and Record., Underlying error: We cannot apply operator & to types Number and Record. Details: Reason = Expression.Error;Message = We cannot apply operator & to types Number and Record.;Detail = [Operator = "&", Left = 2, Right = [...]];Message.Format = We cannot apply operator #{0} to types #{1} and #{2}.;Message.Parameters = {"&", "Number", "Record"};Microsoft.Data.Mashup.Error.Context = System GatewayObjectId: a246e8b6-3050-4204-ab80-de5a5d11f80a (Request ID: 6a2b936f-cfaf-4dc5-8157-1631a49066c9).

Source: Snowflake

Destination: Warehouse

Using F4 capacity.

Any idea?

Thanks in advance

Re: We cannot apply operator & to types Number and Record -Dataflow Gen2

miguel — Fri, 16 Aug 2024 22:14:53 GMT

What happens when you try to edit your dataflow after this error happens? Do you see any queries with errors ?

are you able to share some steps to reproduce this behavior?

Have you added a custom column that tries to add values from two columns?

Re: We cannot apply operator & to types Number and Record -Dataflow Gen2

rubayatyasmin — Fri, 16 Aug 2024 22:27:15 GMT

Sure. I've double-checked all the queries, and no errors or warnings were shown. I did nothing fancy.

Step 1: Source Snowflake

Step 2: Load, reference the source then get the desired tables. and set up the destination as a warehouse.

I only have 9 queries. that's all I am trying to do. Also, the dataflow fail is not consistent for a single table. Meaning, in first run if table1, table4 and table5 failed to write then in 2nd run table1 is succedded now table2 failed because it is idle.

this is the situation right now

Re: We cannot apply operator & to types Number and Record -Dataflow Gen2

miguel — Fri, 16 Aug 2024 22:54:04 GMT

Any chance that you could post your queries without any private or sensitive information? That would allow us to better understand where things might be happening to cause these issues

Re: We cannot apply operator & to types Number and Record -Dataflow Gen2

rubayatyasmin — Sat, 17 Aug 2024 00:02:25 GMT

Like this or talking about advanced editor code?

Re: We cannot apply operator & to types Number and Record -Dataflow Gen2

miguel — Sat, 17 Aug 2024 01:46:45 GMT

You could potentially export the Power Query template, but effectively what I'm after is the M code - typically what you'd see in the advanced editor to fully understand what happens in each of the queries

Re: We cannot apply operator & to types Number and Record -Dataflow Gen2

frithjof_v — Mon, 19 Aug 2024 08:12:01 GMT

Perhaps your data in Snowflake changes often?

Maybe sometimes there is no data in a Snowflake table?

Or sometimes there is some data in a column which usually contains numeric values but sometimes it contains data values with another format?

You can also try to open your Dataflow, then highlight all the columns in a query and click "Keep rows -> Keep errors" just to see if you find any errors on some rows.

Are you using Append or Replace in the destination settings?

Re: We cannot apply operator & to types Number and Record -Dataflow Gen2

rubayatyasmin — Mon, 19 Aug 2024 10:28:27 GMT

Thank you for the reply. But none of the circumstances matches my situation. and I am doing nothing. Snowflake data is already transformed. I am just copying data, no extra transformation.

Re: We cannot apply operator & to types Number and Record -Dataflow Gen2

rubayatyasmin — Mon, 19 Aug 2024 10:30:30 GMT

let

Source = Source,

Navigation = Source{[Name = "TableName", Kind = "View"]}[Data]

Navigation

this is the simple code. As I mentioned, I am not doing any transformation. In the source, I have the snowflake data navigation steps only.

Re: We cannot apply operator & to types Number and Record -Dataflow Gen2

miguel — Mon, 19 Aug 2024 10:45:57 GMT

I don't think we have enough information to determine what could be happening.

This would require some an investigation by the support team to determine what could be the issue.

You can use the link below to open a support ticket:

https://support.fabric.microsoft.com/support

Re: We cannot apply operator & to types Number and Record -Dataflow Gen2

rubayatyasmin — Mon, 19 Aug 2024 10:47:21 GMT

Strange, isn't it!! Thanks though.

Re: We cannot apply operator & to types Number and Record -Dataflow Gen2

rubayatyasmin — Wed, 21 Aug 2024 14:56:51 GMT

Thanks, miguel and frithjof_v for trying to solve the problem. I raised a support ticket. In my case updating the gateway to the latest version solved the problem.

Re: We cannot apply operator & to types Number and Record -Dataflow Gen2

Anonymous — Wed, 04 Dec 2024 13:34:41 GMT

Hi,

Did anybody find any solution to this probelm?

Thanks

Re: We cannot apply operator & to types Number and Record -Dataflow Gen2

rubayatyasmin — Wed, 04 Dec 2024 13:57:39 GMT

Try to update the gateway see if it works.