topic Re: Is Dataflow gen2 really available? in Dataflow

Is Dataflow gen2 really available?

yjh — Thu, 14 Dec 2023 01:34:40 GMT

Why does Dataflow gen2 always have some inexplicable problems, and can we really use it with confidence?

In the Power Query editor, it's a decimal number,

In writing to the Lakehouse's column mapping settings, it is also a decimal number.

After writing the lake house, it is not a decimal number

For other DF2, some are correctly mapped to decimal numbers. There is no pattern, what should we do?

The following one is another DF2 which is normal, is the desired decimal number.

Re: Is Dataflow gen2 really available?

Anonymous — Wed, 13 Dec 2023 07:17:39 GMT

Hi yjh
Thanks for using Fabric Community. Our community thrives on open communication and collaboration, and for that to happen effectively, we encourage everyone to use English for their questions and discussions. This ensures everyone can understand and participate, regardless of their native language.
Would you be comfortable rephrasing your question in English? We will definitely try to help.

Thanks for understanding.

Re: Is Dataflow gen2 really available?

yjh — Thu, 14 Dec 2023 00:59:58 GMT

I changed to English, and I have terrible English.

Re: Is Dataflow gen2 really available?

miguel — Thu, 14 Dec 2023 01:44:59 GMT

Thank you!

could you share some sample queries that could help us replicate this issue on our end?

I haven't been able to replicate it on my own with the sample queries that I use

Re: Is Dataflow gen2 really available?

yjh — Thu, 14 Dec 2023 02:47:41 GMT

I simply fetch the data from the local database, keep some columns, and that's it.

x5=

Re: Is Dataflow gen2 really available?

miguel — Thu, 14 Dec 2023 03:56:09 GMT

I cannot replicate this within my environment.
if you can replicate this with any public data source or some sample data that you can share with us, please go ahead and do so.

if you are unable to provide this info, please go ahead and raise a support ticket so an engineer can take a closer look at your specific scenario and determine what could be happening.

Re: Is Dataflow gen2 really available?

yjh — Thu, 14 Dec 2023 05:04:46 GMT

let

Source = OData.Feed("https://services.odata.org/Northwind/Northwind.svc/", null, [Implementation = "2.0"]),

#"Source 1" = Source{[Name = "Order_Details", Signature = "table"]}[Data],

DeletedColumns = Table.RemoveColumns(#"Source 1", {"Order", "Product"})

DeletedColumns

Re: Is Dataflow gen2 really available?

miguel — Thu, 14 Dec 2023 19:58:09 GMT

Thank you! We've identified the issue and have a fix for it that will be available in January of next year.

Re: Is Dataflow gen2 really available?

jjovi — Tue, 24 Sep 2024 12:03:58 GMT

meanwhile is there a workaround to this issue? decimals are pretty important for any calculations. is this an issue with the dataflow? is there other tools we could use in lieu of dataflow to load the data into lakehouse tables? pyspark notebook or pipeline copydata perhaps?