Forum Discussion
009co
Helper IV
Helper IVDataflow Gen 2 dataflow queries with PIVOT long running, never return results
My Dataflow Gen 2 dataflow query does following: * Sources from 4 Lakehouse tables each with 3 columns - datetime, string, number. * Appends 4 tables as new (about 4,500 rows total). * Pivot ne...
miguel
Community Admin
Community Admincould you please share your dataset with us so we could try and repro this scenario?
The only thing that I can think of is that your Parameter column might have a high cardinality where it tries to create over 250 new columns using the Pivot operation, but its something that we would love to learn from and improve the experience.
009coHelper IV
Helper IVHey miguel, it appears that Dataflow Gen 2 simply cannot do the pivot transform. My guess is that it is related to lack of resources. But maybe it is just on my trial account? But are you able to use the data I linked below to replicate my steps?