Forum Discussion
pace-jp
1 year agoAdvocate I
Dataflow Join Bug
I have a JSON file with many nested arrays that I'm trying to flatten into a single table using a Dataflow Gen2. I have a main table (table0) that contains some metadata about each record and an expa...
pace-jp
1 year agoAdvocate I
Thanks for the reply Anonymous. I double checked the tables and joins and couldn't find anything suspicious. I also did not find anything in the known issues site. I'm guessing it has something to do with the way the system is parsing the JSON, and possibly (mis)handling empty arrays (even though I am actively filtering them out). So, I've abandoned trying to parse the file using a dataflow and am changing to a spark notebook instead.