Forum Discussion

pace-jp's avatar
pace-jp
Advocate I
1 year ago

Dataflow Join Bug

I have a JSON file with many nested arrays that I'm trying to flatten into a single table using a Dataflow Gen2. I have a main table (table0) that contains some metadata about each record and an expa...
Need Help
Anonymous's avatar
Anonymous
Not applicable
1 year ago

Hi pace-jp ,

Based on the behavior you describe, i.e., records that were filtered out after expanding fields after connecting reappear, it is unusual.

So I think you can take the following steps:

 

1. Ensure that the join conditions are correctly specified and that there are no unintended matches causing the reintroduction of filtered records.

 

2. Verify that the data in table0, table1, and table2 is consistent and that the filtering steps are correctly applied before the join operation.

 

3. The issue might be related to how the expansion step is handled. Double-check the configuration of this step to ensure it doesn't inadvertently reintroduce filtered records.

 

4. You can also look at this document about dataflow known issues below: 

Fabric known issues - Microsoft Fabric | Microsoft Learn

 

 

Best Regards

Yilong Zhou

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.