Forum Discussion
Streaming Dataflow does not produce and output
Anonymous we (data engineer from my team and myself) found a solution. Since our event hub consisted of partition 0, partition 1 and those "free fields" and I mainly needed the data from partitions, the data engineer created a new event hub where partition 0 and partition 1 was combined into one and the output looks like only free columns, no second level columns.
So our guess is that PBI SDF (streaming dataflows) cannot for now handle a bit more complex partitions that include lists, dictionaries.
Contact me if you need more details.
Thank You for your help!
How the output looks now:
Anonymous the fields that cannot be pulled are from valid json files. The fields that can - simple columns. From many examples that I have seen, it should be possible to pull individual fields from json and free fields together. That does not happen in this case.
Anonymous we (data engineer from my team and myself) found a solution. Since our event hub consisted of partition 0, partition 1 and those "free fields" and I mainly needed the data from partitions, the data engineer created a new event hub where partition 0 and partition 1 was combined into one and the output looks like only free columns, no second level columns.
So our guess is that PBI SDF (streaming dataflows) cannot for now handle a bit more complex partitions that include lists, dictionaries.
Contact me if you need more details.
Thank You for your help!
How the output looks now: