Forum Discussion

MiguelMartinez's avatar
MiguelMartinez
Icon for Microsoft Employee rankMicrosoft Employee
5 years ago

Share your thoughts on streaming dataflows aka SDF (preview feature)

Back at MBAS, our CVP Arun Ulag gave everybody a sneak peek of streaming dataflows, the new experience for real-time data preparation and comsumption in Power BI. Later at BUILD, we showed everyone a...
Dataflow
General Comment
Need Help
Show and Tell
Tips and Tricks
MrKrukauskas's avatar
MrKrukauskas
Icon for Helper I rankHelper I
4 years ago

Eklavya Thank You for checking this. I'll make sure to double check if the payload is a valid json. I see that our examples differ in payload structure, so that is probably where the issue is, but I'll check first.

 

 

  • MrKrukauskas's avatar
    MrKrukauskas
    Icon for Helper I rankHelper I
    4 years ago

    Eklavya we (data engineer from my team and myself) found a solution. Since our event hub consisted of partition 0, partition 1 and those "free fields" and I mainly needed the data from partitions, the data engineer created a new event hub where partition 0 and partition 1 was combined into one and the output looks like only free columns, no second level columns.

    So our guess is that PBI SDF (streaming dataflows) cannot for now handle a bit more complex partitions that include lists, dictionaries.

    Contact me if you need more details.

    Thank You for looking into this!