Forum Discussion

MiguelMartinez's avatar
MiguelMartinez
Icon for Microsoft Employee rankMicrosoft Employee
5 years ago

Share your thoughts on streaming dataflows aka SDF (preview feature)

Back at MBAS, our CVP Arun Ulag gave everybody a sneak peek of streaming dataflows, the new experience for real-time data preparation and comsumption in Power BI. Later at BUILD, we showed everyone a...
Dataflow
General Comment
Need Help
Show and Tell
Tips and Tricks
AndyDDC's avatar
AndyDDC
Icon for Most Valuable Professional rankMost Valuable Professional
5 years ago

Hi Miguel,  I'm currently working through the documentation to get up and running but hitting a snag.  I'm using a PPU account and creating a blank workspace with PPU assignment.  The streaming dataflow option is greyed out with a message stating "Workspaces connected to a storage account are not supported".  This workspace is not connected to Azure nor is the tenant.  I've also tried using an Embedded A3 tier attached to the workspace but I get the same message.

MrKrukauskas's avatar
MrKrukauskas
Icon for Helper I rankHelper I
4 years ago

Hello, does not seem that the streaming dataflows work with deeper than 1 level nested items? F.e. trying to pull the _env field and it does not produce an output. Any ideas?

 

  • Eklavya's avatar
    Eklavya
    Icon for Microsoft Employee rankMicrosoft Employee
    4 years ago

    Hi, you can pull it by using Manage Fields operator

     

    • MrKrukauskas's avatar
      MrKrukauskas
      Icon for Helper I rankHelper I
      4 years ago

      Eklavya still does not work. When I use Manage fields to pull f.e. 1st level items (not nested), it works fine. When I try to do it with 2nd level nested items - it does not. I'm pulling all from the same event hub, same streaming dataflow, use manage fields, filters, output tables and the only output is for the items that are not nested.
      Works here:

      Does not work here:

      Streaming Dataflow:

       

      • Eklavya's avatar
        Eklavya
        Icon for Microsoft Employee rankMicrosoft Employee
        4 years ago

        I see. Let's do some quick checks here:
        1. You've verified that env field does have data coming in from the source?

        2. Do you see the data if you remove the filter?

        3. I am assuming you are using preview to check presence of data - but can you save and run the streaming dataflow and then check if you see the output in the report?

        Is it possible to share the schema/sample event of the data you are using? (You can dm me this if you'd like).