Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
4 years ago
Solved

Much more data when connecting to dataflow than directly to SQL

I've set up a dataflow that pulls selected tables from our ERP SQL.   When I connect to the dataflow from PBI Desktop it loads several GB's of data even though I'm selecting only a few 100 lines fr...
Need Help
  • mahoneypat's avatar
    mahoneypat
    4 years ago

    Yes. When you use a Dataflow as a source, to get folding, the Enhanced Compute Engine has to be turned on (premium capacity) and you need to use the Dataflows connector (not the Power BI Dataflows one).

    Pat

     

Anonymous's avatar
Anonymous
Not applicable
4 years ago

Thanks mahoneypat 

 

Could you point me one step further?

 

Google is giving me lots of contradictory information about query folding regarding dataflows. I don't know the term, so don't know what I'm looking for.

 

One thing I see mentioned is the "Enhanced Compute Engine". The dataflow doesn't sit within a premium capacity. Is this the root of my issue, perhaps?

mahoneypat's avatar
mahoneypat
Icon for Microsoft Employee rankMicrosoft Employee
4 years ago

Yes. When you use a Dataflow as a source, to get folding, the Enhanced Compute Engine has to be turned on (premium capacity) and you need to use the Dataflows connector (not the Power BI Dataflows one).

Pat

 

  • Anonymous's avatar
    Anonymous
    Not applicable
    4 years ago

    Thanks. So outside of Premium, Dataflows isn't really a viable option, since any datasets will have to pull entire tables every time.