Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
7 years ago

Dataflow +Dataset = NEED more Clarity!

Hi All, I have successfully built an Enterprise Dataflow that loads all my tables in PBI service. Its incremental, scheduled and all is good! Now I use PowerBI Desktop to consume my Dataflow: PS: I...
Dataflow
Need Help
parishdapbi's avatar
parishdapbi
Icon for Advocate II rankAdvocate II
7 years ago

Ideally, if you have Power BI Premium, you could use Incremental Refresh, both in loading data to the dataflow and to incrementally load new data into the dataset. Otherwise, you have to load all of the the data all the time. Only way around without Premium would be to create a table with history data that is not refreshed, then another table with currrent data. In a DAX measure you could combine the values, such as: Sales = SalesHistory[Units] + SalesCurrent[Units}.

Anonymous's avatar
Anonymous
Not applicable
7 years ago

Thanks parishdapbi 
We do have Premium capacity and I am using Incremental Refresh on the Dataflow.

I liked the idea of having Incremental refresh on the Dataset, however I always thought Dataset will have a live connection to Dataflows. This is really disappointing. 
And I hope MS does something to only enable a preview Data during development using Dataflow and not force use to download complete data onto desktop.

    • Anonymous's avatar
      Anonymous
      Not applicable
      7 years ago

      Thank you RBunting for the link!
      I read some of the comments on this idea. Glad to see I am not alone here :)
      Hope MS takes this up soon

      • Anonymous's avatar
        Anonymous
        Not applicable
        7 years ago

        AnonymousSo I've been following this post now for a couple weeks as I believe I'm in the same boat with our current PBI environment. For my understanding, are you, essentially, importing your dataflows into the PBI Desktop? If so, aren't you waiting a long time for things to load? I thought the whole point of Dataflows was to have a "connection" to the cloud where resource utilization would take place on the Azure Data Lake level (scratching my head here)?

         

        I thought as a work around I would create a Dataflow dataset (wait a half day for everything to import :) ). This way I have one central dataset the masses could leverage as well as me having one central ETL point.  

         

        Any additional clarification would be greatly appreciated!