Forum Discussion

Cymbolz's avatar
Cymbolz
Helper III
7 years ago
Solved

Dataflow vs Dataset refresh

Haven't found any documentation on how data refresh works with respect to a dataflow and then a dataset sourced from that dataflow.   So looking for feedback, based on what I've discovered:   Bo...
Need Help
  • otravers's avatar
    otravers
    7 years ago

    >So I assume the dataflow is much like a data storage component on its own that manages the updating from the data source, wherever that may be

     

    That's correct, technically PBI's Dataflow uses Azure Data Lake Gen2 for storage.

     

    One use case I plan to use this dual refresh structure for, is to handle sources (e.g. static files) that don't need to be refreshed in Dataflows where they'll be imported but not under scheduled refresh. I've found PBI's scheduled refreshes to fail easily, so cutting down the service's scheduled refreshes to sources that actually need to be refreshed should lower incidents (e.g. web API timeouts, credential issues etc.).

  • Assaf's avatar
    Assaf
    7 years ago

    Hi,

     

    After internal checking, it seems that the next refresh time update (without browser refresh) was fixed and is should be available in the following updates.

     

    I will keep monitor it.

     

    Thanks,

    Assaf

Anonymous's avatar
Anonymous
Not applicable
5 years ago

otravers 
Here is a screenshot of flow setup. I use the same for Dataflow as well

otravers's avatar
otravers
Community Champion
5 years ago

Anonymous and you're actually getting emails for dataflows? I contacted Microsoft support and they pointed me to this page that states:

 

 "Triggers a refresh for the specified dataflow. The only supported mail notification options are either in case of failure, or none. MailOnCompletion is not supported."

 

Edit: I got confirmation that the documentation is incorrect and will be corrected in the next couple of weeks.