Forum Discussion
Incremental Refresh on a dataset with Dataflows as a data source
Anonymous Did you actually read my message? I'm not trying to set up Incremental Refresh in Dataflows, I'm trying to set it up for a dataset that uses Dataflows as a data source.
Could you provide any information on that or perhaps even address my actual questions?
Hi Anonymous,
Any update on this?
Hey Anonymous,
Would you happen to have an answer on the questions I asked? Or maybe a colleague could help you out?
Thanks so much in advance.
Hi Anonymous，
Sorry for delay. There are two ways to configure incremental refresh: one is configure increment refresh in Power BI Desktop (it is available for Pro users) and another is use increment refresh with Power BI dataflows(currently only for Premium users). Currently you are connecting to dataflow as data source in Power BI Desktop, since the original data source is the dataflow, you can just configure increment refresh for the dataflow in Power BI Service.
Best Regards
Rena
Hi Anonymous,
Thanks for your answer. It is absolutely clear to me that I can set up incremental refresh in dataflows. This is what I currently do. So the main benefit of this is that we only refresh the last 14 days of data each morning (approx. 2 million rows of data). This is working well and I'm happy with the feature.
However, our total dataset consists of approximately 70 million rows of data. And each morning, when I'm refreshing my dataset, it will refresh all of these 70 million rows of data. Even when I implement incremental refresh on the dataset, it will still refresh all rows. What I would expect it to do is refresh only the last 14 days of data, so that it only has to refresh 500 MB of data, instead of the entire ~7 GB.
How can I make sure that my dataset will only refresh the part that is refreshed in dataflows (the incremental part)?