dataflow refresh history duration vs elapsed time

[Kpham]

When I'm looking at my refresh history in dataflows the duration time doesn't look that bad. However when I hit the refresh button I need to wait for hours. In this case elapsed time has passed the 20 hours. When I just let them run it will eventually finish and it post a duration time of 5 minutes(?). Can you explain to why elapsed time and the duration is not the same?

[v-eqin-msft · Accepted solution]

Hi @Kpham ,

The reason for refreshing taking too much time：

Too many datasets to refresh at the same time occupy CPU and memory, Insufficient gateway or underlying data source performance (busy on network / refresh), To refresh the model to be loaded into memory, it takes up 2 times the size of the data set, and you need to wait for memory resources.

 If a refresh is running a long time, you can select the dataflow options (the ellipses next to the dataflow) and then select Cancel refresh. Or scheduled the refresh of dataset at different time.

In addition, I found a same issue ,please check if it could help you a little.

https://community.powerbi.com/t5/Service/Dataflow-vs-Dataset-refresh/td-p/572076

https://medium.datadriveninvestor.com/my-dataset-is-taking-too-long-to-refresh-843fd8fd4a51

https://radacad.com/how-to-use-dataflow-to-make-the-refresh-of-power-bi-solution-faster

Best Regards,
Eyelyn Qin
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.