Dataflow linked entities refresh failure - concurrent / parallel or sequential refresh??

[uberdube]

Hi Community,

I'm wondering if anyone has figured out yet (or please point me to the doco if any exists here, I just can't find anything useful so far..) ..if I have multiple 'source data' dataflows (each containing one or more entities... but lets call them 'A' for example), and another dataflow (called 'B') which contains linked entities from 'A'... can I refresh the 'A' entities at the same time, or do they have to be refreshed one after the other (ie. in sequence)? My 'A' entities are failing when scheduled refreshes within the same time interval (eg. 6:00am) fire off, and typical only one entity (I presume the first one that makes it in the queue) successfully completes.

With currently 9 entities to refresh (that only take on average 5-10 mins each in incremental refresh) - and minimum scheduled refresh intervals of 30 minutes this would take 4 - 5 hours to sequentially stage each refresh, and potentially this list of entities could still grow to 20, 30, 50... that would become impossible to stage more than 48 dataflows in 24 hours (which is completely unreasonable, i have a 6 hour window to work with here...)

To complicate the matter further, I'm struggling currently to grapple with dataflow refresh, just what is actually 'functionality' (ie. what works and what doesn't in general) , and what is the result of bugs and issues that have been going on lately, for those of you that have seen/experienced this (or similar posts) over the past week (or any of the multiple 'failed to refresh/timeout' calls for help I see all over the support forums)..

https://community.powerbi.com/t5/Service/Just-started-this-week-DATAFLOW-table-does-not-show-up-in-P...

It's difficult when you spend a week trying to figure out what you're doing wrong.. to find out you weren't doing it wrong at all, and it was actually a bug.. I can't count the ridiculous amount of hours I've lost watching the yellow wheel spin with this. 😞 Is it me? Is it you? Should we see other people? Haha 😛

Pls halp!  😛

[v-eachen-msft · Accepted solution]

Hi @uberdube ,

There is a capacity limit on dataflow, you could refer to this document and set it to meet your requirements.

https://docs.microsoft.com/en-us/power-bi/service-admin-premium-workloads#workload-settings

---

that would become impossible to stage more than 48 dataflows in 24 hours (which is completely unreasonable, i have a 6 hour window to work with here...)

---

The limit of refresh is 48 times per day.  If you want shorter intervals, you could post your ideas here.

https://ideas.powerbi.com/forums/265200-power-bi-ideas

---