Best Practice for dealing with WEB API Source refresh on DataFlows

[Imrans123]

Hey All, 

I was wondering what your work around is for refreshing WEB API for Dataflow. Basically I have multiple queries using difference calls, but all under the same API. So when they refresh parallely, I go beyond the rate limit that the API allows. 

Unlike the desktop file, there is no option for me to disable parallel loading. I am using invoke after and I am giving excessive buffer times to make sure that my data refreshes smoothly. BUt it's really surprising how I can't simply disable parallel loading.

Am I missing something here?

Edit: After a bit of research, it seems this option is not available on dataflows. If anyone has the same issue, https://ideas.powerbi.com/ideas/idea/?ideaid=9f65c4d8-0bf4-ec11-b5cf-281878de4cfd

[otravers]

You may want to split your queries into different dataflows and chain their sequential execution via Power Automate so that one starts just after the other is finished. For illustration, the left branch of the process below is sequential, the right one runs in parallel:

[Imrans123]

Woah, creative! I'll risk making my workspace really messy 😛 But it's a pretty full proof idea if all else fails. 

[otravers]

Yes, you do want to name your dataflows with meaningful and consistent names if you're going to have many of them. I like to prepend numbers in case I have many dataflows and they're meant to be chained in a sequence (e.g. staging vs. silver vs. gold stages).