Forum Discussion
Dataflow Gen1 data refresh duration is allways more than 30 seconds
I understand, but rest assured, your queries are fine it’s just Gen1’s design.
It’s not necessarily a best practice to create many small Dataflows Gen1 if each contains only one or two very light tables, because each one will incur that same startup overhead.
Instead, you’ll get better performance by grouping related tables into a single dataflow so they refresh together within the same container session.
Hope it helps you !Best regards,Antoine
Yes, you are right, you can't use Dataflow Gen2 'cause it's only available in a Fabric Capacity.
And so, you may have the refresh duration that is more than expected, due to starting server and dataflow engine, I know it's a bit frustrating but does it affect your usage? or have you encounter some issue when you execute your dataflow gen1 ?
No there is no problem in benefit of Gen1. It just confuse me like something is wrong in my queries. And it makes me avoid enabling too much table as each one takes at least 30 seconds
I understand, but rest assured, your queries are fine it’s just Gen1’s design.
It’s not necessarily a best practice to create many small Dataflows Gen1 if each contains only one or two very light tables, because each one will incur that same startup overhead.
Instead, you’ll get better performance by grouping related tables into a single dataflow so they refresh together within the same container session.
Hope it helps you !Best regards,Antoine