- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark
- Subscribe
- Printer Friendly Page
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Dataflow runs for hours
Hello,
I regularly have Gen2 dataflows that get stuck in refresh mode for hours on end, consuming all the resources of my capacity. Under normal circumstances, these dataflows only last a few minutes (they only load one table from a cvs).
I tried to restart the gateway, without success.
What can I do?
Thanks for your help
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @amolt
Following up to check if you have a resolution yet. In case if you have any resolution please do share the same with community as it can be helpful to others.
Otherwise, will respond back with the more details and we will try to help .
Thanks
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @v-cboorla-msft ,
Unfortunately I have no other solution than not to use pipelines to run Gen2 dataflow.
Thanks
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I am having the same issue - support hasn't been able to help other than suggesting not to use Gen2 dataflows.
Not really feasible - surprising how bad this product is.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I have the same issue trying to load from on-prem SQL Server with the latest gateway.
With a gen 1 dataflow, the table loads in a couple seconds. With gen2 and staging enabled, it takes a few minutes. Turning off staging, which I'd like to do since the query can fold, it takes an hour and a half and fails 9 out of 10 times.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello @amolt
Thanks for using the Fabric community.
As I understand the current inquiry, the question is why Dataflow Gen2 is taking more time than usual. Please correct me if I'm mistaken.
You mentioned that it's 'consuming all the resources of my capacity,' which seems unusual and suggests that there may be other activities occurring concurrently, such as another scheduled data flow. If you're uncertain, you could attempt to reschedule the Dataflow during off-hours to see if this adjustment results in fewer failures.
Thanks
HImanshu
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hello @HimanshuS-msft ,
Thank you for your reply.
No, I don't have any other treatment in parallel. During this last execution, the dataflow lasted more than 5h against a few minutes usually.
Thanks
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @DataPne , @Joshrodgers123 ,
Do you use a pipeline to execute your dataflows ?
In my case, I noticed that my problems came when I used a pipeline to schedule the execution of the gen2 dataflow.
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @amolt ,
The issue seems to present itself even just when executing the pipelines manually from the UI.
It will maybe run successfully 1/10 times.
Have you managed to find any work arounds on your side?
- Mark as New
- Bookmark
- Subscribe
- Mute
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Hi @DataPne ,
I've found no other solution than to dispense with pipelines to run dataflows. I make individual schedules for each dataflow. It's really not great.
If anyone has a better solution, I'm interested.

Helpful resources
Join our Fabric User Panel
This is your chance to engage directly with the engineering team behind Fabric and Power BI. Share your experiences and shape the future.
Fabric Monthly Update - June 2025
Check out the June 2025 Fabric update to learn about new features.

Subject | Author | Posted | |
---|---|---|---|
06-04-2025 02:42 PM | |||
05-06-2025 03:30 AM | |||
05-30-2023 12:19 AM | |||
12-02-2024 09:39 PM | |||
04-11-2025 10:48 AM |
User | Count |
---|---|
1 | |
1 | |
1 | |
1 | |
1 |