Dataflow Gen2 taking a long time suddenly

[Morse-AMHG]

I’ve set up some Gen2 dataflows that pull directly from an on-premises SQL Data Warehouse. The tables don’t typically increase in size significantly, but recently, they have been taking a long time to refresh. They have staging enabled and only a few applied steps. Do you have any insights on why this might be happening?

Thank you!

[Anonymous]

Hi @Morse-AMHG ,

This may be related to the network, the data source and the service. I recommend that you contact the support team for a more thorough investigation. Microsoft Fabric Support and Status | Microsoft Fabric

Best regards,

Mengmeng Li

[Shivu-2000 · Accepted solution]

Hi @Morse-AMHG 

Here are few reasons and corresponding solutions for this:

• Network Issues: Check for latency or bandwidth problems between the SQL Data Warehouse and the gateway.
• Gateway Overload: Ensure the gateway has enough resources and isn’t overloaded.
• Unoptimized Queries: Review and optimize SQL queries; consider using views or indexes.
• Staging Performance: Ensure staging storage is properly configured and low-latency.
• Transformations: Simplify or push complex transformations to the source database.
• Service Issues: Check Power BI service health or contact Microsoft Support.
• SQL Contention: Monitor for locking or resource bottlenecks in the SQL Data Warehouse.

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Happy to help!