Forum Discussion

Morse-AMHG's avatar
Morse-AMHG
Frequent Visitor
1 year ago
Solved

Dataflow Gen2 taking a long time suddenly

 

I’ve set up some Gen2 dataflows that pull directly from an on-premises SQL Data Warehouse. The tables don’t typically increase in size significantly, but recently, they have been taking a long time to refresh. They have staging enabled and only a few applied steps. Do you have any insights on why this might be happening?

Thank you!

 

 

Dataflow
General Comment
  • Shivu-2000's avatar
    Shivu-2000
    1 year ago

    Hi Morse-AMHG 

     

    Here are few reasons and corresponding solutions for this:

     

    • Network Issues: Check for latency or bandwidth problems between the SQL Data Warehouse and the gateway.
    • Gateway Overload: Ensure the gateway has enough resources and isn’t overloaded.
    • Unoptimized Queries: Review and optimize SQL queries; consider using views or indexes.
    • Staging Performance: Ensure staging storage is properly configured and low-latency.
    • Transformations: Simplify or push complex transformations to the source database.
    • Service Issues: Check Power BI service health or contact Microsoft Support.
    • SQL Contention: Monitor for locking or resource bottlenecks in the SQL Data Warehouse.

     

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
    Happy to help!

     

2 Replies

  • Shivu-2000's avatar
    Shivu-2000
    Icon for Responsive Resident rankResponsive Resident
    1 year ago

    Hi Morse-AMHG 

     

    Here are few reasons and corresponding solutions for this:

     

    • Network Issues: Check for latency or bandwidth problems between the SQL Data Warehouse and the gateway.
    • Gateway Overload: Ensure the gateway has enough resources and isn’t overloaded.
    • Unoptimized Queries: Review and optimize SQL queries; consider using views or indexes.
    • Staging Performance: Ensure staging storage is properly configured and low-latency.
    • Transformations: Simplify or push complex transformations to the source database.
    • Service Issues: Check Power BI service health or contact Microsoft Support.
    • SQL Contention: Monitor for locking or resource bottlenecks in the SQL Data Warehouse.

     

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
    Happy to help!