Gen1 Dataflow Validation running very slow.

[SuperDave007]

After experiencing a data refresh issue with Gen1 dataflows in our Power BI Premium tenant (as well as other unrelated tenants) a few weeks ago (which was corrected by Microsoft), we are now experiencing super slow validation times when saving/closing a dataflow.  I am waiting to hear back from Microsoft on the new dataflow issue but am curious if others are experiencing similar dataflow save/close issues with dataflow with large number of records (1 million plus).

[SuperDave007]

Hi @v-hashadapu ,

I appreciate your insights.  See my responses to your line items below.  Yes.  Microsoft has been engaged and trace logs have been sent their way.  Hopefully, they see something on their end that I am not seeing.

1. Check for API Limits & Throttling:  "This is definitely a top consideration.  However, I review limits as well as throttling with Fabric Metrics app.  Everything looks good."

2. Optimize Query Performance:  "I don't believe query optimization issues are at play here as the same query works fine at other times." 

3. Test Different Save Times: "Just an update here after additonal testing, the issue occurs even in the evenings both early and late."

4. Monitor Power BI Service Health:  "I have kept an eye out on the Service Health portal and don't see any backend dataflow issues advertised by Microsoft (not yet anyway)."

Thanks Again for all your help!

[v-hashadapu]

Hi @SuperDave007, thank you for reaching out to the Microsoft Fabric Community Forum.

Thanks for the update. Hope your issue is solved. If it is, please share the insights here, which will help others with similar queries.

Also, please consider marking the answer 'Accept as Solution' so others with similar queries may find it more easily.
Thank you.

[Akash_Varuna]

Hi @SuperDave007  Yes the Dataflow Gen 1 are really slow when i used also it was performing very slowly when i surfed through the community they recomended to Migrate to gen 2 in my case the data source was also very slow for my recent one where the data was being dumped to sharepoint

[SuperDave007]

Hi @Akash_Varuna   I appreciate the response.  Unfortunately, Gen2 isn't an option for us.  Fabric Capacity Metrics app doesn't show any major bottlenecks when the validation stalls but seems to work better early evening.  However, for other times like late night and during the work day, the issue seems to be the worse.  Again, I know everyone is thinking that there are other reports running that may be impacting this.  However, I have recreated the issue in an isolated Tenants with no other traffic.  Will post back to this thread on Microsoft's thoughts once I hear back.

[v-hashadapu]

Hi @SuperDave007 , thank you for reaching out to the Microsoft Fabric Community Forum.

Thank you @Akash_Varuna, we appreciate your response.

May I know if this ‘Will post back to this thread on Microsoft's thoughts once I hear back’ mean, you have already raised a Microsoft Support Ticket. If not, please consider trying these troubleshooting steps before you raise it.

1. Check for API Limits & Throttling: Even in an isolated tenant, background processes or Power BI service limits could be causing delays.

2. Optimize Query Performance: If possible, reduce the number of transformations or push processing upstream.

3. Test Different Save Times: Since validation performs better in the evening, it might indicate Power BI service congestion during peak hours.

4. Monitor Power BI Service Health: Microsoft may be addressing broader issues affecting validation times.

If this helps, please consider marking it 'Accept as Solution' so others with similar queries may find it more easily. If not, please share the details.
Thank you.