Forum Discussion
Helper VData flow gen 1 extremely slow
Hi jochendecraene ,
We just wanted to check in again regarding your issue. If you've found a solution, marking the reply as the solution and leaving a kudos would be greatly appreciated, it helps the community and others with similar questions.
Additionally, we'd like to share that the known issue related to the slowness of connecting to SharePoint folders in Dataflow Gen1 and Gen2 has been fixed.
If you're still facing challenges or have further questions, please let us know.
Thank you.
Community SupportHi jochendecraene ,
Thank you for reaching out. The issue you're facing with Dataflow Gen 1's performance is a known issue, and Microsoft is actively working on a resolution.
Meanwhile please try the Workarounds and troubleshooting steps provided by Jai-Rathinavel , rohit1991 and Akash_Varuna as they are useful in these kind of scenarios.
Additionally, you can try the following:
- Filter data at the source: Use filters in the SharePoint folder connector to load only relevant files or data.
- Reduce file size: Ensure files in the folder are optimized by removing unnecessary columns and reducing data volume.
- Minimize query transformations: Perform lightweight transformations to reduce processing complexity in the dataflow.
- Batch or parallel processing: If possible, divide data into smaller subsets for parallel processing.
This resource provides best practices and strategies to enhance the efficiency of your dataflows
dataflows-best-practices
We encourage you to consider raising a support ticket with Microsoft to highlight the urgency of the issue and to ensure it receives appropriate attention and tracking.
How to raise a support ticket
We appreciate your patience while this issue is resolved.
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly and a kudos would be appreciated.
Best regards,
Vinay Kumar.