Forum Discussion
Are Gen 2 Dataflows slower than Gen 1?
I got the option today to save my Dataflow as a GEN 2 dataflow so I thought, what the heck lets try it.
So it did a save as and made a copy of the dataflow so now I have one of each.
I refreshed each dataflow. The Gen 2 was twice as slow as Gen 1 every time.
They have the exact same query against the exact same database.
Is anyone else seeing the performance of Gen 2 is worse than Gen 1?
Hi kevin-ky ,
If you haven't already, you should enable fast copy in the Dataflow Gen2.
Here is how to do it:
https://learn.microsoft.com/en-us/fabric/data-factory/dataflows-gen2-fast-copy
4 Replies
Hi kevin-ky ,
If you haven't already, you should enable fast copy in the Dataflow Gen2.
Here is how to do it:
https://learn.microsoft.com/en-us/fabric/data-factory/dataflows-gen2-fast-copy
Hi kevin-ky
The reason that this can also be longer is because in a Dataflow Gen 2 it writes the information out to a place in fabric, so depending on the data source that it is writing to will also consume a bit of extra time to get this done. I would also highly recommend looking at Data Flow Gen 2 with CICD which should be faster and more reduced capacity units.
Hi kevin-ky,
I would also take a moment to thank GilbertQ , djurecic for actively participating in the community forum and for the solutions you’ve been sharing in the community forum. Your contributions make a real difference.
I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions.
Regards,
Community Support Team.Hi kevin-ky,
I hope the above details help you fix the issue. If you still have any questions or need more help, feel free to reach out. We are always here to support you.
Regards,
Community Support Team.
