Forum Discussion
Dataflow Gen2 Failing where Gen1 Works
Hi markjdm ,
Dataflow Gen2 is the new generation of dataflow. You can read the following article to understand the difference between Dataflow Gen1 and Dataflow Gen2:
Differences between Dataflow Gen1 and Dataflow Gen2 - Microsoft Fabric | Microsoft Learn
If you are experiencing the exact same query failure in a Gen2 dataflow, consider the following steps to troubleshoot the problem:
- Ensure that the Gen2 data stream has the necessary fabric capacity.
- Verify that the query does not exceed Gen2's functional or resource limits.
If the suggestions above do not help, please provide a specific error message so that we can identify the issue for you.
For moving data from Gen1 to Gen2 and then to Lake Warehouse All-in-One, please see the following links:
Move queries from Dataflow Gen1 to Dataflow Gen2 - Microsoft Fabric | Microsoft Learn
Copy sample data into Lakehouse and transform with dataflow - Microsoft Fabric | Microsoft Learn
Best Regards,
Ada Wang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Hi Ada,
Thanks I've already done most of those. I can't see any document that has the key limitations of gen2. I'm assuming it should have similar or better limitations vs gen 1. However the primary issue is gen1 refreshes sucessfully 100% of the time will gen2 fails 100% of the time. There shouldn't be this kind of discprepancy on a supposed gen2?
On another thing to note on the same dataflow. I tried using the gen1 dataflow and used that as a source for a gen2 dataflow. Even that fails?
Cheers,
Mark
