Forum Discussion

motoray's avatar
motoray
Advocate V
3 years ago

Gen2 Dataflow failures when loading medium sized datasets

I've been trying to get a medium-sized (100,000 records for now) dataset to load from a SQL database (on prem and Azure) to a Fabric Warehouse from a Gen2 dataflow. I can get it to load 1000 or 10000...
Dataflows
Need Help
SidJay's avatar
SidJay
Microsoft Employee
3 years ago

Hi motoray,

 

This is unexpected behavior with the SQL endpoint and we are still actively debugging the issue. The issue (connection forcibly closed by remote host) is sporadic and there isn't a specific limit or throttle that you're running into.

 

Thanks

motoray's avatar
motoray
Advocate V
2 years ago

Thanks for working with me on this. It was really good to hear from you and have the issue confirmed yesterday.