Forum Discussion

Scott_Powell's avatar
Scott_Powell
Icon for Advocate IV rankAdvocate IV
2 years ago

Gen2 Dataflow to Warehouse - really slow performance

Hi, I'm hitting an issue with loading data from on-prem SQL server to a Fabric Warehouse using dataflows gen2. I'm only moving 34k rows (about 30 columns), and it's taking almost 13 minutes to do thi...
Tips and Tricks
Joshrodgers123's avatar
Joshrodgers123
Icon for Advocate V rankAdvocate V
2 years ago

I'm seeing the same thing as well. I'd really love to start using warehouses but can't seem to get anything but really slow performance or errors.

 

I have a DFG2 writing 2 tables 300k and 400k records each. 

With no destination: 50 seconds

With warehouse destination, staging enabled: 50 minutes

With warehouse destination, staging disabled, times out after 3.5 hour and locks up the warehouse from being accessed.