Gen2 Dataflow to Warehouse - really slow performance

[Scott_Powell]

Hi, I'm hitting an issue with loading data from on-prem SQL server to a Fabric Warehouse using dataflows gen2. I'm only moving 34k rows (about 30 columns), and it's taking almost 13 minutes to do this (see image at bottom). Staging is disabled for this (these jobs literally just copy the data as is, with no transformations).

• If I enable staging, I can see the staging objects load in < 30 seconds, and then it takes 12+ minutes to write from the staging warehouse to the actual real warehouse.
• If I write the records to a Lakehouse instead of a Warehouse, the whole thing always completes in 30 - 45 seconds.

Is this type of performance typical for loading a Warehouse??? Can't believe it is, but the jobs are too simple to have anything messed up I think. Any ideas?

Thanks,

Scott

[Scott_Powell]

I've spoken with support and sent them the relevant info, I'll update this post as soon as we figure out what's going on.

Thanks!

Scott

[DataPne]

Hi Scott,

Did support manage to assist you at all? Im having a call with them tomorrow for the same issue.

Thanks a lot!
Pne