Running 4 Queries in Parallel, and then Append as New?

[LeoL]

Hello!

I have 4 SQL queries I am importing in parallel. Total runtime is about 40 minutes.

However, when I add an Append as New into the mix, the runtime goes all the way up to 2 hours and 30 minutes.

When you Append as New, is parallel query still preserved? 

Br,

L

[collinq · Accepted solution]

Hi @LeoL ,

It COULD be that the append as new is an issue but to help out.  Make sure that the individual queries are set to NOT "enable load" as that could be causing issues as well that cost you performance.

You may also want to turn on Performance Analyzer or the Query Diagnostics to see if that helps you out in where the issue might be that is causing the delay.

[Anonymous · Accepted solution]

Hi,

Thanks for the solution collinq offered, and i want to offer soem more information for user to refet to.

hello @LeoL , you can use enable tracing in options settings.

Then in power query can trace the steps to trace the performance then check which step affect the performance.

You can refer to the following link abou it.

Query diagnostics - Power Query | Microsoft Learn

And the performance of Append is better than Append as New.

You can refer to the following thread.

Solved: Append vs Append as new for performance - Microsoft Fabric Community

Best Regards!

Yolo Zhu

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[collinq · Accepted solution]

Hi @LeoL ,

It COULD be that the append as new is an issue but to help out.  Make sure that the individual queries are set to NOT "enable load" as that could be causing issues as well that cost you performance.

You may also want to turn on Performance Analyzer or the Query Diagnostics to see if that helps you out in where the issue might be that is causing the delay.