Very long time loading a query to the sheet

[bjurek]

Hello. I am writing about the very long time needed to load my Query.

This is a very simple query.

I download about 50 .csv files from a folder.

It transforms using Csv.document and Table.SelectColumns and Table.SelectRows.

Additionally, one Join and several calculated and conditional columns.

The number of expected "rows" as a result of loading into the sheet is about 200,000.

The loading time is about 2-3 hours. Is it normal?

[ImkeF]

Hi @bjurek ,
I would say that this is not normal. Are you by any chance referencing a whole table in one of your calculated or conditional columns? Then you should buffer that referenced table, as without a buffer, it would be loaded over an over again for each row where you reference it.

[bjurek]

Thanks for the answer.

Typically, as in this case, it adds calculated and conditional columns step by step.

It looks something like this:

1.Data import
2.Transformation (including calculated and conditional columns)
3.Load
I added the "Query dependencies" chart to the original post. Maybe this will show where I'm making a mistake