Forum Discussion

bjurek's avatar
bjurek
Helper I
3 years ago

Very long time loading a query to the sheet

Hello. I am writing about the very long time needed to load my Query.

This is a very simple query.

I download about 50 .csv files from a folder.

It transforms using Csv.document and Table.SelectColumns and Table.SelectRows.

Additionally, one Join and several calculated and conditional columns.

The number of expected "rows" as a result of loading into the sheet is about 200,000.

The loading time is about 2-3 hours. Is it normal?

 

 

 

Need Help

2 Replies

  • ImkeF's avatar
    ImkeF
    Community Champion
    3 years ago

    Hi bjurek ,
    I would say that this is not normal. Are you by any chance referencing a whole table in one of your calculated or conditional columns? Then you should buffer that referenced table, as without a buffer, it would be loaded over an over again for each row where you reference it.


    • bjurek's avatar
      bjurek
      Helper I
      3 years ago

      Thanks for the answer.

      Typically, as in this case, it adds calculated and conditional columns step by step.

      It looks something like this:

      1.Data import
      2.Transformation (including calculated and conditional columns)
      3.Load
      I added the "Query dependencies" chart to the original post. Maybe this will show where I'm making a mistake