Forum Discussion
Data Refresh is too much slow in Power Query
- 3 years ago
In my experience, the Sharepoint connectors are one of the slowest ones. First, the data sources have some considerable size (200-400 MB). Due the nature of the source, Power Query does not perform query folding (detailed explanation of what this is here). For that reason, Power Query will always perform each and every step of the query once you add a new step or modify one. The speed of this will depend on the processing capacity of your laptop/PC and available RAM, since it will need to work thoroughly to download that data, import it and process it. I would like to say there is a faster way to do it, but unless you use Power Query through a dataflow in a premium capacity or have a super powerful computer, unfortunately it will always take its time.
What can you do about it? Remove rows (filter) and columns that you don't need on your first step.
In my experience, the Sharepoint connectors are one of the slowest ones. First, the data sources have some considerable size (200-400 MB). Due the nature of the source, Power Query does not perform query folding (detailed explanation of what this is here). For that reason, Power Query will always perform each and every step of the query once you add a new step or modify one. The speed of this will depend on the processing capacity of your laptop/PC and available RAM, since it will need to work thoroughly to download that data, import it and process it. I would like to say there is a faster way to do it, but unless you use Power Query through a dataflow in a premium capacity or have a super powerful computer, unfortunately it will always take its time.
What can you do about it? Remove rows (filter) and columns that you don't need on your first step.
Finally, I got the good suggestion.
Thank you