Forum Discussion
Covid-19 Vaccination Effort How to use table.buffer PLEASE HELP
I am working on the Covid-19 vaccination effort and I could really use some help as I do not normally write code. I am using power query to load data from a set of CSV files, but the data refreshes a...
CNENFRNL
Community Champion
Community Championsimonbernick , I ran into a similar situation not long time ago and here's my solution for your reference.
- in the first place imported all dataset into a database.
- then use Value.NativeQuery() to execute as much manipulation of dataset as possible at the db end, especially operations like row/column selection, table joins, etc;
- finally use PQ for complex data aggregation or format cleansing
even a simplest Access also worked like a charm in my scenario; some filtering operations took 3 minutes without db but only seconds while incorporating with db! It's worth trying.
For reasons I can't explain, I can't move the data to a database (I wish I could) so I am looking for other solutions. I really wish there was a way I could just buffer the csv files in my RAM.