Forum Discussion
Power query row count changes when refreshed
I'm working with a dataset that contains approx 10 million rows and the source is a text file. I'm finding that if I click refresh in Power Query, even if there has been no change to the text file, t...
Power Query does some sampleing and caching. It holds NO data, so will not hold 10M records. A few thousand at best.
The result should be correct once you load it to the data model, or to an Excel spreadsheet - which cannot hold 10M records either.
If you created field with the row count for a table and loaded that single field single record table, it should work as well as it will be guaranteed to process all of the data, but just clicking REFRESH in the PQ window isn't a super reliable indicator of results - isn't designed to be. Remember, the only data in Power Query is your M code. Not a single byte of data is actually stored there. Only what is loaded to Excel or the data model.