need some suggestion - fetch data from view in sql server hourly ?

Hi suvechha ,

I think the answer is query folding.

Connect to the view using the SQL Server source. This will only import the first 1,000 rows for preview.

Make your transformations, like filters, removing columns etc. and, for the most part, these will get folded back to the server to reduce the query volume.

You can check which steps have been folded to the server by right-clicking on the Power Query steps and seeing if the 'View Native Query' option is lit up. If it is, all the steps up to that one have been folded. If not, the folding has been broken by one of your steps and they should be reordered/adjusted to maintain folding for as much of the query as possible.

If you need all 3.5m rows and all columns, and you continue to get memory errors, there's not much you can do but directly address the memory issues via hardware etc.

Pete