Memory issue while refresh data from csv files

[Anonymous]

Hi,

I have a few Power BI reports, which has all the sources files are CSV. I have placed these files in the shared folder and imported the files using “Import from Web” option by using the direct link of the reports. These files have more than 5 million rows in each table. The problem with the reports is whenever I refresh the reports, I get an error on refresh saying “ there is not enough memory to complete the operation”.  Whenever I get this error on refresh, I will filter some older data at query editor then the refresh will work.

Could somebody suggest what could be the cause for this issue while refresh and what is the best practice in refreshing these reports without filtering out the data at query editor?

I have also noticed, when I refresh the reports, Power BI is using more memory of my computer and when it reaches the 100% memory usage, refresh gets failed. Please advise if this due to the shortage of RAM in my computer. I am using 16GB RAM.

Also are there any limitations of data size when using CSV files as source?

[lbendlin]

I have placed these files in the shared folder and imported the files using “Import from Web” option 

What is your rationale for this? Have you considered using the Folder connector instead?

After you ingest the CSV files are you attempting any sort of merges?