Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Be one of the first to start using Fabric Databases. View on-demand sessions with database experts and the Microsoft product team to learn just how easy it is to get started. Watch now

Reply
jerald
Frequent Visitor

Poor performance in data refresh using multiple large CSV files

Power BI newbie here. I have large CSV files scattered on multiple directories. I specify datasource using Get Data > More > Folder. , Its taking too long when you hit refresh to get updated data. Does Power BI re-read all CSV files even if they are not updated? Is it better to have 1 large csv files compared to just incrementally adding new csv for every update?

 

3 REPLIES 3
GilbertQ
Super User
Super User

Hi @jerald,

 

Having worked quite a lot with CSV's it would be ideal to put all the data into on CSV file, so it does not have to and read all the individual files.

 

Also currently there is no incremental refresh option as you have indicated.

 

You can refer to my blog post below, where I give some tips in terms of how to process CSV files as quickly as possible.

 

Power BI – Quick Tips working with multiple large CSV Files





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!







Power BI Blog

v-shex-msft
Community Support
Community Support

Hi @jerald,

 

You can turn off refresh function in query editor:

 

1. Open query editor.
2. Choose the query which you don't want to refresh.
3. Right-Click on it and turn off the "Include In Report Refresh" option.

 

Regards,

Xiaoxin Sheng

Community Support Team _ Xiaoxin
If this post helps, please consider accept as solution to help other members find it more quickly.

Hi @v-shex-msft,

 

I forgot to mention that this multiple csv files are in only 1 query. I was hoping that Power BI supports incremental refresh but I recently found out that this is not supported.

 

-Jerald

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!

Dec Fabric Community Survey

We want your feedback!

Your insights matter. That’s why we created a quick survey to learn about your experience finding answers to technical questions.

ArunFabCon

Microsoft Fabric Community Conference 2025

Arun Ulag shares exciting details about the Microsoft Fabric Conference 2025, which will be held in Las Vegas, NV.

December 2024

A Year in Review - December 2024

Find out what content was popular in the Fabric community during 2024.