Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
7 years ago

refreshing from sharepoint folder very slow

Why does refreshing 1,1mln rows from csv on Sharepoint folder takes about 1hour, whilst refreshing the same data saved locally  takes 1min?
Need Help
Anonymous's avatar
Anonymous
Not applicable
7 years ago

Thanks Jimmy

 

Let me add some thoughts. I repeated my tests after one month and got totally different results:

 

 

tests made in mid of Dec  (PBI Nov 2018 release) -> it takes +60min to import to pbi desktop

tests made in mid of Jan   (PBI Dec 2018 release) - > it takes about 5min to import to pbi desktop

 

I suppose big performance improvments in Dec 18 PBI desktop release. 

 

I have also tested the settings you suggested and here are results.

With my original settings I got exact time of 5min 24 sec to import data:

With a new settings I got 5min 09sek to import data:

It is not a big diff but it is something. :)

Anonymous's avatar
Anonymous
Not applicable
7 years ago
I'm experiencing the exact same issue: it's taking a very long time to load a 1.5 million rows csv file. I can't convert it to xls because it's too large. How is your file performance with the latest pbi update (Apr 19)?
  • Anonymous's avatar
    Anonymous
    Not applicable
    7 years ago

    I started to compress csv files to csv.gz 

    It gives significant reduction in size and loading times.

    With some tricks Power BI can connect to such file.