Forum Discussion
refreshing from sharepoint folder very slow
Why does refreshing 1,1mln rows from csv on Sharepoint folder takes about 1hour,
whilst refreshing the same data saved locally takes 1min?
7 Replies
v-yuta-msftCommunity Support
Hi Gordon2,
If your data source is online such as in onedrive or sharepoint online, they use automatic refresh. This means no user configuration is necessary in order for the dataset to be refreshed on a regular basis. Data refresh settings are configured for you by Power BI. For online service providers, refresh usually occurs once-a-day. For files loaded from OneDrive, automatic refresh occurs about every hour for data that does not come from an external data source. While you can configure different schedule refresh settings and manually refresh, you probably don’t need to.
Regards,
Jimmy Tao
Thanks Jimmy
Unfortunatelly it does not refreshed automaticly. I even do not want this to be refreshed automaticaly.
Every month my client puts csv file on his ondrive/sharepoint which I have to recconect to power bi dashboard.
This file is now about 1.1mln rows and weights above 1GB. It takes more then hour to refresh (if I do not get time out error).
My assumption is the connector to sharepoint folder is very very inefficient. Refreshing the same file from my local computer is not a problem. It running quite fast. So it is not a dataset size issue. Do not tell me please to amend architecture to store data in a different place like database or azure storage. I know this, but at this moment we use Onedrive/Sharepoint as a data storage.
It is quite common practice but I do not understad why it is not so efficient? Both are Microsofts ones, ya?
I find quite a few discussions here on forum, people brought similar questions. Many of them with no sollution given.
- v-yuta-msft
Anonymous,
Try clicking Options-> Data Load-> Unclick all the options in Background Data, Time intelligence and Relationships, do click the Parallel loading of tables like below:
Regards,
Jimmy Tao
