Forum Discussion
Power BI web data source won't refresh
I've got a report uploaded in Power BI that will update the data that is connected to an Excel source, but wont update the data from github raw data. It doesn't display either an error message so I don't know what can the problem could be.
This is an example of my data updated in my Power Bi desktop, where the web datasource does refresh:
And this is how it shows in Power Bi, with the data outdated:
It seems that all of my credentials work:
And the data of the xlsx sources do refresh.
This is the M code of the datasource: = Csv.Document(Web.Contents("https://raw.githubusercontent.com/CSSEGISandData/COVID-19/master/csse_covid_19_data/csse_covid_19_time_series/time_series_covid19_confirmed_global.csv"),[Delimiter=",", Encoding=65001, QuoteStyle=QuoteStyle.None])
pleaseee help!
Ok. I see something. The problem here is that a Data Refresh means that the data grows in rows. When you need a refresh it's because you have more rows. The source data naturaly won't grow in columns like that csv. That's a wrong way to save data. Adding a column by date isn't a good way to save data. Power Bi with csv will ask you to define the number of columns like the following pictures:
If the data adds a new column the engine won't take it unless you change it in desktop and publish again. The data is not supose to add columns, Power Bi Service refresh won't load it.
The ideal solution would include not to save the data like that. I know you may not have the possibility to change that, so you can try setting more columns than the real amount of columns. That way when a new column is added it might be considered.
Hope that helps,
4 Replies
Hi, can you send us the error message? that way we might be able to help more. I addition can you send the public raw data from github? because that last link is 404.
If everything is refresh but you just don't see new data, it might be a problem in data. You should analyze your hidden filters or the data extracted.
Regards,
Thank you! The point is that it doesn't display any error message, it just wont update...
It appears as it has been updated:
But it's not, so I end up uploading again the report from Power Bi Desktop...
Ok. I see something. The problem here is that a Data Refresh means that the data grows in rows. When you need a refresh it's because you have more rows. The source data naturaly won't grow in columns like that csv. That's a wrong way to save data. Adding a column by date isn't a good way to save data. Power Bi with csv will ask you to define the number of columns like the following pictures:
If the data adds a new column the engine won't take it unless you change it in desktop and publish again. The data is not supose to add columns, Power Bi Service refresh won't load it.
The ideal solution would include not to save the data like that. I know you may not have the possibility to change that, so you can try setting more columns than the real amount of columns. That way when a new column is added it might be considered.
Hope that helps,