Web data won't refresh in Power BI Desktop report

[zia_ward]

Hi,

In my Desktop Power BI Report, I make use of Web data (via import). When I click on Refresh, the process completes successfully but I don't see the Web-based dataset to be updated. The web data is John Hopkins COVID data (https://raw.githubusercontent.com/CSSEGISandData/COVID-19/master/csse_covid_19_data/csse_covid_19_ti...) which adds a new column every day. 

Any suggestions how to refresh the data to fetch latest CSV file from web. 

I also plan to upload this BI report to web. If any suggestions what to look out for to make sure the report data is refreshed successfully everyday.

Thanks.

[lbendlin · Accepted solution]

When you import a CSV file the connector makes a note of the number of columns.

let
    Source = Csv.Document(Web.Contents("https://raw.githubusercontent.com/CSSEGISandData/COVID-19/master/csse_covid_19_data/csse_covid_19_time_series/time_series_covid19_confirmed_US.csv"),[Delimiter=",", Columns=608, Encoding=1252, QuoteStyle=QuoteStyle.None]),
    #"Promoted Headers" = Table.PromoteHeaders(Source, [PromoteAllScalars=true])
in
    #"Promoted Headers"

You need to manually edit that part of the code and remove the reference.  Otherwise the connector will ignore any new columns that are added.

let
    Source = Csv.Document(Web.Contents("https://raw.githubusercontent.com/CSSEGISandData/COVID-19/master/csse_covid_19_data/csse_covid_19_time_series/time_series_covid19_confirmed_US.csv"),[Delimiter=",",  Encoding=1252, QuoteStyle=QuoteStyle.None]),
    #"Promoted Headers" = Table.PromoteHeaders(Source, [PromoteAllScalars=true])
in
    #"Promoted Headers"