Failing a scheduled update with public web sources

[Anonymous]

Hello,

I want to create a dashboard in which I have visualizations for different KPIs that change on a daily basis (e.g. oil price). The data comes from online web sources. When I get the data the only way I could schedule a update was with the help of a personal gateway. Then it is working if my laptop is turned on during the scheduled update. Is there a chance how I can have a scheduled update without the dependency on my laptop, so without my personal gateway?

Thank you!!

Timo

[ibarrau]

Hi. Scrapping web pages usually demands a Gateway. It depends on how the web page is built and your Power Query M knowledge if you can get rid of the Excel. To make the story short, the Web.Page power query function needs the gateway, but if you manage to get the data with just Web.Contents and some Power Query magic, you might be able to get capture the numbers you need without using the function. It won't work always, it depends on how the website was built.

Another alternative would be using a web service to get the data and then get the data with Power Bi. For example, you can create an Azure Function that take the data from the web site with some code. Then you can just get the data from the Azure Function URL with Power Bi like an API.

I hope that helps because if the alternatives don't solve your problem you might want to create a Virtual Machine to install a gateway in order to keep the VM turned on 24x7 hours.

Regards,