Reply
avatar user
Anonymous
Not applicable

Failing a scheduled update with public web sources

Hello,

I want to create a dashboard in which I have visualizations for different KPIs that change on a daily basis (e.g. oil price). The data comes from online web sources. When I get the data the only way I could schedule a update was with the help of a personal gateway. Then it is working if my laptop is turned on during the scheduled update. Is there a chance how I can have a scheduled update without the dependency on my laptop, so without my personal gateway?

 

Thank you!!

Timo

1 REPLY 1
ibarrau
Super User
Super User

Hi. Scrapping web pages usually demands a Gateway. It depends on how the web page is built and your Power Query M knowledge if you can get rid of the Excel. To make the story short, the Web.Page power query function needs the gateway, but if you manage to get the data with just Web.Contents and some Power Query magic, you might be able to get capture the numbers you need without using the function. It won't work always, it depends on how the website was built.

Another alternative would be using a web service to get the data and then get the data with Power Bi. For example, you can create an Azure Function that take the data from the web site with some code. Then you can just get the data from the Azure Function URL with Power Bi like an API.

I hope that helps because if the alternatives don't solve your problem you might want to create a Virtual Machine to install a gateway in order to keep the VM turned on 24x7 hours.

Regards,


If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Happy to help!

LaDataWeb Blog

avatar user

Helpful resources

Announcements
March PBI video - carousel

Power BI Monthly Update - March 2025

Check out the March 2025 Power BI update to learn about new features.

March2025 Carousel

Fabric Community Update - March 2025

Find out what's new and trending in the Fabric community.

Top Solution Authors (Last Month)
Top Kudoed Authors (Last Month)