Forum Discussion
Gateway needed for web data ?
I got this from a good friend of mine
Web.page function needs gateway. If you use web.contents you won't need it.
So just check the underlying M Code.
Thanks for your quick reply.
I am using the "out of the box" web data source. When I add my URL the following code is added as a source.
= Web.Page(Web.Contents("http://www.bom.gov.au/tas/observations/tasall.shtml"))
If I remove the "Web.Page()" and leave the Web.Contents, I am shown an icon of the website and my only option is to click to expands the data, which regenerates the Web.Page() wrapper.
When I attempt to set up refresh on the generated dataset, i am prompted to use a gateway. :(
Any ideas?
- GilbertQ7 years agoSuper UserNot off the top of my head, but I am sure that there is a way to get this done.
- luisrh7 years agoResponsive Resident
You are screen scraping. Is there a web service end point that returns JSON or CSV for this site? You can hand code M to do the expansion. Here is a post that can help you. https://community.powerbi.com/t5/Desktop/Web-scraping-advice/td-p/330414
- cnschulz7 years agoHelper IV
Hi,
The very first source line of that linked page is identical to mine
Source = Web.Page(Web.Contents("http://..."Therefore, it should require a web gateway as well.
Has anyone processed web (http) data in a report on the powerbi service without a gateway? Is so please detail the steps.
- GilbertQ7 years agoSuper UserHi there
As explained above it can only be done with a Web.Contents, if there is a Web.Page it will require a gateway.- kirvis5 years agoHelper I
Hi,
Don't know if this is still actual, but I ran into the same issues.
I found a workaround, which I describe here: https://community.powerbi.com/t5/Power-Query/WORKAROUND-How-to-use-scheduled-refresh-of-a-web-page-without/m-p/1434043#M44835.
Hope that helps!
Kirvis