Forum Discussion
Gateway needed for web data ?
It depends on how the underlying M Code is being used.
I cannot recall off the top of my head, but I am certain there are different ways.
I got this from a good friend of mine
Web.page function needs gateway. If you use web.contents you won't need it.
So just check the underlying M Code.
- cnschulz7 years agoHelper IV
Thanks for your quick reply.
I am using the "out of the box" web data source. When I add my URL the following code is added as a source.
= Web.Page(Web.Contents("http://www.bom.gov.au/tas/observations/tasall.shtml"))If I remove the "Web.Page()" and leave the Web.Contents, I am shown an icon of the website and my only option is to click to expands the data, which regenerates the Web.Page() wrapper.
When I attempt to set up refresh on the generated dataset, i am prompted to use a gateway. :(
Any ideas?
- GilbertQ7 years agoSuper UserNot off the top of my head, but I am sure that there is a way to get this done.
- luisrh7 years agoResponsive Resident
You are screen scraping. Is there a web service end point that returns JSON or CSV for this site? You can hand code M to do the expansion. Here is a post that can help you. https://community.powerbi.com/t5/Desktop/Web-scraping-advice/td-p/330414
- cnschulz7 years agoHelper IV
Hi,
The very first source line of that linked page is identical to mine
Source = Web.Page(Web.Contents("http://..."Therefore, it should require a web gateway as well.
Has anyone processed web (http) data in a report on the powerbi service without a gateway? Is so please detail the steps.
- GilbertQ7 years agoSuper UserHi there
As explained above it can only be done with a Web.Contents, if there is a Web.Page it will require a gateway.