Forum Discussion
Replace Web.BrowserContents with Web.Contents
- 4 years ago
Hi myriamouan,
This one's got me curious and unfortunately I seem to be running into the same dead ends as you.
I have done a lot of searching with no definitive answers but I suspect it is down to the use of JavaScript or other website specific formatting/design on that site.
One option which I assume you've already thought of and are probably trying to avoid...
- Install a Gateway so you can use the Web.BrowserContents() to still schedule a refresh.
Another possibility I've found is to use the RSS feed link but I don't think it contains all of the same info...
let url = "https://ir.tevapharm.com/rss/pressrelease.aspx", source = Binary.Buffer(Web.Contents(url)), #"Imported XML" = Xml.Tables(source, null, 1252), channel = #"Imported XML"{0}[channel], item = channel{0}[item], #"Changed Type2" = Table.TransformColumnTypes( item, { {"title", type text}, {"description", type text}, {"link", type text}, {"pubDate", type datetimezone} } ) in #"Changed Type2"Here's a similar thread which also doesn't seem to be solved (it is marked as solved but I suspect that is down to the CST member marking it as solved and not the OP)...
I'll keep looking to see if I can find any other options but let me know if any of this helps.
Hi myriamouan,
This one's got me curious and unfortunately I seem to be running into the same dead ends as you.
I have done a lot of searching with no definitive answers but I suspect it is down to the use of JavaScript or other website specific formatting/design on that site.
One option which I assume you've already thought of and are probably trying to avoid...
- Install a Gateway so you can use the Web.BrowserContents() to still schedule a refresh.
Another possibility I've found is to use the RSS feed link but I don't think it contains all of the same info...
let
url = "https://ir.tevapharm.com/rss/pressrelease.aspx",
source = Binary.Buffer(Web.Contents(url)),
#"Imported XML" = Xml.Tables(source, null, 1252),
channel = #"Imported XML"{0}[channel],
item = channel{0}[item],
#"Changed Type2" = Table.TransformColumnTypes(
item,
{
{"title", type text},
{"description", type text},
{"link", type text},
{"pubDate", type datetimezone}
}
)
in
#"Changed Type2"
Here's a similar thread which also doesn't seem to be solved (it is marked as solved but I suspect that is down to the CST member marking it as solved and not the OP)...
I'll keep looking to see if I can find any other options but let me know if any of this helps.
Hi KNP ,
Thank you so much for taking a look at my issue. The second option you suggest works perfectly and it does allow to schedule a refresh on Power BI Service ! The only difference I noticed is that is only scrapes the data that is displayed on the first page and does not browse into the following pages of the same link. This is not a problem for me since it is only essential for me to have the latest news releases, the former news are just bonuses.
As you guessed, I am indeed trying to avoid using a gateway as I am working from a business environment that does not provide me with an enterprise gateway.
Thanks a lot for your help! I will implement this solution to the rest of my queries and mark your answer as solution.
Best,
Myriam