Forum Discussion
Replace Web.BrowserContents with Web.Contents
- 4 years ago
Hi myriamouan,
This one's got me curious and unfortunately I seem to be running into the same dead ends as you.
I have done a lot of searching with no definitive answers but I suspect it is down to the use of JavaScript or other website specific formatting/design on that site.
One option which I assume you've already thought of and are probably trying to avoid...
- Install a Gateway so you can use the Web.BrowserContents() to still schedule a refresh.
Another possibility I've found is to use the RSS feed link but I don't think it contains all of the same info...
let url = "https://ir.tevapharm.com/rss/pressrelease.aspx", source = Binary.Buffer(Web.Contents(url)), #"Imported XML" = Xml.Tables(source, null, 1252), channel = #"Imported XML"{0}[channel], item = channel{0}[item], #"Changed Type2" = Table.TransformColumnTypes( item, { {"title", type text}, {"description", type text}, {"link", type text}, {"pubDate", type datetimezone} } ) in #"Changed Type2"Here's a similar thread which also doesn't seem to be solved (it is marked as solved but I suspect that is down to the CST member marking it as solved and not the OP)...
I'll keep looking to see if I can find any other options but let me know if any of this helps.
Hi myriamouan,
This one's got me curious and unfortunately I seem to be running into the same dead ends as you.
I have done a lot of searching with no definitive answers but I suspect it is down to the use of JavaScript or other website specific formatting/design on that site.
One option which I assume you've already thought of and are probably trying to avoid...
- Install a Gateway so you can use the Web.BrowserContents() to still schedule a refresh.
Another possibility I've found is to use the RSS feed link but I don't think it contains all of the same info...
let
url = "https://ir.tevapharm.com/rss/pressrelease.aspx",
source = Binary.Buffer(Web.Contents(url)),
#"Imported XML" = Xml.Tables(source, null, 1252),
channel = #"Imported XML"{0}[channel],
item = channel{0}[item],
#"Changed Type2" = Table.TransformColumnTypes(
item,
{
{"title", type text},
{"description", type text},
{"link", type text},
{"pubDate", type datetimezone}
}
)
in
#"Changed Type2"
Here's a similar thread which also doesn't seem to be solved (it is marked as solved but I suspect that is down to the CST member marking it as solved and not the OP)...
I'll keep looking to see if I can find any other options but let me know if any of this helps.
I noticed that some websites simply don't offer RSS feed. How would you proceed in this situation?
- KNP4 years agoSuper User
That is a good question and one I'm still trying to figure out.
My best guess so far, you'd need to dig into the developer tools in your web browser or use an external tool like Fiddler or Wireshark to inspect the HTTP traffic. From there, it may be possible to find another URL that is being called when the site loads.
Similar issues mentioned in this post...