Forum Discussion
Web scraping - website changed
Hi PBi Users, I, on a daily basis, scrape a web site for fund prices but the website has been updated over the weekend and my query (below) and table below, no longer works. Please may you help m...
I appreciate you having a go HotChilli
Sadly, yes it is quite complex. I have spent most of the day manually scraping the website .... eeeek!
Yes, the table name has changed, apologies for not stating that in my original post. There are 39 "sectorid" and each sectorid, could possibly, have more than 1 page and with the change in the website you can't put page numbers in the URL. That's just another headache I have come across.
Anyway I appreciate you taking the time to look. I'll keep scratching my head and hopefully reach a solution
Thanks again
Another headache I faced was not able to navigate to the tab "Prices & Yields". This doesn't appear in the URL so I don't know how to access this tab via the query.
Many thanks