Forum Discussion
Web scraping - website changed
Hi PBi Users, I, on a daily basis, scrape a web site for fund prices but the website has been updated over the weekend and my query (below) and table below, no longer works. Please may you help m...
I think it might be an anti-spam thing on this forum but they shorten any URLs in posted stuff so we don't know what the 2 lines with web links are.
I had a brief try with the Query. The table that gets returned with fund names is results__table not sortableTable.
The second web call (RearragnedURL ) presumably constructs each url with positions in the list e.g. You can see that the &start= parameter controls which fund is displayed on the page
https://www.hl.co.uk/funds/fund-discounts,-prices--and--factsheets/search-results?sectorid=121&start=0&rpp=20&lo=0%2C1&sort=fd.full_description&sort_dir=asc
https://www.hl.co.uk/funds/fund-discounts,-prices--and--factsheets/search-results?sectorid=121&start=20&rpp=20&lo=0%2C1&sort=fd.full_description&sort_dir=asc
Overall, I think the work involved is too complex for a forum issue. It needs time and effort.