Forum Discussion
Web scraping with url not showing query string parameter
Hi, in the following web site: https://www.world.rugby/tournaments/rankings/mru
when you choose a different year in the drop down list for example, the query string parameter does not appear in the url string that still appear the same. Then difficult to put a parameter in any web query. Thus, has anyone an idea how to make a query for a specific date of this site in power BI?
thanks very much for any answer.
Hi Anonymous
That site uses JavaScript to display the page. You can't use PQ to interact with the site.
You'd need to use something like VBA to drive a web browser and send commands to change menus etc to display what you want before scraping it.
Some relevant info on this technique.
https://www.myonlinetraininghub.com/web-scraping-filling-forms
Phil
If I answered your question please mark my post as the solution.
If my answer helped solve your problem, give it a kudos by clicking on the Thumbs Up.
2 Replies
- PhilipTreacySuper User
Hi Anonymous
That site uses JavaScript to display the page. You can't use PQ to interact with the site.
You'd need to use something like VBA to drive a web browser and send commands to change menus etc to display what you want before scraping it.
Some relevant info on this technique.
https://www.myonlinetraininghub.com/web-scraping-filling-forms
Phil
If I answered your question please mark my post as the solution.
If my answer helped solve your problem, give it a kudos by clicking on the Thumbs Up. - AnonymousNot applicable
Thank you very much, helps a lot, though not that easy. 🙂