Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
5 years ago
Solved

Web scraping with url not showing query string parameter

Hi, in the following web site: https://www.world.rugby/tournaments/rankings/mru when you choose a different year in the drop down list for example, the query string parameter does not appear in the ...
Need Help
  • PhilipTreacy's avatar
    PhilipTreacy
    5 years ago

    Hi Anonymous 

    That site uses JavaScript to display the page.  You can't use PQ to interact with the site.

    You'd need to use something like VBA to drive a web browser and send commands to change menus etc to display what you want before scraping it.

    Some relevant info on this technique.

    https://www.myonlinetraininghub.com/web-scraping-filling-forms

    Phil

    If I answered your question please mark my post as the solution.
    If my answer helped solve your problem, give it a kudos by clicking on the Thumbs Up.

PhilipTreacy's avatar
PhilipTreacy
Super User
5 years ago

Hi Anonymous 

That site uses JavaScript to display the page.  You can't use PQ to interact with the site.

You'd need to use something like VBA to drive a web browser and send commands to change menus etc to display what you want before scraping it.

Some relevant info on this technique.

https://www.myonlinetraininghub.com/web-scraping-filling-forms

Phil

If I answered your question please mark my post as the solution.
If my answer helped solve your problem, give it a kudos by clicking on the Thumbs Up.