Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
5 years ago
Solved

Web scraping with url not showing query string parameter

Hi, in the following web site: https://www.world.rugby/tournaments/rankings/mru

when you choose a different year in the drop down list for example, the query string parameter does not appear in the url string that still appear the same. Then difficult to put a parameter in any web query. Thus, has anyone an idea how to make a query for a specific date of this site in power BI?

thanks very much for any answer.

  • Hi Anonymous 

    That site uses JavaScript to display the page.  You can't use PQ to interact with the site.

    You'd need to use something like VBA to drive a web browser and send commands to change menus etc to display what you want before scraping it.

    Some relevant info on this technique.

    https://www.myonlinetraininghub.com/web-scraping-filling-forms

    Phil


    If I answered your question please mark my post as the solution.
    If my answer helped solve your problem, give it a kudos by clicking on the Thumbs Up.

2 Replies

  • Hi Anonymous 

    That site uses JavaScript to display the page.  You can't use PQ to interact with the site.

    You'd need to use something like VBA to drive a web browser and send commands to change menus etc to display what you want before scraping it.

    Some relevant info on this technique.

    https://www.myonlinetraininghub.com/web-scraping-filling-forms

    Phil


    If I answered your question please mark my post as the solution.
    If my answer helped solve your problem, give it a kudos by clicking on the Thumbs Up.

  • Anonymous's avatar
    Anonymous
    Not applicable

    Thank you very much, helps a lot, though not that easy. 🙂