The ultimate Microsoft Fabric, Power BI, Azure AI, and SQL learning event! Join us in Stockholm, Sweden from September 24-27, 2024.
2-for-1 sale on June 20 only!
Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started
Hi!
I want to scrap data from web page with ratings and reviews of the clients. However, there is a button "Show more", which doesn't change URL link, but expand number of reviews.
Power Query capable of scraping from what is shown on the default web page instance. So, even if you were to click and expand the data set to 100 rows, the Power Query engine is still only going to detect the first 10.
What can I do to fix this problem?
Hi @Anonymous
This Show more button may not actually be loading more data, it may just be displaying it on screen. So the data you are after may be in the page, just not displayed. I can't say for sure without knowing the URL and checking it.
But if the Show more button does load more data then you won't be able to use PQ to interact with the page and click that button.
To do this you will need to use something like VBA and/or Selenium to drive a web browser and get your data.
Further info on that approach here
Web Scraping - Filling in Forms • My Online Training Hub
regards
Phil
Proud to be a Super User!
Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.
Check out the June 2024 Power BI update to learn about new features.
User | Count |
---|---|
34 | |
19 | |
18 | |
16 | |
13 |