Forum Discussion
Scrape from multiple pages
Hi, I am trying to scrape the data from this link that has multiple pages....
http://190.34.154.84/consultar_tramites/grid_registros_sanitarios_medicamentos/
I am able to connect to it succesfully and see the data I need in Table 43. However, the site has multiple pages and I am not able to edit the Source code in "Advance Editor" as the below video suggests (changing the start page, etc.)
https://www.myonlinetraininghub.com/scrape-data-multiple-web-pages-power-query
Any suggestions as to how to do this when there is no start page indicated?
a1979d
Please refer to the blog below:
Web Scraping 2: Scrape multiple pages at once and refresh in Power BI service – The BIccountantPaul Zheng _ Community Support Team
If this post helps, please Accept it as the solution to help the other members find it more quickly.
3 Replies
Just to expand further...this is the Source code I was looking to edit in Advance Editor but didn't find anything I could change in that line as to scrape the data from the different pages.
let
Source = Web.BrowserContents("http://190.34.154.84/consultar_tramites/grid_registros_sanitarios_medicamentos/")Thanks!
a1979d
Please refer to the blog below:
Web Scraping 2: Scrape multiple pages at once and refresh in Power BI service – The BIccountantPaul Zheng _ Community Support Team
If this post helps, please Accept it as the solution to help the other members find it more quickly.Hello Anonymous , I'm having an issue trying to scrape monthly liquor sales data from the following website:
http://www.barmart.net/ReportSelect1.aspx
The URL doesn't seem to change when new filters are used or when clicking through to page 2, 3, etc. There are seemingly hundreds of pages of data, but I've only been succesful in pulling the first 200 or so when dropping the URL into the Web Query in PBI Desktop. It appears that filtering for larger timeframes is not accounted for, but defaults back to the current month filter.
Can anyone please steer me in the right direction before I start going copy/pasta crazy? 🙂
Thank you,
Kevin
