Scrape from multiple pages

[a1979d]

Hi, I am trying to scrape the data from this link that has multiple pages....

http://190.34.154.84/consultar_tramites/grid_registros_sanitarios_medicamentos/

I am able to connect to it succesfully and see the data I need in Table 43. However, the site has multiple pages and I am not able to edit the Source code in "Advance Editor" as the below video suggests (changing the start page, etc.) 

https://www.myonlinetraininghub.com/scrape-data-multiple-web-pages-power-query

Any suggestions as to how to do this when there is no start page indicated?

[V-pazhen-msft · Accepted solution]

@a1979d 
Please refer to the blog below:
Web Scraping 2: Scrape multiple pages at once and refresh in Power BI service – The BIccountant

Paul Zheng _ Community Support Team
If this post helps, please Accept it as the solution to help the other members find it more quickly.

[Anonymous]

Hello @V-pazhen-msft , I'm having an issue trying to scrape monthly liquor sales data from the following website: 

http://www.barmart.net/ReportSelect1.aspx

The URL doesn't seem to change when new filters are used or when clicking through to page 2, 3, etc. There are seemingly hundreds of pages of data, but I've only been succesful in pulling the first 200 or so when dropping the URL into the Web Query in PBI Desktop. It appears that filtering for larger timeframes is not accounted for, but defaults back to the current month filter. 

Can anyone please steer me in the right direction before I start going copy/pasta crazy? 🙂

Thank you, 
Kevin

[a1979d]

Just to expand further...this is the Source code I was looking to edit in Advance Editor but didn't find anything I could change in that line as to scrape the data from the different pages. 

let
Source = Web.BrowserContents("http://190.34.154.84/consultar_tramites/grid_registros_sanitarios_medicamentos/")

Thanks!