Get data from multiple pages on a website - no page # in URL

[SLR71]

Hi,

I am trying to extract all the pages of data from this URL https://www.cahss.ca/surveillanceDiseaseAlert/equine/ . I am able to bring in the first 10 in a nice table with web connector and extract HTML but I need all the pages. The URL does not change as you move through the pages on the site.

I have looked at a number of the suggestions in the forum

https://www.mattmasson.com/2014/11/iterating-over-multiple-pages-of-web-data-using-power-query/

https://exceleratorbi.com.au/using-power-query-extracting-non-tabular-data-web-pages/

https://www.sumproduct.com/thought/referencing-multi-page-data-from-a-web-site-with-a-single-url

but all require the URL to have a page number reference which mine does not have.

Any help would be appreciated.

Thanks

[soumyaiyer]

@SLR71 Hello! were you able to find a solution where the URL does not have a page indicator. Thanks!

[SLR71 · Accepted solution]

Hello

Using just the first line of code from https://www.mattmasson.com/2014/11/iterating-over-multiple-pages-of-web-data-using-power-query/ as an example, I tried: 

= Web.Page(Web.Contents("https://www.cahss.ca/surveillanceDiseaseAlert/equine/"))

This resulted in a table that I could expand with all the pages required.

As soon as I ask for help . . . the brain kicks in.

[TheoC]

Hi @SLR71 , the link to Matt Masson's page leads to a Wordpress Error. By chance, do you have this code you're referring to?  I am trying to scrape rows from the site: https://www.coronavirus.vic.gov.au/exposure-sites but it ceases at 30 records only.

Thanks heaps in advance!

[angelevans]

This is great! So how do you get the data into excel?