Forum Discussion

pat_energetics's avatar
pat_energetics
Icon for Advocate II rankAdvocate II
9 years ago

Web scraping a site which requires form data entry before producing a data table

Hi all,

 

I'm after some guidance on the best way of obtaining all of the available data from the following web site.

 

https://www.rec-registry.gov.au/rec-registry/app/public/lgc-register

 

The site requires a form to be completed before producing a data table. (or several tables over many pages)

 

Registry form - "select all" needed for each drop down

 

Is there a way of parameterising a query so that ALL of the available data would be returned?

 

Thanks in advance.

2 Replies