Scraping from a .asp page using POST

[Trevor_]

I'm attempting to use PowerBI to pull regular updates of posts from a government website:

https://elibrary.ferc.gov/idmws/search/fercadvsearch.asp

This is the search form. It uses a POST method, and I'd like to input a variable into:

<INPUT TYPE="textbox" NAME="textsearch" SIZE=50> 

And then post to the results page:

<FORM NAME="search" ACTION="advResults.asp" METHOD="POST">

This site is public, so I don't think there should be permissions problems. But I'm having a hard time getting it to work. Any ideas on how to pass a particular textsearch variable (like a company name) through the form so I can then download and view recent postings about it? Thanks much. 

[v-lili6-msft]

hi, @Trevor_ 

You could refer to this post:

https://community.powerbi.com/t5/Service/can-I-scrape-html-from-a-web-page-to-get-the-json-data-into...

https://www.poweredsolutions.co/2018/05/14/new-web-scraping-experience-in-power-bi-power-query-using...

and you could also filter data source in power query and use Parameters in Power BI Edit Queries.
This is the tutorial for you to refer to
reference:https://www.mssqltips.com/sqlservertip/4475/using-parameters-in-power-bi/

Best Regards,
Lin

[Trevor_]

Just wanted to bump--any ideas on how to do this? Thanks much.