power bi query web click on links and capture contented

[se2]

I see that power bi can not use by example to add custom columns, and also that there is a way to capture links, either as text or icons.  But what if you want to go to a web page and not only capture a table, but also click on a link, and that the context that comes ?

This one is useful in that it has some links for different years to click on

https://scrapethissite.com/pages/ajax-javascript/

But I am think of a web page that (1) has useful information, including a table and (2) an incon that when clicked, lets the user chose from a drop down menu, when an time is chose another web page comes up?  Can this be done with power bi query

Thanks,

Steve

[Anonymous]

Hi @se2 ,

Could you tell me if your problem has been solved? If it is, kindly Accept it as the solution. More people will benefit from it.

Best Regards,
Eyelyn Qin

[Anonymous]

Hi @se2 ,

Thanks for your sharing.

And according to my understanding, you want to capture data from web pages in batch,right?

You could refer to this blog for further help. This approach works with URLs that have a predictable structure.

Best Regards,
Eyelyn Qin
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[PhilipTreacy]

Hi @se2 

PBI can't interact with web pages like this.  In order to click on elements on a web page like links/buttons you'll need to use something like VBA to drive the browser andinteract with the website.

Refer to this article that describes how to do this

Web Scraping - Filling in Forms • My Online Training Hub

Regards

Phil

[Anonymous]

Hi @se2 

What happens on the web page is it creates different urls when you click on some link to display data.

Check the URL you provided and click on the year the url gets appended with year.

PBI will point to an static URL and table from that URL and doesn't take in consideration what you do there.

Now if you know how the URL is constructed on different clicks your best bet will be to contruct the URL in PBI before hitting it.

[se2]

If I know how a url is contracted, how can I use PBI to go there?

Thanks,

Steve

[Anonymous]

Hi @se2 

Use buttons for each year and in actions use type as "Web URL" and give specific URL for that button.