how to bypass popup in power bi web source

[StanS]

Hi everyone,

I need to get data from a web site. But before you get to a page with data you have a popup window there.
When you enter the page it asks you to confirm you are older than 19 (need to click a checkbox and click a button).
Is there a way to make Power Bi do that?

Thank you!

[Anonymous]

Hello @StanS ,

What website is it that you are trying to "Scrape" the data from? In my experience to extract the data from sites like that the popup doesn't do much besides hiding the rest of the page. The HTML code is still visible.

Kind regards
Joren Venema

Data & Analytics Consultant
If this reply solved your question be sure to mark this post as the solution to help others find the answer more easily. 

[StanS]

Hello @Anonymous Jore. The website is https://www.cannabis-nb.com/search/

Thank you

[parry2k · Accepted solution]

@StanS start blank query in Advanced editor and paste following scripts, it is showing table1

let
    Source = Web.BrowserContents("https://www.cannabis-nb.com/search/"),
    #"Extracted Table From Html" = Html.Table(Source, {{"Column1", ".cnb-product-name"}, {"Column2", ".productTile"}, {"Column3", ".cnb-product-price + *"}, {"Column4", ".cnb-product-format"}, {"Column5", ".cnb-product-price"}, {"Column6", "SPAN:nth-child(1) *"}, {"Column7", ".col-sm-6:nth-child(2) .cnb-product-occasion:nth-child(1)"}, {"Column8", ".col-sm-6:nth-child(2) .cnb-product-info:nth-child(6)"}, {"Column9", ".col-sm-6:nth-child(2) .cnb-product-info:nth-child(7)"}, {"Column10", ".col-xs-12:nth-child(3) .cnb-product-occasion:nth-child(1)"}, {"Column11", ".col-xs-12:nth-child(3) .cnb-product-info:nth-child(6)"}, {"Column12", ".col-xs-12:nth-child(3) .cnb-product-info:nth-child(7)"}, {"Column13", ".col-xs-12:nth-child(4) .cnb-product-occasion:nth-child(1)"}, {"Column14", ".col-xs-12:nth-child(4) .cnb-product-info:nth-child(6)"}, {"Column15", ".col-xs-12:nth-child(4) .cnb-product-info:nth-child(7)"}, {"Column16", ".product-tile-promotion-label"}}, [RowSelector=".cnb-product"]),
    #"Changed Type" = Table.TransformColumnTypes(#"Extracted Table From Html",{{"Column1", type text}, {"Column2", Int64.Type}, {"Column3", type text}, {"Column4", type text}, {"Column5", type text}, {"Column6", type text}, {"Column7", type text}, {"Column8", type text}, {"Column9", type text}, {"Column10", type text}, {"Column11", type text}, {"Column12", type text}, {"Column13", type text}, {"Column14", type text}, {"Column15", type text}, {"Column16", type text}})
in
    #"Changed Type"

[StanS]

Thank you @parry2k  I wonder how did you do that. It didn't show me any tables when I tried to add that web page source

[Anonymous]

Hello @StanS ,

When connecting to the source via the Web connector it shows me 4 tables aswell:

This should pop up for you aswell?

What are you trying to obtain from the website?

The front page only shows the first 20 results.

If there is anything else you need help with don't hesitate to ask.

Kind regards
Joren Venema

Data & Analytics Consultant

[parry2k]

@StanS there are four tables, whch table you want

[parry2k]

@StanS I'm not aware if there is anything in Power BI that automate clicking of check box.