Web.BrowserContents - how to force web page to load all pictures

[pirdim]

Hello everyone,

I am trying to take info about products from web page using so-called "web by example connector". So I use Web.BrowserContents method. Eventually I am able to get what I need except the url of a product image. When I insepct html code while I check page in Chrome I see that I need class "product-media _img _imgImpressions _imageLoaded", "src" field contains required url. But in html code loaded by this method in PowerBI for most products I have shorter class "product-media _img _imgImpressions" without "_imageLoaded". Only 2 first products have "_imageLoaded". So only for 2 first products I have url of their picture and for all others I have some template url, same for all. 

I've tried to use WaitFor field of Web.BrowserContents method. It gives an opportunity to check whether some CSS Selector exists on page. But the problem that selector "img._imageLoaded" does exist on page but only for 2 products, not all of them. So this field didn't help. I am not super experienced in Power BI and know nothing about html. Maybe you can suggest some idea how to avoid this trouble?

I have a workaround to go to each product page and take image url from there. But it works super slowly. I need to take data from 1 page with all products on it.

[v-chuncz-msft]

@pirdim,

You could also create a support ticket for assistance.

[pirdim]

 @v-chuncz-msft,

I am not a pro user. I make it more out of curiousity to see what I can do with this instrument in a future.

[Ehren]

Hi @pirdim. The issue is that the images are loaded lazily based on the user scrolling, and if no scrolling occurs, the images are never loaded. There's currently no way to trigger PQ's internally hosted web browser to scroll, click, or perform other actions (for security reasons). So I don't think you'll be able to get this scenario to work.

Ehren

[pirdim]

@Ehren,

thanks for your reply.