Iterate Over Web Pages using Web Connector

[vyacheslavg]

Hello Community, 

Could you please advise how to work with web connector. 

I want to collect information from several pages and get a single table (if possible).

The typical URL is:

https://test.com.aspx?component=1

On this page there are several tables, and Power BI web connector is perfectly able to parse these html tables.

Also I have a list of components ids table I want to scrap/download tables.

For example:

component

1

5

7

42

For component id = 42, the URL would be https://test.com.aspx?component=42

I want Power BI to take Ids from this list and download tables for these ids.

Would be perfect if tables will be concatenated.

Any ideas or suggestions would be appreciated. 

My thinking is I need some advanced Power Query/M and Parameters?

[v-yulgu-msft · Accepted solution]

Hi @vyacheslavg,

Per my research, you could refer to below blogs 

Loop through Multiple Web Pages using Power Query

Iterating over multiple pages of web data using Power Query

Regards,

Yuliana Gu

[vyacheslavg]

This is exactly what I was looking for.

He even shows couple of methods - thru functions-iterators and thru generated table - iterators.

In my case I already have a table thru which I want to iterate, which makes the exercise easier.

Thanks a lot!