Dynamic web content scraping where URL doesn't change

[Anonymous]

Hello,

I can find lots of cases where you can get the data from web pages dynamically as the parameters change in the URL, however I was interested in such a scenario where the web content is changed say by picking an item from the drop down list, and this change doesn't get reflected in the URL. The example is below. I was wondering and hoping that you could help. Thanks in advance - Di

E.g.  the UR is https://azure.microsoft.com/en-us/pricing/details/virtual-machines/linux/

In the web page when I iterate through the OS options the URL gets updated accordingly and therefore it's easy to get the pricing tables, but when I go through the Region drop down the URL doesn't get changed, but the pricing in the tables does. So my question is how can you loop through the regions' list and get the updated pricing tables?

[v-piga-msft]

Hi @Anonymous ,

By my tests and research, I'm afraid that we cannot get the data from web pages when the change doesn't get reflected in the URL in Power BI currently. We only could get data based on the URL.

Actually, when you get data from the web url, you get all of the data. I think you could create the Region slicer to filter the price when you create the report in power bi.

Best  Regards,

Cherry

[Anonymous]

Thanks @v-piga-msft ,

I pulled the regions into a slicer but by switching between the regions the pricing in the query table doesn't get updated dynamically. I guess because the region list is actually not a table in the webpage? Could you give more hints on how I can get the pricing updated after picking different regions?

[v-piga-msft]

Hi @Anonymous ,

Yes, you're right. The region list is actually not a table in the webpage, so we cannot extract the data via web connector in power bi currenly.

Sorry, I cannot help further on this case. Hope others have better ideas.

Best  Regards,

Cherry