getting Data from a price comparison webpage

[HenningW]

Hi everybody,

I would like to pull monthly data for a specific brand from the price comparison webpage Idealo for the German market.

Here for example for Nike Nike Schnäppchen bei idealo entdecken | Neuheiten & Klassiker

A second source could be google shopping, but this might be different sellers, because they have to pay both providers to get listed.

I don't see any product speficic numbers like an EAN code, so I would probably have to compare each name with the product names from my inventory list to be able to compare prices.

Any ideas to get the data, or is there another webpage were I can aquire this data specifically for the German market more easily?

Thanks in advance for your ideas. 🙂

[HenningW]

Hi @selimovd , any ideas? 🙂

[selimovd · Accepted solution]

Hey @HenningW ,

to be honest not really.

You can try if it works will a normal Web call in PowerBI, but most sites don't allow that. Then you could check if there is an API that you could use. If that's not the case you have to write a web scraper and save the data somewhere.

If you need any help please let me know.

If I answered your question I would be happy if you could mark my post as a solution ✔️ and give it a thumbs up 👍

Best regards

Denis

Blog: WhatTheFact.bi

Follow me: twitter.com/DenSelimovic

[HenningW]

Alright, thanks. I don't think there is an API. They probably don't want to give people access to these information. 

[HenningW]

I would like to compare the current best price for each product with my price and the recommended retail price.

[selimovd]

Hey @HenningW ,

that depends on what you want to do. What data do you need?

Only the EANs? All products of a brand? The best price per product?

Best regards

Denis