Forum Discussion

HenningW's avatar
HenningW
New Member
4 years ago
Solved

getting Data from a price comparison webpage

Hi everybody,

 

I would like to pull monthly data for a specific brand from the price comparison webpage Idealo for the German market.

Here for example for Nike Nike Schnäppchen bei idealo entdecken | Neuheiten & Klassiker

A second source could be google shopping, but this might be different sellers, because they have to pay both providers to get listed.

 

I don't see any product speficic numbers like an EAN code, so I would probably have to compare each name with the product names from my inventory list to be able to compare prices.

 

Any ideas to get the data, or is there another webpage were I can aquire this data specifically for the German market more easily?

 

Thanks in advance for your ideas. 🙂

Need Help
  • selimovd's avatar
    selimovd
    4 years ago

    Hey HenningW ,

     

    to be honest not really.

    You can try if it works will a normal Web call in PowerBI, but most sites don't allow that. Then you could check if there is an API that you could use. If that's not the case you have to write a web scraper and save the data somewhere.

     

    If you need any help please let me know.
    If I answered your question I would be happy if you could mark my post as a solution ✔️ and give it a thumbs up 👍
     
    Best regards
    Denis
     

5 Replies

  • selimovd's avatar
    selimovd
    Icon for Most Valuable Professional rankMost Valuable Professional
    4 years ago

    Hey HenningW ,

     

    that depends on what you want to do. What data do you need?

    Only the EANs? All products of a brand? The best price per product?

     

    Best regards

    Denis

  • HenningW's avatar
    HenningW
    New Member
    4 years ago

    I would like to compare the current best price for each product with my price and the recommended retail price.

    • selimovd's avatar
      selimovd
      Icon for Most Valuable Professional rankMost Valuable Professional
      4 years ago

      Hey HenningW ,

       

      to be honest not really.

      You can try if it works will a normal Web call in PowerBI, but most sites don't allow that. Then you could check if there is an API that you could use. If that's not the case you have to write a web scraper and save the data somewhere.

       

      If you need any help please let me know.
      If I answered your question I would be happy if you could mark my post as a solution ✔️ and give it a thumbs up 👍
       
      Best regards
      Denis
       
      • HenningW's avatar
        HenningW
        New Member
        4 years ago

        Alright, thanks. I don't think there is an API. They probably don't want to give people access to these information.