Forum Discussion

vanessafvg's avatar
vanessafvg
Icon for Community Champion rankCommunity Champion
9 years ago

web scraping and keeping historical data

I need to scrape data from a webpage but then i also need to keep historical data, it gets overwritten on the website.    Has anyone been able to figure out how to do this?  

 

ie

 

1) pull data from a web page

2) store and not overwrite when new data comes in?

Need Help

3 Replies

  • vanessafvg's avatar
    vanessafvg
    Icon for Community Champion rankCommunity Champion
    9 years ago

    bumping this to see if anyone has any thoughts on this?

    • Anonymous's avatar
      Anonymous
      Not applicable
      9 years ago

      Do you mean scraping with the "Get data" in Power BI?

  • v-yulgu-msft's avatar
    v-yulgu-msft
    Icon for Microsoft Employee rankMicrosoft Employee
    9 years ago

    Hi vanessafvg,

     

    Please check the workarounds mentioned in this thread, as currently, there is no direct way to keep historical data when refreshing data.

     

    Someone has submitted this idea to Microsoft, you could click to vote it up. And this topic is under review, it might be added to future release. 

     

    Best regards,
    Yuliana Gu