Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
5 years ago
Solved

Web Scraping a table, Identify Changes

Hello everyone!   Im scraping a web table to see when new products are released from a supplier.  As they dont have a "new product" list, Im using their "full Product List" table, and want to compa...
Need Help
  • edhans's avatar
    edhans
    5 years ago

    Power BI is not built to handle prior data and compare with new data. It is an all or nothing refresh.

     

    There are some hacks that can simulate partitioning off data in an ad-hoc incremental refresh, which you can read about here, but I'm not sure I'd put that in production. Also, everytime you republish your PBIX file, it wipes out the history unless you got really fancy and use the ALM Toolkit to preserve partions.

    It is a very cool hack. It is a bit too Rube Goldberg for me to rely on for production reporting.

edhans's avatar
edhans
Community Champion
5 years ago

Power BI is not built to handle prior data and compare with new data. It is an all or nothing refresh.

 

There are some hacks that can simulate partitioning off data in an ad-hoc incremental refresh, which you can read about here, but I'm not sure I'd put that in production. Also, everytime you republish your PBIX file, it wipes out the history unless you got really fancy and use the ALM Toolkit to preserve partions.

It is a very cool hack. It is a bit too Rube Goldberg for me to rely on for production reporting.

  • Anonymous's avatar
    Anonymous
    Not applicable
    5 years ago

    Thank you!!!  Sad to see, but it makes sense... thanks for the swift reply.