Forum Discussion

User2804's avatar
User2804
New Member
1 year ago

historical data for dynamic table

I have a dynamic database, and I want to keep a history of the data while adding only the new data with each weekly or monthly update. I would like to achieve this in Power Query. Is it possible? Incremental refresh is not an option, and I don't want to export data to SharePoint files using Power Automate.

5 Replies

  • User2804 

     

    No not possible.  PQ isn't able to store data, it loads data from the datasource every time the query is refreshed.

     

    Phil

    • PhilipTreacy's avatar
      PhilipTreacy
      Super User

      User2804 

       

      Dump data out of the database before it is replaced?

       

      Or just leave the data in the database?  Don't delete anything.

       

      Regards

       

      Phil

       

  • It is not easily possible in power query. 

    if you use Power Bi, maybe you can add a step by using Python script to export the result into CSV and then use that inside the code also, 

    if you use Excel, it become a little bit more challenging 

    • User2804's avatar
      User2804
      New Member

      Yes I'm using Power BI, is it possible to add a python code to extract the data in cvs file (millions of rows) ?