Forum Discussion

6 Replies

    • rubayatyasmin's avatar
      rubayatyasmin
      Community Champion

      sure. I did try this one with a sample example. looks like it is rewriting the row as the append table is updating, not adding new rows. But then I thought that it is supposed to work like that. 

       

      So, you need to use a DB actually to store data on a daily basis. use SSIS or may be can use Azure logic app to push the data. It is suggested that you use DB for long term data storage. 

       

       

       

  • Hi fabiopaturzo ,

     

    Power Query is not a data warehouse and is not designed to retain data beyond its immediate use.

    The PQ refresh process works like this:

    Wipe all data > Import available data from source > Perform transformations > Push to Data Model.

    As such, there's no function to create and retain history/archives of changing source data.

     

    The closest native function (within the Power BI universe) would be Incremental Refresh, which comes with its own significant caveats:

    https://learn.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-overview 

     

    Beyond this, you will need to arrange some kind of data warehousing or storage capability at your end to keep the history that you can then query with PQ.

     

    Pete