Forum Discussion

amaaiia's avatar
amaaiia
Icon for Skilled Sharer rankSkilled Sharer
2 years ago

Delta table CHECKPOINts and log retention

From what I have read, how is it possible to get VERSION 1 for a table where first checkpoint is done after this version timestamp?

 

This is the HISTORY of my table. As you can see, version 1 is from 2024-03-09:

Then, I check parquet files and I see there's a checkpoint on 2024-03-14:

As a I've understood, even if the log files still exist, as there's a checkpoint, the previous logs shouldn't be available. So, why can I get VERSION 1 of table data if the first checkpoint points to VERSION 10?

 

I have a CHECKPOINT each 7 days, that is, I have more than one CHECKPOINT until today and I'm able to get all versions until today. How do CHECKPOINTs work?

 

data engineering

4 Replies

    • v-cboorla-msft's avatar
      v-cboorla-msft
      Icon for Microsoft Employee rankMicrosoft Employee
      2 years ago

      Hi amaaiia 

       

      We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet.
      In case if you have any resolution please do share that same with the community as it can be helpful to others.
      Otherwise, will respond back with the more details and we will try to help.


      Thanks.

      • v-cboorla-msft's avatar
        v-cboorla-msft
        Icon for Microsoft Employee rankMicrosoft Employee
        2 years ago

        Hi amaaiia 

         

        We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others .
        If you have any question relating to the current thread, please do let us know and we will try out best to help you.
        In case if you have any other question on a different issue, we request you to open a new thread.

         

        Thanks.