Forum Discussion

stellahe102's avatar
stellahe102
Helper I
1 year ago
Solved

Question About Table History Discrepancy in Lakehouse

Hi, In our lakehouse environment, we have about 20 tables. I’ve noticed that only 2 of these tables retain just the past 30 days of parquet files, while the rest maintain a full history (beyond 30 d...
lakehouse
  • v-ssriganesh's avatar
    v-ssriganesh
    1 year ago

    Hi stellahe102,
    Thank you for reaching out to the Microsoft Fabric Forum Community.

    The discrepancy where two shortcut tables retain only 30 days of parquet files is likely due to VACUUM operations or predictive optimization on the source tables in the other workspace, limiting their history. Since shortcuts reference source data, maintenance like VACUUM with a 30-day retention (e.g., delta.deletedFileRetentionDuration = interval 30 days) affects their history.

    Steps to Investigate:

    • Check source table properties: SHOW TBLPROPERTIES source_table_name for delta.deletedFileRetentionDuration.
    • Review source workspace for VACUUM jobs.
    • Coordinate with the source workspace owner to align retention policies.

    Please refer below official documentation:


    If this information is helpful, please “Accept as solution” and give a "kudos" to assist other community members in resolving similar issues more efficiently.
    Thank you.

v-ssriganesh's avatar
v-ssriganesh
Community Support
1 year ago

Hi stellahe102,

May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.

Thank you.