Forum Discussion

stellahe102's avatar
stellahe102
Icon for Helper II rankHelper II
1 year ago
Solved

Question About Table History Discrepancy in Lakehouse

Hi, In our lakehouse environment, we have about 20 tables. I’ve noticed that only 2 of these tables retain just the past 30 days of parquet files, while the rest maintain a full history (beyond 30 d...
lakehouse
  • v-ssriganesh's avatar
    v-ssriganesh
    1 year ago

    Hi stellahe102,
    Thank you for reaching out to the Microsoft Fabric Forum Community.

    The discrepancy where two shortcut tables retain only 30 days of parquet files is likely due to VACUUM operations or predictive optimization on the source tables in the other workspace, limiting their history. Since shortcuts reference source data, maintenance like VACUUM with a 30-day retention (e.g., delta.deletedFileRetentionDuration = interval 30 days) affects their history.

    Steps to Investigate:

    • Check source table properties: SHOW TBLPROPERTIES source_table_name for delta.deletedFileRetentionDuration.
    • Review source workspace for VACUUM jobs.
    • Coordinate with the source workspace owner to align retention policies.

    Please refer below official documentation:


    If this information is helpful, please “Accept as solution” and give a "kudos" to assist other community members in resolving similar issues more efficiently.
    Thank you.

v-ssriganesh's avatar
v-ssriganesh
Icon for Community Support rankCommunity Support
1 year ago

Hi stellahe102,
I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions. If my response has addressed your query, please accept it as a solution and give a 'Kudos' so other members can easily find it.
Thank you.