Forum Discussion
Question About Table History Discrepancy in Lakehouse
- 1 year ago
Hi stellahe102,
Thank you for reaching out to the Microsoft Fabric Forum Community.The discrepancy where two shortcut tables retain only 30 days of parquet files is likely due to VACUUM operations or predictive optimization on the source tables in the other workspace, limiting their history. Since shortcuts reference source data, maintenance like VACUUM with a 30-day retention (e.g., delta.deletedFileRetentionDuration = interval 30 days) affects their history.
Steps to Investigate:
- Check source table properties: SHOW TBLPROPERTIES source_table_name for delta.deletedFileRetentionDuration.
- Review source workspace for VACUUM jobs.
- Coordinate with the source workspace owner to align retention policies.
Please refer below official documentation:
If this information is helpful, please “Accept as solution” and give a "kudos" to assist other community members in resolving similar issues more efficiently.
Thank you.
Hi stellahe102,
Thank you for reaching out to the Microsoft Fabric Forum Community.
The discrepancy where two shortcut tables retain only 30 days of parquet files is likely due to VACUUM operations or predictive optimization on the source tables in the other workspace, limiting their history. Since shortcuts reference source data, maintenance like VACUUM with a 30-day retention (e.g., delta.deletedFileRetentionDuration = interval 30 days) affects their history.
Steps to Investigate:
- Check source table properties: SHOW TBLPROPERTIES source_table_name for delta.deletedFileRetentionDuration.
- Review source workspace for VACUUM jobs.
- Coordinate with the source workspace owner to align retention policies.
Please refer below official documentation:
If this information is helpful, please “Accept as solution” and give a "kudos" to assist other community members in resolving similar issues more efficiently.
Thank you.
- v-ssriganesh1 year agoCommunity Support
Hi stellahe102,
I hope this information is helpful. Please let me know if you have any further questions or if you'd like to discuss this further. If this answers your question, please accept it as a solution and give it a 'Kudos' so other community members with similar problems can find a solution faster.
Thank you.