Forum Discussion
Storage increasing daily
- 3 months ago
You should use Python notebooks. It is so easy top use bronze --> silver --> gold layer. You should use OPTIMIZE commands for indexing and Vaccum commands as well. That way You can apply VACUUM and you can save money a lot.
Hi,
Thanks For the respnse,
So what is the solution for is there any way to reduce the small or can we delete this files just like vaccum
Hi shirishmathanka
As per my knowledge, Vacuum only removes obsolete/unreferenced files, it does not compact active files. Frequent MERGE/upserts create many small active files across Bronze, Silver, and Gold, which is why storage shows more than actual data.
To reduce storage and improve performance, run OPTIMIZE to compact small files, and consider batching updates or reducing write frequency.
I have included the official Microsoft documentation for your review.
Lakehouse and Delta Tables - Microsoft Fabric | Microsoft Learn
Remove unused data files with vacuum - Azure Databricks | Microsoft Learn
If there are any deviations from your expectation please let us know we are happy to address.
Thanks.
- v-priyankata2 months agoCommunity Support
Thank you for reaching out to the Microsoft Fabric Forum Community.
I hope the information provided was helpful. If you still have questions, please don't hesitate to reach out to the community.