Forum Discussion
priyanfabriccom
1 year agoFrequent Visitor
Relational database as a destination in Fabric
Hi Team, We are looking for a relational database, usually a Azure SQL database in Fabric to manage the ETL metadata, configuration with small size storage to store those kind of reference or met...
- 1 year ago
Why not just use a Warehouse table, Lakehouse table or even a csv or json in Lakehouse files?
- Anonymous1 year ago
Why can't you use a Delta Tables on the Lakehouse? They are ACID-compliant and relational. Just because they are capable of handling large datasets does not mean they are incapable of handling small datasets.
If you are just reading meta and configurations, you don't even need a relational database. You can just write that data to a file (XML, JSON, CSV, etc.) in a Lakehouse and read that file whenever you need it.
If it's smaller than 5mb, you could even store it in a variable in a data pipeline and retrieve it in real time when you need to refresh it.
frithjof_v
Community Champion
1 year agoWhy not just use a Warehouse table, Lakehouse table or even a csv or json in Lakehouse files?