How to organize tables on a lakehouse

[alfBI]

We are trying to implement a Medallion architecture, but on the bronze layer lakehouse does not support custom schema names for the tables. Then, how to handle hundreds of stage tables from differents areas if there is no way to organize them? Any suggestions/idea?

thx

Alfons

[SorenSparso · Accepted solution]

Hi,

Schema support in Lakehouses is scheduled for Q2 2024:

https://learn.microsoft.com/en-us/fabric/release-plan/data-engineering#schema-support

[govindarajan_d]

Hi @alfBI,

Yes. Since custom schemas are not available in Lakehouse for tables, its a pain. 

I suggest you can use the following for bronze - b_sourcesystem_table_name. This will help to distinguish the bronze tables when they are added as shortcuts. I process bronze data using Spark and I add bronze tables as shortcuts in silver lakehouse for use within notebook. 

[AndyDDC]

In a current solution I'm working on, we have  prefixed the table name with the data source name.  Eg datasourceone_stgTableOne