Forum Discussion
setup of medallion architecture
Hi shivam_agarwal ,
There are multiple ways you can setup Medallion architecture:
Using Lakehouses/Warehouses and each zone (bronze, silver and gold) in separate workspace. This is advantageous as you can separate the access based on workspace. But I found it to be effective only if I use entirely Lakehouse or Warehouse. If you need Spark, then you can go entirely with Lakehouse or else just Warehouse if you plan to use plain T-SQL. This boils down to the skillset of the team.
The other approach would be having all three layers in same workspace or just silver and gold in same workspace so that you can mix Lakehouse/Warehouse very easily as both silver and gold are in the same workspace.
For a more step-by-step process, follow this exercise:
mslearn-fabric (microsoftlearning.github.io)
I have a part 1 in a small series where I'm looking at medallion architecture and what data loading options there are
Super UserHi shivam_agarwal ,
There are multiple ways you can setup Medallion architecture:
Using Lakehouses/Warehouses and each zone (bronze, silver and gold) in separate workspace. This is advantageous as you can separate the access based on workspace. But I found it to be effective only if I use entirely Lakehouse or Warehouse. If you need Spark, then you can go entirely with Lakehouse or else just Warehouse if you plan to use plain T-SQL. This boils down to the skillset of the team.
The other approach would be having all three layers in same workspace or just silver and gold in same workspace so that you can mix Lakehouse/Warehouse very easily as both silver and gold are in the same workspace.
For a more step-by-step process, follow this exercise:
mslearn-fabric (microsoftlearning.github.io)