Forum Discussion
Folders Structures in workspace
Hi,
I am the only person managing data analytics at a startup. We currently use a single Microsoft Fabric workspace for our Bronze, Silver, and Gold data layers.
What is the best way to organize and clearly distinguish pipelines, notebooks, dataflows, and other artifacts for each layer?
I am considering creating separate top-level folders for Bronze, Silver, and Gold. Could you recommend a practical folder and subfolder structure for each layer that is simple to manage now and scalable for future growth?
3 Replies
- spaceman127Super User
Hi reddyr2502 ,
what you're showing would be one approach.
It always depends on what your governance/security strategy is.
Another option would be to organize this into separate workspaces to further differentiate between them.As I said, it always depends on what your governance/security strategy looks like.
I often use exactly what you're showing right now; at the very least, it's sufficient.Here is a documentation about Workspaces.
https://learn.microsoft.com/en-us/fabric/fundamentals/workspaces
https://learn.microsoft.com/en-us/fabric/fundamentals/workspaces-folders
I hope that helps.
Many greetz
spaceman127Feel free to leave kudos or accept it as a solution. This will also help other community members.
- reddyr2502New Member
Please recommend the folder and subfolder structures to differentiate between all layers.
- tayloramySuper User
Hi reddyr2502,
It really depends on how you work and how you've structured your environment.I've seen one folder per source system before, and then inside that are subfolders for bronze, silver, and gold components.
I've also seen the root folders be bronze, silver, and gold, and then in each of those are subfolders for each system.
My environment is metadata driven for bronze and silver layers, so there's nothing system specific at that level, I have a folder for some shared functions that I've abstracted away from the main notebooks so they can be reused across layers, and then I have a single notebook for bronze and a single notebook for silver that will read from the metadata tables and load what needs to be loaded.
Then at my gold layer I have a top level folder for gold, and inside I have a folder for each resulting data product.