Forum Discussion

reddyr2502's avatar
reddyr2502
New Member
1 day ago

Folders Structures in workspace

Hi,

I am the only person managing data analytics at a startup. We currently use a single Microsoft Fabric workspace for our Bronze, Silver, and Gold data layers.

What is the best way to organize and clearly distinguish pipelines, notebooks, dataflows, and other artifacts for each layer?

I am considering creating separate top-level folders for Bronze, Silver, and Gold. Could you recommend a practical folder and subfolder structure for each layer that is simple to manage now and scalable for future growth?

 

3 Replies

  • Hi reddyr2502​ ,

    what you're showing would be one approach.
    It always depends on what your governance/security strategy is.
    Another option would be to organize this into separate workspaces to further differentiate between them.

    As I said, it always depends on what your governance/security strategy looks like.
    I often use exactly what you're showing right now; at the very least, it's sufficient.

    Here is a documentation about Workspaces.

    https://learn.microsoft.com/en-us/fabric/fundamentals/workspaces

    https://learn.microsoft.com/en-us/fabric/fundamentals/workspaces-folders

    I hope that helps.

    Many greetz
    spaceman127

    Feel free to leave kudos or accept it as a solution. This will also help other community members.

  • Please recommend the folder and subfolder structures to differentiate between all layers.

  • Hi reddyr2502​,
    It really depends on how you work and how you've structured your environment.

    I've seen one folder per source system before, and then inside that are subfolders for bronze, silver, and gold components. 

    I've also seen the root folders be bronze, silver, and gold, and then in each of those are subfolders for each system. 

    My environment is metadata driven for bronze and silver layers, so there's nothing system specific at that level, I have a folder for some shared functions that I've abstracted away from the main notebooks so they can be reused across layers, and then I have a single notebook for bronze and a single notebook for silver that will read from the metadata tables and load what needs to be loaded. 

    Then at my gold layer I have a top level folder for gold, and inside I have a folder for each resulting data product.