Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
pmscorca
Helper II
Helper II

OneLakes in a medallion architecture

Hi,

I've known that in Fabric it is possible to have only one OneLake for the entire organization, but should it possible to have an OneLake for each layer of the medallion architecture (bronze, silver and gold layers) or is it a senseless idea?

Thanks

1 ACCEPTED SOLUTION
v-cboorla-msft
Community Support
Community Support

Hi @pmscorca 

 

Thanks for using Microsoft Fabric Community.

 

Microsoft Fabric's medallion architecture leverages a single OneLake for all data tiers (bronze, silver, gold). This simplifies data management and avoids the overhead of maintaining separate OneLakes for each layer. OneLake is designed to be a single, unified, logical data lake for your entire organization. It offers functionalities like data categorization using domains and workspaces, which makes it suitable to handle data at various stages of refinement. The idea behind OneLake is to remove silos, reduce management effort, and minimize data movement and duplication.

 

Benefits of a Single OneLake:

  • Simplified Data Governance: A single lake simplifies governance and compliance efforts.
  • Centralized Management: Easier to manage and monitor the data lifecycle and access.
  • Cost Efficiency: Reduces the overhead associated with maintaining multiple storage solutions.

Why Multiple OneLakes Might Not Be Ideal:

  • Increased Complexity: Managing multiple OneLakes increases complexity in terms of data governance, access control, and integration.
  • Redundant Storage: Storing data in multiple lakes can lead to redundancy and higher storage costs.
  • Integration Overhead: Ensuring consistent data flow and synchronization across multiple lakes can be challenging.

Using a single OneLake and logically organizing it to reflect the medallion architecture is a sensible and efficient approach. It leverages the strengths of OneLake in terms of integration, governance, and management while still adhering to the principles of the medallion architecture. This method ensures streamlined operations and cost-effectiveness while maintaining clear separation and organization of data at different processing stages.

 

I hope this information helps. Please do let us know if you have any further queries.

 

Thank you.

View solution in original post

2 REPLIES 2
v-cboorla-msft
Community Support
Community Support

Hi @pmscorca 

 

Thanks for using Microsoft Fabric Community.

 

Microsoft Fabric's medallion architecture leverages a single OneLake for all data tiers (bronze, silver, gold). This simplifies data management and avoids the overhead of maintaining separate OneLakes for each layer. OneLake is designed to be a single, unified, logical data lake for your entire organization. It offers functionalities like data categorization using domains and workspaces, which makes it suitable to handle data at various stages of refinement. The idea behind OneLake is to remove silos, reduce management effort, and minimize data movement and duplication.

 

Benefits of a Single OneLake:

  • Simplified Data Governance: A single lake simplifies governance and compliance efforts.
  • Centralized Management: Easier to manage and monitor the data lifecycle and access.
  • Cost Efficiency: Reduces the overhead associated with maintaining multiple storage solutions.

Why Multiple OneLakes Might Not Be Ideal:

  • Increased Complexity: Managing multiple OneLakes increases complexity in terms of data governance, access control, and integration.
  • Redundant Storage: Storing data in multiple lakes can lead to redundancy and higher storage costs.
  • Integration Overhead: Ensuring consistent data flow and synchronization across multiple lakes can be challenging.

Using a single OneLake and logically organizing it to reflect the medallion architecture is a sensible and efficient approach. It leverages the strengths of OneLake in terms of integration, governance, and management while still adhering to the principles of the medallion architecture. This method ensures streamlined operations and cost-effectiveness while maintaining clear separation and organization of data at different processing stages.

 

I hope this information helps. Please do let us know if you have any further queries.

 

Thank you.

Hi @pmscorca 

 

Glad that you query got resolved.
Please continue using Fabric Community for further queries.

 

Thanks.

Helpful resources

Announcements
Europe Fabric Conference

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

PBI_Carousel_NL_June

Fabric Community Update - June 2024

Get the latest Fabric updates from Build 2024, key Skills Challenge voucher deadlines, top blogs, forum posts, and product ideas.

MayFBCUpdateCarousel

Fabric Monthly Update - May 2024

Check out the May 2024 Fabric update to learn about new features.

RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.