Connecting on Data Engineering: Lakehouses & Pipelines 🚀

Thanks for joining the data engineering community on microsoft fabric.

You are at the right place to share your ideas and help others on data engineerings' topics and have the chance to be visible with microsoft teams like MVP, super users etc...

Enjoy your learning on Fabric 🙂  

Hi Krishna_11 ,

I hope you are doing well today 🙂❤️

Great to see your focus on Data Engineering in Microsoft Fabric. I completely agree the integration between Data Factory pipelines and the Lakehouse layers makes managing Bronze, Silver, and Gold tables much smoother.

I’ve also been exploring OneLake, Spark notebooks, and ETL best practices, and it would be great to exchange ideas on pipeline orchestration, incremental loads, and optimizing Lakehouse performance.

Here are some official Microsoft Learn resources that might be helpful:

1) Lakehouse & OneLake

• Lakehouse overview – Understand the lakehouse architecture in Fabric

• OneLake documentation – Unified data lake fundamentals

• Medallion Lakehouse architecture – Bronze/Silver/Gold layers explained

• Create a Lakehouse on OneLake – Step-by-step guide

2) Data Factory & Pipelines

• Fabric Data Factory docs – Learn about pipelines, activities, and integrations

• End-to-end Data Factory tutorial – Practical pipeline examples

3) Spark & Notebooks

• Fabric notebooks guide – Basics of working with Spark notebooks

• Spark best practices – Optimizing Spark in Fabric

Looking forward to connecting and learning together! 🚀💻

______________________________________________________________________________________

If this answer helped, kindly give Kudos and mark it as the Accepted Solution

to help other members find it more quickly.

Best regards,

Vaibhav Mahajan

LinkedIn: https://www.linkedin.com/in/vaibhavnmahajan

______________________________________________________________________________________

Hi Krishna_11 

Great to know you've started your journey on Microsoft Fabric. The Microsoft Learn pages are a fantastic place to start. Personally it was more than enough to complete my certification on Fabric! 

Data Engineering in Microsoft Fabric documentation - Microsoft Fabric | Microsoft Learn

There are also GitHub pages with snippets of code if you're interested to learn further. 

fabric-docs/docs/data-engineering/data-engineering-overview.md at main · MicrosoftDocs/fabric-docs · GitHub

If this helps kindly give a Thumbs Up or Accept as a Solution.  

Hi Krishna_11 ,

If you get a chance, please review the responses shared by vaibhavmahajan deborshi_nag and AntoineW  . They have correctly pointed out the key points, so kindly check and let us know if you need any additional details.Thank you all for your valuable support.

Regards,
Yugandhar

Hi Krishna_11 ,

May I know if your issue has been resolved, or if you need any additional information? Please let us know if you need any further assistance.

Thank you