Data Engineering Community Blog

Choosing between Kimball and Data Vault is often framed as a contest between two modelling styles. But they solve different problems. The more useful question is: what does your data platform need to...

When organizations discuss enterprise AI, the conversation almost always begins with foundation models, prompts, and agents. Yet in practice, every production enterprise AI initiative succeeds or fai...

Have you ever seen a situation when in an ETL pipeline engineers create a not strictly necessary dataset only because they can use a tool such as a Spark or SQL notebook to process data in that datas...

Last year around April, there was a production issue in our data engineering system and we had to roll back a recently merged pull request. This pull request had minor code changes and was reviewed a...

As Microsoft Fabric becomes central to business reporting and data engineering, inefficient workloads can affect more than execution time. They can consume shared capacity, compete with critical proc...

In this video, I walk through how to architect and implement a Cross-Tenant Delegated OneLake Shortcut in Microsoft Fabric. Discover how organisations can securely access and consume data stored in a...

Reassigning a Workspace in the Microsoft Fabric Admin Portal When working with Microsoft Fabric, workspaces are an important part of organising and managing analytics content. A workspace can contai...

When working with Microsoft Fabric Notebooks, it is common to work with data that lives in more than one Lakehouse. Instead of creating a separate Notebook for every Lakehouse, Microsoft Fabric allow...