warehouse
7 TopicsAn Overview of Lakehouses and Data Warehouses
Unlocking the Future of Data: Lakehouses vs. Data Warehouses In today’s data-driven world, choosing the right architecture is crucial for turning information into insight. Are traditional data warehouses still the gold standard, or are modern lakehouses rewriting the rules? Dive into our latest article as we explore how these two powerful approaches stack up — and discover which one could transform your data strategy.20KViews22likes6CommentsMicrosoft Fabric Data Warehouse
Microsoft Fabric Data Warehouse (Azure Synapse) Microsoft Fabric introduces a new era in data management, and at its core lies a transformative capability—the Data Warehouse, also known as Azure Synapse within Fabric. While it builds on familiar concepts from traditional BI systems, Fabric’s Data Warehouse breaks new ground by offering a truly open, scalable, and fully integrated analytical environment. This article offers a high-level overview of Microsoft Fabric Data Warehouse, providing foundational insights for professionals ready to embrace modern data architecture.19KViews15likes2Comments# Top 10 Anti-Patterns in Fabric Warehouse Production Code Part -2
You fixed the loops, batched the loads, and listed your columns explicitly. Good. But your Fabric Warehouse still has hidden cost leaks. In Part 2, we tackle the six anti-patterns that don't show up until your tables are large and your team is shipping fast: scalar UDFs that silently dodge Fabric's inlining engine, MERGE statements that join on the wrong column (and why case-sensitivity makes it worse), small-file fragmentation from over-partitioned lakehouse shortcuts — and the OPTIMIZE + VACUUM + V-Order trio that fixes it — plus three CI/CD habits (missing column lists, hardcoded workspace GUIDs, and DROP-recreate cycles) that quietly erase your statistics, your permissions, and your Monday morning peace of mind. Ten anti-patterns. Two posts. One rule: Fabric Warehouse is not SQL Server.2.4KViews6likes0Comments# Top 10 Anti-Patterns in Fabric Warehouse Production Code
With Microsoft Fabric Warehouse , many teams carried over habits from dedicated SQL pools, Synapse serverless, or on-premises SQL Server. Most of those habits still work — but a handful of them quietly erode performance on Fabric's Delta Parquet + MPP engine, and they only reveal themselves once your tables cross a few hundred million rows or your capacity starts throttling. What looks like a "Fabric is slow" problem is, more often than not, a code problem inherited from an older architecture. Over the last several months I've reviewed a number of production Fabric Warehouses across industries, and the same anti-patterns keep showing up. In this first post of a two-part series, I'll walk through the four that cost teams the most Capacity Units and the most debugging time, show the fix for each, and — most importantly — explain why the fix matters specifically in Fabric, not just as a generic SQL best practice. Part 2 will cover the remaining six.2.5KViews4likes0CommentsPartition & Column Pruning in Azure Fabric Warehouse
If you’re bringing Parquet data into Microsoft Fabric, you don’t have to sacrifice query performance. Fabric’s SQL engine (built on the same technology as Azure Synapse serverless SQL pools) automatically applies partition pruning and column pruning when querying Parquet files. These optimization features allow Fabric to skip over irrelevant partitions and unneeded columns – dramatically reducing the amount of data scanned and accelerating your queries. In this article, we’ll explore how partition and column pruning work in Fabric, with examples and best practices to help you make the most of these features for lightning-fast analytics on your data lake.18KViews3likes0CommentsSecuring Your Microsoft Fabric Data Warehouse: A Comprehensive Guide
Microsoft Fabric offers a robust security framework to safeguard sensitive data in today's data-driven landscape. This blog post explores key security considerations and best practices for securing your Fabric data warehouse. By understanding network security, identity and access management, data security, monitoring and logging, and implementing strong security measures, organizations can effectively mitigate risks and protect their valuable data assets.5.2KViews12likes0CommentsThe Importance of New Case-Insensitive Collation in Fabric Warehouse
The Fabric Warehouse service, launched in summer 2023, simplifies end-to-end data and analytics solutions. This T-SQL based platform provides SQL developers with a dedicated Data Warehousing environment featuring auto-scale and fault-tolerance capabilities. It uses the Parquet file format and Delta Lake, which offer new possibilities in Data Warehousing. This blog post will discuss the new case insensitive collation feature.7.4KViews14likes1Comment