Fabric Monday 121: Human in The Loop
🚨 A Business Event can start a Fabric pipeline automatically. But should every event be allowed to complete the process without a human decision? Business Events turn important data conditions into governed, reusable signals. The new Approval activity puts a human decision directly inside a Fabric Data Factory pipeline. Combine them, and you get an event-driven workflow that stays automatic until judgment is actually required. 📡 FROM DATA TO A BUSINESS EVENT In this video, a Fabric notebook checks incoming sales records for orders with a quantity greater than 15. When it finds one, it publishes a `HighQuantityOrderDetected` Business Event containing the invoice, item, quantity, and total value. The event uses a registered schema, so publishers and consumers exchange the same business context in a predictable format. ⚡ FROM BUSINESS EVENT TO PIPELINE Activator monitors the Business Event in Real-Time Hub. For each matching event, Activator starts a Fabric pipeline and passes the event fields into pipeline parameters. The pipeline can then enrich the request with additional data before asking for approval. 👤 HUMAN IN THE LOOP The Approval activity pauses the pipeline and sends the request to a designated reviewer through Outlook or Microsoft Teams. The reviewer sees the business context, opens the Review experience in Monitoring Hub, and chooses whether to approve or reject the request. 👉 Approved — the pipeline continues through the success path 👉 Rejected — the pipeline continues through the failure path 👉 Timeout — the activity fails and follows the rejection path After the decision, the pipeline resumes automatically. 💾 KEEPING THE DECISION Both branches call a notebook that records the result in the Lakehouse. The saved record includes the event values, approval result, pipeline run ID, and decision timestamp. The original signal, the human decision, and the downstream action remain connected and traceable. 🎯 WHY THIS COMBINATION MATTERS Business Events remove the need for every producer and consumer to build a private integration contract. The Approval activity adds a controlled decision point without moving the process outside Fabric. Together they enable workflows that are: 👉 Event-driven — the process starts when a meaningful business condition occurs 👉 Context-aware — the event payload travels into the approval request 👉 Governed — only the step that needs judgment is paused 👉 Auditable — the pipeline records who decided, the outcome, and what happened nextreti This is where real-time detection becomes an operational business process: automatic detection, human judgment, and an automated response in one Fabric workflow. ⚠️ The Business Events alert integration and the Approval activity shown in this video are currently in Preview.Fabric Monday 117: SCD Type 2 Uing Copy Job
🔄 SCD Type 2 has been one of the most needed — and most painful — patterns in data warehousing for decades. Every time a dimension record changes, you need to preserve the old version and insert a new one. Valid_From, Valid_To, Is_Current. Simple concept. Traditionally brutal to implement. Copy Job in Microsoft Fabric now does this with a single toggle. 📋 WHAT COPY JOB DOES FOR YOU When a record changes in the source: 👉 The existing current row gets Valid_To set + Is_Current = false 👉 A new row is inserted with the updated values, Valid_From, and Is_Current = true When a record is deleted at the source: 👉 Soft delete — the destination row is closed (Valid_To + Is_Current = false). History is never lost. No MERGE logic. No custom code per table. No framework to maintain. ⚙️ ONE STEP 1. Create a Copy Job 2. Select a CDC-enabled source 3. Select a supported destination 4. Set the write method to SCD Type 2 That's it. 🔗 LINKED TO INCREMENTAL LOAD SCD Type 2 in Copy Job is built on top of Change Data Capture (CDC). The incremental load detects what changed — Copy Job applies the SCD2 history pattern automatically. watch?v=tAktgDFTYHwMicrosoft Fabric Copy Job Tutorial for Beginners
In this beginner-friendly tutorial, I explain how to create and configure a Copy Job in Microsoft Fabric step by step — from source connection to destination loading. This session is perfect for: ✔️ Beginners in Microsoft Fabric ✔️ Aspiring Data Engineers ✔️ ETL / Data Integration learners ✔️ Power BI & Azure professionals moving to Fabric By the end of this video, you will confidently create your own Copy Job in Fabric. #MicrosoftFabric #FabricCopyJob #MicrosoftFabricTutorial #DataEngineering #FabricForBeginners #DataIngestion #CopyActivity #AzureData #FabricLakehouse #ETL #NDAC #NextGenData #DataPipeline #CloudData #LearnFabric Follow our WhatsApp channel : https://whatsapp.com/channel/0029VbB2EH33AzNVJEyA6L0r Visit us at : https://ndac.community/ Join us at Meetup: https://www.meetup.com/nextgen-data-aspirants-community/ watch?v=mmZSvks32bgFabric Monday 100: Dataflows Destinations and Schema
If you’re working with Microsoft Fabric Dataflows Gen2, Default Data Destinations can be a huge productivity boost… if you know how to use them properly. In this video, I show: ⏱️ How the Default Data Destination saves serious time by removing the need to configure a destination query by query 🧠 Why this is especially powerful when you’re building dataflows with many entities 🧩 How schema selection actually works (yes, it is supported — but only if Fabric is set up the right way) 👀 The small, easy-to-miss details that decide whether schemas are available or silently ignored If you’ve ever: 🚫 clicked through destinations for every single query 😤 wondered why schemas sometimes don’t appear ⚙️ wanted faster, cleaner Dataflows without hidden pitfalls …this video will save you time and frustration. watch?v=5KB8sjqXnDs
Introduction To Microsft Fabric Lakehouse
This is a level 100 tutorials. It provides overview of Microsoft Fabric LAKEHOUSE 1. Concept, definition and principle of Lakehouse 2. LAkehouse Key Feature 3. Lakehouse Core functioanlity 4. How to create Fabric Lakehouse 5. Demo to navigate into the Lakehouse watch?v=57gVydAQhUI
Microsoft Fabric Community Conference 2025
Hear from Arun Ulag, CVP of Azure Data on his favorite part of FabCon Europe, what's new at the second FabCon in Las Vegas, and how we're making sure it's bigger and better than ever before across a variety of topics! Join us March 31-April 2 in Las Vegas to kick off our second year of the Microsoft Fabric Community Conference. Register Now at https://fabricconf.com/. Follow us on X - https://x.com/mspowerbi More questions? Try asking the Power BI forums @ https://community.fabric.microsoft.com/t5/Power-BI-forums/ct-p/powerbi #Microsoft #PowerBI #FabCon watch?v=IqvDWEhozEIUsing Notebooks and Loading Tables from Lakehouse - Learn Fabric - Episode 16
Starting to work with Noteboooks in fabric Full Learn Fabric Series Found here: https://www.youtube.com/playlist?list=PLn1m_aBmgsbH5M_v7aZB_4GT9hecrDrEH Fun Fabricators Website https://www.fabricators.tips/ watch?v=8Xu1M-ORbK8
