Proactive Data Quality Engineering for Microsoft Fabric Healthcare Data Pipelines
Description Modern healthcare organizations increasingly rely on Microsoft Fabric to unify data engineering, analytics, and reporting across cloud-native platforms. As Medicare datasets such as claims, eligibility, enrollment, and provider information traverse multiple ingestion, transformation, and analytics layers, maintaining data quality becomes essential for regulatory compliance, operational efficiency, and trusted decision-making. Traditional quality assurance approaches that validate data only after pipeline execution often identify defects too late, resulting in costly remediation and inconsistent analytical outcomes. This session presents a proactive data quality engineering framework designed for Microsoft Fabric environments, embedding validation throughout the end-to-end data lifecycle. The framework integrates source-level verification for schema conformity, completeness, and referential integrity; transformation-level validation for mapping accuracy, business rule enforcement, and aggregations within Data Factory and Synapse Data Engineering; and cross-layer reconciliation across OneLake and analytical datasets. By incorporating automated validation workflows into Fabric pipelines, organizations can detect anomalies earlier, improve traceability, and support continuous data quality monitoring at scale. The session also demonstrates how healthcare-specific validation rules can be aligned with Medicare business processes while leveraging Microsoft Fabric's unified architecture for orchestration and analytics. Attendees will gain practical guidance on implementing scalable validation strategies that enhance governance, strengthen compliance readiness, and establish reliable healthcare data pipelines capable of supporting high-quality analytics and business intelligence.Handling Real Time data in Fabric Eventhouse
Event Details: Date: 19 September Time: 10:00 AM IST Speaker: Naveen Nagar | LinkedIn Profile About the Event: In today's data-driven world, organizations increasingly need to make sense of high-volume, fast-moving data - sensor telemetry, clickstreams, transactions, and logs - before the opportunity to act on it passes. Join us for this technical meetup as we explore Fabric Eventhouse, Microsoft Fabric's purpose-built engine for real-time analytics. This session will move beyond traditional batch pipelines to demonstrate a modern, low-latency data architecture where streaming data is captured, indexed, and made queryable within seconds. We will walk through a complete real-time data flow - from a live streaming source, into Eventhouse, and out to every consuming engine in Fabric via OneLake - without data duplication or performance trade-offs. What we will cover: Architecture: An end-to-end walkthrough of a real-time pipeline built on Fabric Eventstream, Eventhouse, and OneLake. Eventstream & Ingestion: How Eventstream captures, transforms, and routes streaming events from sources such as Azure Event Hub, IoT Hub, and CDC connectors into Eventhouse. Eventhouse & KQL Database: How KQL databases automatically index and time-partition data on arrival, and how update policies and materialized views enrich and aggregate data as it lands. OneLake Availability: How a single copy of streaming data becomes instantly available to Power BI, Warehouses, Notebooks, and Lakehouses through OneLake, eliminating the need for separate ETL copies. Live Demo: A practical, live walkthrough showing data flow from a streaming source, through Eventstream, into Eventhouse, out to OneLake, and into a live Power BI report in near real-time. This session is designed for: Data Engineers & Architects working with streaming data Power BI Developers & Fabric Users Analytics teams building real-time or near-real-time dashboards Anyone evaluating Microsoft Fabric's Real-Time Intelligence capabilitiesReal-Time Loyalty Intelligence on Microsoft Fabric for Agentic Commerce
Description Agentic commerce is projected to redirect three to five trillion dollars in global retail spending by 2030, and AI-driven retail website traffic grew 693% year-over-year during the 2025 holiday season. Every major agentic commerce protocol today treats agent-initiated transactions as anonymous guest checkouts, which means loyalty tier, points, and benefits disappear the moment an AI agent completes a purchase on a customer's behalf. Since loyalty members generate two to five times the revenue of non-members, this is a costly blind spot, and it is also a data engineering problem Fabric is well suited to solve. This session walks through a reference architecture for restoring tier recognition, benefit eligibility, and points accrual to machine-speed checkout flows operating under 100-millisecond latency budgets, built on Fabric's real-time stack. Eventstream and KQL Database power a Loyalty State Cache that serves pre-computed tier state in single-digit milliseconds using change-data-capture pipelines from the loyalty system of record. Data Activator drives a Benefit Eligibility Evaluator that resolves banner-parameterized offers and gated access in real time, while OneLake and Lakehouse provide the unified storage layer connecting transactional, promotional, and identity data without duplication. An asynchronous accrual engine settles points and benefit updates within seconds of payment confirmation, decoupled from the hot path. The talk covers concrete implementation patterns: staleness policies tuned by benefit type, from 15-minute tolerances for standard discounts to under 2 minutes for gated event access; a layered security model using short-lived, single-use tokens; and graceful degradation logic that preserves the purchase with retroactive accrual when real-time loyalty resolution fails. Attendees will leave with a working blueprint for using Fabric's real-time intelligence and OneLake foundation to keep loyalty programs intact as an increasing share of retail transactions shift to autonomous AI agents.The Integration Blueprint: Choosing the Right Path in Microsoft Fabric
Data Engineers in Toronto November 2026 Semimonthly Meeting Topic: The Integration Blueprint: Choosing the Right Path in Microsoft Fabric Abstract: In a world of multiple tools and endless data sources, how do you design the right integration strategy in Microsoft Fabric? Join Javier and Gaston, two Microsoft MVPs in Data Platform for a live demo-driven session that breaks down the real-world patterns, use cases, and best practices for landing, transforming, and orchestrating data in Microsoft Fabric. Whether you’re working with a Lakehouse, Data Warehouse, Eventhouse, or SQL Database, this session gives you the playbook to select and combine the right tools for the job. We’ll walk through: • Landing data using Data Pipelines, OneLake shortcuts, and external connections • Transforming and cleaning data using Notebooks (Spark) for scale and flexibility • Business logic and last-mile transformation using Dataflows Gen2 • How to orchestrate it all using Fabric Data Pipelines for repeatable, maintainable workflows • When and why to land your data into Lakehouses, Data Warehouses, Eventhouses, or SQL endpoints. You’ll walk away with: • A clear understanding of which tools to use when across the Fabric integration stack • A working knowledge of how to combine multiple integration techniques in one solution • Architecture patterns and decision criteria for building scalable data landing zones • Live demos you can replicate to accelerate your own Fabric journey Speaker: Javier Villegas, IT Director & Microsoft MVP Data Platform Speaker Profile: Javier Villegas is IT Director (DBA & BI Services) at Mediterranean Shipping Company with 30 years of experience working with SQL Server, Including Azure SQL. His specialization is Administration, Performance Tuning, High Availability and Disaster Recovery. Javier is a Microsoft MVP Data Platform since 2016 and MCT He is a frequent speaker in technical conferences and events such as SQL Saturdays, PASS Virtual Groups, PASS Marathons, 24 Hours SQL PASS , vOpen , GroupBy , Data Saturdays and Azure Global Bootcamps. He is one of the group leaders of SQL Argentina Community and former Microsoft Azure Data Advisory Board Member. The meeting is over Microsoft Teams, and the joining link is https://vip.dataengineersintoronto.org/webinar See you at the meeting!Deep Dive into Scalable, AI-Ready Spark in Microsoft Fabric
Data Engineers in Toronto November 2026 Semimonthly Meeting Topic: Deep Dive into Scalable, AI-Ready Spark in Microsoft Fabric Abstract: In this session, we’ll take a practical deep dive into Spark-based data engineering in Microsoft Fabric. We’ll walk through proven techniques and repeatable patterns for solving common and advanced data engineering challenges, covering advanced Spark SQL functions, effective approaches to semi-structured data, and strategies for building reliable, maintainable pipelines. We will be focusing on Fabric-specific aspects of Spark Notebooks, including table optimization. AI-related capabilities in Fabric Spark will also be covered, including built-in and integrated functions that support text processing, enrichment, classification, and feature engineering directly within Spark workloads, along with guidance on where these functions fit. Speaker: Iurii Iurchenko, Sr Data Engineer at Life Line Screening Speaker Profile: Iuril is an Azure advocate, Fabcon speaker, Senior Data Engineer & Tech Lead with 13 years of deep, hands-on expertise in Data Analytics, Microsoft Fabric, and the Azure data ecosystem. 2x certified in Microsoft Fabric, with 6+ successfully delivered complex projects leveraging Microsoft Fabric. Two-time SQL Saturday speaker in San Diego, Top-1% ADPList mentor, former entrepreneur, and active OHDSI CDM contributor with 7 years in consulting and 6 years in product engineering. He brings a highly practical, frontier-level skillset at the intersection of Fabric, AI, and healthcare analytics. He is currently innovating at Life Line Screening, bringing the best of Microsoft Fabric to its modern data analytics platform. The meeting is over Microsoft Teams, and the joining link is https://vip.dataengineersintoronto.org/webinar See you at the meeting!Beyond the Prompt: Tuning Fabric Data Agents for Flawless Results
Data Engineers in Toronto August 2026 Semimonthly Meeting Topic: Beyond the Prompt - Tuning Fabric Data Agents for Flawless Results Abstract: As organizations race to deploy AI Agents, it quickly becomes clear that standard prompt engineering isn't enough. To achieve production-grade accuracy, you have to go beyond the prompt and fundamentally change how you feed your data layers to the AI. In Microsoft Fabric, your choice of data artifact directly dictates your agent's reasoning style and native language. In this session, we will deep-dive into how Fabric Data Agents interact with four distinct data paradigms: Semantic Models, Ontology, Data Warehouses, and Lakehouses. Moving past high-level theory, we will practically map the three pillars of data agent optimization across the data paradigms: Agent Instructions (System Prompts) Data Source Descriptions (Grounding) Example Queries (Few-Shot Prompting) You will walk away with an actionable blueprint showing you exactly how to write context rules, embed semantic metadata, and supply technical query examples to ensure your Fabric Data Agents deliver flawless, trusted results every time. Speaker: Thimantha Vidanagamage, Data Engineer at OMERS, Canada Speaker Profile: Thimantha has over 8 years of experience in Data and AI. He currently works as a Senior Data Engineer at OMERS in Canada, where he plays an active role in the organization’s adoption of Microsoft Fabric. He holds multiple Microsoft certifications, including Microsoft Certified: AI Transformation Leader and Fabric Data/Analytics Engineer Associate. Thimantha is also a co-organizer of the Toronto Data Professionals Community. The meeting is over Microsoft Teams, and the joining link is https://vip.dataengineersintoronto.org/webinar See you at the meeting!Fabric Discord Contest
🎯 New in the Microsoft Fabric Discord community: Certification Prep Challenge The idea: build something that helps you (or someone else) study for a Microsoft Fabric certification. Doesn't matter which one - DP-600, DP-700, whatever you're working toward or have your eye on. Designed to take 1-2 hours. If you get into it and want to spend more time, go for it, but you don't have to. Participants have the opportunity to get vouchers for DP-700 or DP-600 exams! Some ideas to get you started: • A flashcard site for key terms and concepts (SKUs, CU math, roles, whatever trips you up) • A quiz app pulling from exam objective areas • A "spot the error" tool: show a broken config or a wrong answer and have people pick what's off • A progress tracker across exam domains • Anything interactive that helps the content stick Two ways to enter: 📸 Concept track: no Fabric environment? No problem. Mock up your idea in Canva, Figma, PowerPoint, whatever you've got. 🛠️ Builder track: actually build it. A great excuse to try Fabric Apps and Rayfin, both in public preview right now. Submit a live URL plus a GitHub repo. To submit: Join the Discord Server and share your app or mockup in our contest entries channel. 📅 Opens: August 18 📅 Closes: September 1 🏆 Prizes: winners in each track take home some Microsoft swag Join the Discord server to enter today! https://discord.gg/EGD4Yv8DEZPower BI + Fabric MCP: What It Can Do, What It Can't, and How to Set It Up
Event Details: Date: 29 August 2026 Time: 6:30 PM IST Speaker: Natarajan Manivasagan | LinkedIn Profile About the Event: Microsoft has shipped MCP servers for Power BI and Microsoft Fabric, opening up a new way for AI agents to work directly with semantic models and workspace items. This session is a practical introduction to integrating these new capabilities into your workflow. We will explore what MCP is, how to set it up, and what it makes possible in real work - from semantic model development to workspace management through natural language. What we will cover: The Fundamentals: What MCP is and how it differs from a traditional REST API. Microsoft's Offerings: An overview of the available MCP servers for Power BI and Fabric, and the specific use cases for each. Setup & Integration: How to configure these servers with the tools you already use. Real-World Applications: Managing semantic models and workspaces using natural language. Honest Boundaries: A realistic look at the current limitations of this public preview so you can avoid wasted effort. Who should attend: Power BI Developers Data Analysts Data Engineers Anyone looking for a grounded view of how AI agents fit into a real data workflow Are you based out of India? Join Our WhatsApp group for Event Updates. https://chat.whatsapp.com/FqDsKITYk22F5wXWYQKzua
A Year in Review, Fabric Community Update - December 2024
A Year in Review, Fabric Community Update - December 2024 Thank you to all our Fabric Community members! The Fabric community team would like to take the opportunity to say thank you for your contributions over the 2024 year. Providing solutions, posting in galleries, writing blogs, and participating in user groups are some of the ways you have helped make the Fabric community a great place to be. Join us at the 2025 Microsoft Fabric Community Conference 2024 introduced #FabCon, the Fabric Community Conferences that attracted over 8,000 Fabric fans across 2 sold out conferences in Las Vegas and Stockholm. FabCon 2025 in Las Vegas from March 31 to April 2 will be the biggest-ever FabCon. With 4 keynotes, 215 sessions, and 20 full-day Workshops covering Power BI, Fabric, SQL and AI, it’s the ultimate learning event for BI professionals, database professionals, and developers. Here are 5 more reasons to join us at FabCon in 2025: The extremely popular Ask the Experts enclave with 12+ dedicated booths to answer your trickiest technical, capacity, and billing questions. The much-anticipated FREE Partner Pre-Day for systems integrators to help grow their Fabric practice. The buzzing Community Lounge to connect and collaborate with like-minded professionals, stalwarts (and celebrities) in the data community. The ever-popular Power Hour where you are guaranteed to learn NOTHING but may luck out with cool swag. And brand new at FabCon 2025, a Power BI visualization showdown where you get to watch and vote on the best of the best competing for our world title! Snag the early bird discount before Dec 31 and use the code MSCUST to get another $150 off, this is the lowest it’s ever going to be! Need help convincing your boss, use this letter! The Fabric community has grown so much in 2024! If you haven't seen all the updates that have been made to the Fabric community this year, now is the time. Get started with the Fabric community landing page and explore the Career Hub, expanded forum experiences and community blogs. Career Hub Expanded forum experiences Data Engineering Data Warehouse Data Science Databases Fabric platform Fabric community blogs Fabric community support Be one of the first to start using Fabric Databases Ready to build reliable, highly scalable applications where cloud authentication and encryption are secured by default? Watch on-demand SQL database in Fabric session with database experts and the Microsoft product team and see just how easy it is to get started. View all the sessions here. Popular blogs Here are some community blogs from the past year, that are getting attention and that you might be interested in! [Power BI] Measure Killer - external tool to clean model by @ibarrau Power BI Dynamic Date Filters: Automatically Updating Filters with Each Refresh by @ Fowmy Page Level Security in Power BI by @truptis Utilize Power BI Semantic Model within Power BI Reports Builder by @SamInogic Refresh Power BI Semantic Model from MSFT Fabric Data Pipeline by @NandanHegde Blogs from the Fabric team Announcing SQL database in Microsoft Fabric (Preview) Store and access your Iceberg data in OneLake using Snowflake and shortcuts Announcing preview of Workspace Monitoring The Microsoft Fabric Community Conference is coming back to Las Vegas! Announcing New Recruitment for the Private Preview of Microsoft Fabric SKU Estimator Community Spotlight Members Each month a member of the Fabric community is chosen to be showcased for their exemplary community contributions. Community Spotlight Members answer questions, provide solutions and share their expert knowledge. They are valued community members that go above and beyond to support the Fabric community. Meet @Brunner_BI, November Spotlight member. Super User Power BI Community Member since 2020 80+ Kudos 40 Solutions authored 260+ Replies Creator of the Measure Killer tool Thank you to all the 2024 Community Spotlight members. @bhanu_gautam @DoherDrizzle @jennratten @Ashish_Mathur @rubayatyasmin @lbendlin @Jihwan_Kim @aj1973 @technolog People are finding solutions These are the most popular questions about Fabric that got answered in the past year. Power BI: Add a table to a semantic model - using Power BI desktop or online services Fabric Platform: How to access Fabric Warehouse from Fabric Notebooks? Data Factory: Execute Data Pipeline Via API Real-Time Intelligence: Data Activator Power BI Report Alert Refresh Rate Popular discussions These are the trending discussions in the forums. Power BI: Connecting Power BI Desktop to Stored Procedures: Feasibility and Best Practices Fabric Platform: Fabric compute capacity exceeded its limits. How to know how much CU each dataflowgen2 consumes Data Factory: Truncate Warehouse SQL table Real-Time Intelligence: Fabric workspace item events - alert creation failed Trending Data Stories for Power BI Visit the Data Stories Gallery for more inspiration and ideas. Global Supermarket by @AjitPadole_ Operational Overview for Quick Service Restaurants by @RapidaSolutions To stay up-to-date with Fabric, visit Fabric Community News and select Subscribe from the Options menu.
