data
15 TopicsFabCon 2026 Barcelona: Beyond the Announcements
Data Engineers in Toronto October 2026 Semimonthly Meeting Topic: FabCon 2026 Barcelona - Beyond the Announcements Abstract: What was it like to attend Microsoft's flagship Fabric conference in Barcelona? Which announcements generated the most excitement? And more importantly, which ones are likely to matter in real-world customer projects? Join me for an informal recap of FabCon 2026 as I share photos, conference highlights, conversations with Microsoft engineers and community members, and a curated selection of Fabric announcements that caught my attention. Speaker: Alexander Turlov, Principal Consultant at Alta Computing Speaker Profile: Alexander Turlov is a professional consultant, specializing in cloud data architecture and Microsoft Fabric solutions. He helps organizations design scalable data platforms and integrate modern tools like GitHub Copilot and VS Code to accelerate development workflows. Alexander is a certified Microsoft Fabric Data Engineer and an active community contributor, sharing practical insights through presentations and workshops on AI-assisted data engineering and analytics. The meeting is over Microsoft Teams, and the joining link is https://vip.dataengineersintoronto.org/webinar See you at the meeting!10Views0likes0CommentsAgentic Loops in the Data Stack: From Pipeline Failure to Auto-Remediation
Data Engineers in Toronto January 2027 Semimonthly Meeting Topic: Agentic Loops in the Data Stack: From Pipeline Failure to Auto-Remediation Abstract: Every data engineer knows the 2 AM pipeline failure, the one nobody notices until Friday's report is wrong. In this session, we break down five AI agents that are changing how data teams operate: from monitoring pipelines 24/7 and catching schema drift at ingestion, to closing the gap between a production failure and its root cause in minutes. We'll walk through real implementation patterns, including a baseline-learning monitoring agent and a tool-use driven incident response loop, and discuss what the shift to agentic data engineering actually means for the way teams are built and how engineers grow. Whether you're evaluating agents for your platform or already running them in production, you'll leave with concrete patterns you can apply immediately. Speaker: Varun Joshi, Senior Data Engineer at AWS Speaker Profile: Highly motivated and results-oriented Data Engineer with 12+ years of experience in designing, building,and optimizing scalable data pipelines and architectures.Proven expertise in data warehousing, ETL/ELT processes, and cloud platforms. Passionate about leveraging Artificial Intelligence (AI) and Machine Learning (ML). Designed and deployed AI-driven Data solutions, integrating LLM-powered coding assistants into Data Engineering to produce AI solutions for customers. Focused on leveraging LLMs and advanced engineering to build scalable, secure, and trustworthy platforms, resulting in significant efficiency gains, reduced on-call burden,and improved customer trust. Driving AI adoption across teams to enhance productivity, streamline deployments, and improve end-user experience. The meeting is over Microsoft Teams, and the joining link is https://vip.dataengineersintoronto.org/webinar See you at the meeting!42Views0likes0CommentsCity of Toronto Open Data Portal
Data Engineers in Toronto December 2026 Semimonthly Meeting Topic: City of Toronto Open Data Portal Abstract: The City of Toronto launched its first Open Data Portal in the fall of 2009 to meet growing demand for open data. Since then, the open data movement has gained increasing momentum within Toronto’s digital and civic spaces. Come hear the city staff that manage the open data portal (https://open.toronto.ca) pull back the curtain and discuss how it works behind the scenes and where it contributes to the city. Speaker: Mac Nichols; Supervisor, City of Toronto Open Data Speaker Profile: Mac is the supervisor of the city of Toronto's open data portal. He's worked on the portal since 2021, before which he worked in the private sector as a data engineer and analyst The meeting is over Microsoft Teams, and the joining link is https://vip.dataengineersintoronto.org/webinar See you at the meeting!29Views0likes0CommentsThe Integration Blueprint: Choosing the Right Path in Microsoft Fabric
Data Engineers in Toronto November 2026 Semimonthly Meeting Topic: The Integration Blueprint: Choosing the Right Path in Microsoft Fabric Abstract: In a world of multiple tools and endless data sources, how do you design the right integration strategy in Microsoft Fabric? Join Javier and Gaston, two Microsoft MVPs in Data Platform for a live demo-driven session that breaks down the real-world patterns, use cases, and best practices for landing, transforming, and orchestrating data in Microsoft Fabric. Whether you’re working with a Lakehouse, Data Warehouse, Eventhouse, or SQL Database, this session gives you the playbook to select and combine the right tools for the job. We’ll walk through: • Landing data using Data Pipelines, OneLake shortcuts, and external connections • Transforming and cleaning data using Notebooks (Spark) for scale and flexibility • Business logic and last-mile transformation using Dataflows Gen2 • How to orchestrate it all using Fabric Data Pipelines for repeatable, maintainable workflows • When and why to land your data into Lakehouses, Data Warehouses, Eventhouses, or SQL endpoints. You’ll walk away with: • A clear understanding of which tools to use when across the Fabric integration stack • A working knowledge of how to combine multiple integration techniques in one solution • Architecture patterns and decision criteria for building scalable data landing zones • Live demos you can replicate to accelerate your own Fabric journey Speaker: Javier Villegas, IT Director & Microsoft MVP Data Platform Speaker Profile: Javier Villegas is IT Director (DBA & BI Services) at Mediterranean Shipping Company with 30 years of experience working with SQL Server, Including Azure SQL. His specialization is Administration, Performance Tuning, High Availability and Disaster Recovery. Javier is a Microsoft MVP Data Platform since 2016 and MCT He is a frequent speaker in technical conferences and events such as SQL Saturdays, PASS Virtual Groups, PASS Marathons, 24 Hours SQL PASS , vOpen , GroupBy , Data Saturdays and Azure Global Bootcamps. He is one of the group leaders of SQL Argentina Community and former Microsoft Azure Data Advisory Board Member. The meeting is over Microsoft Teams, and the joining link is https://vip.dataengineersintoronto.org/webinar See you at the meeting!18Views0likes0CommentsDeep Dive into Scalable, AI-Ready Spark in Microsoft Fabric
Data Engineers in Toronto November 2026 Semimonthly Meeting Topic: Deep Dive into Scalable, AI-Ready Spark in Microsoft Fabric Abstract: In this session, we’ll take a practical deep dive into Spark-based data engineering in Microsoft Fabric. We’ll walk through proven techniques and repeatable patterns for solving common and advanced data engineering challenges, covering advanced Spark SQL functions, effective approaches to semi-structured data, and strategies for building reliable, maintainable pipelines. We will be focusing on Fabric-specific aspects of Spark Notebooks, including table optimization. AI-related capabilities in Fabric Spark will also be covered, including built-in and integrated functions that support text processing, enrichment, classification, and feature engineering directly within Spark workloads, along with guidance on where these functions fit. Speaker: Iurii Iurchenko, Sr Data Engineer at Life Line Screening Speaker Profile: Iuril is an Azure advocate, Fabcon speaker, Senior Data Engineer & Tech Lead with 13 years of deep, hands-on expertise in Data Analytics, Microsoft Fabric, and the Azure data ecosystem. 2x certified in Microsoft Fabric, with 6+ successfully delivered complex projects leveraging Microsoft Fabric. Two-time SQL Saturday speaker in San Diego, Top-1% ADPList mentor, former entrepreneur, and active OHDSI CDM contributor with 7 years in consulting and 6 years in product engineering. He brings a highly practical, frontier-level skillset at the intersection of Fabric, AI, and healthcare analytics. He is currently innovating at Life Line Screening, bringing the best of Microsoft Fabric to its modern data analytics platform. The meeting is over Microsoft Teams, and the joining link is https://vip.dataengineersintoronto.org/webinar See you at the meeting!23Views0likes0CommentsIntroduction to the data build tool (dbt)
Data Engineers in Toronto October 2026 Semimonthly Meeting Topic: Introduction to the data build tool (dbt) Abstract: Many people learn from the Jaffle Shop sample dbt project. However, the complexity of the project is quite simple. What I really wanted is a project that goes over the following dbt concepts: • Seed raw data tables • Transform raw data using views • Support multiple databases with macros • Capture slowly changing dimensions type • Incremental loading of large data • Use ephemeral tables as a place holder • Use dbt utils package to make a date dimension • Create a dimensional model for reporting • Save pre-canned queries in analyses directory • Test data quality using property/schema files • Output custom data quality exceptions to a table • Create documentation based on model design In the end, I created my own sample dbt project using the Chinook database schema as the foundation. I must thank Luis Rocha for the OLTP database design and sample data. This open source project was built using an Fabric SQL Database as the target. However, it can be built on any supported database using the correct dbt adapter and ODBC driver. At the end of this presentation, a data engineer will be ready to model data for any given database or warehouse. Speaker: John Miner, Senior Data Architect at Insight Digital Innovation Speaker Profile: John Miner is a Senior Data Architect at Insight Digital Innovation helping corporations solve their business needs with various data platform solutions. He has over thirty years of data processing experience, and his architecture expertise encompasses all phases of the software project life cycle, including design, development, implementation, and maintenance of systems. His credentials include undergraduate and graduate degrees in Computer Science from the University of Rhode Island. Also, he has earned certificates from Microsoft for Database Administration (MCDBA), System Administration (MCSA), Data Management & Analytics (MCSE) and Data Science (MPP). John has been recognized with the Microsoft MVP award ten times for his outstanding contributions to the Data Platform community. When he is not busy talking to local user groups or writing blog entries on new technology, he spends time with his wife and daughter enjoying outdoor activities. Some of John’s hobbies include wood working projects, crafting a good beer and playing a game of chess. The meeting is over Microsoft Teams, and the joining link is https://vip.dataengineersintoronto.org/webinar See you at the meeting!31Views0likes0CommentsMaking AI Work: Aligning Data, Teams, and Business Goals
AI adoption often stalls not due to a lack of tools, but because of what I call “frozen yoghurt syndrome”—an overwhelming number of choices that leads to confusion, misalignment, and stalled progress. This session offers a pragmatic framework for building a scalable data strategy that cuts through the noise and focuses on delivering business value. We’ll explore four key pillars: - Identify the Problem and Bigger Picture – Start with the business need. AI isn’t always the right answer; sometimes automation or simpler analytics are more effective. - Design the Strategy Around Data, AI, and the Use Case Together – Align initiatives with clear business goals and define success metrics that matter to both technical and non-technical teams. - Build the Foundation – Encourage cross-functional collaboration, select scalable tools, and document everything from data sources to model assumptions. - Create a Positive Feedback Loop Between Tech and Non-Tech Teams – Foster a shared product language, enable self-service access to data, and build trust through transparency and iteration. Attendees will leave with practical frameworks to ensure AI efforts are not just technically sound — but strategically aligned, collaborative, and sustainable.133Views0likes0CommentsAll About Data Retention: Tactics for optimizing computing resources
Topic: All About Data Retention: Tactics for optimizing computing resources Abstract: How long should data be kept for? How should it be handled as it moves from actively used hot data to seldom used cool data? What tactics can be used to optimize computing resources when handling data of different types, from different systems, and of different ages. Retention is a seldom-discussed topic, but one that can be used to reduce cloud hosting bills, improve performance, improve predictability, and ensure that an application remains in compliance with legal and contractual obligations, This session dives into data retention from all angles and provides a wide variety of tactics for creating retention policies and implementing technical solutions. Speaker: Edward Pollack, Data Architect & Microsoft Data Platform MVP Speaker Profile: Ed Pollack is a Microsoft Data Platform MVP with a passion for learning how Data Platforms work and sharing that knowledge with the community. His experiences in data architecture, database design, performance optimization, and data security are motivation for public speaking, writing, coding, and other community activities. Ed has spoken at SQL Saturday events, SQL Bits, PASS Summit, EightKB, and many other regional and international events. Ed is the organizer of the Capital Area SQL Server Group and SQL Saturday Albany, as well as a co-organizer of SQL Saturday New York City, and Future Data Driven. He has published a number of books, including "Dynamic SQL: Applications, Performance, and Security in Microsoft SQL Server", "Expert Performance Indexing in Azure SQL and SQL Server 2022", and "Analytics Optimization with Columnstore Indexes in Microsoft SQL Server: Optimizing OLAP Workloads". Ed is also an active contributor of content to SimpleTalk. In his free time, Ed enjoys video games, traveling, cooking exceptionally spicy foods, and hanging out with his amazing wife and sons.53Views0likes0CommentsMaximize SQL Server Performance with Read Committed Snapshot Isolation
Data Engineers in Toronto May 2026 Semimonthly Meeting Topic: Maximize SQL Server Performance with Read Committed Snapshot Isolation Abstract: Are your read operations frequently blocked by write operations? Do you want to retrieve data without relying on NOLOCK? Then it's time to switch to Read Committed Snapshot Isolation (RCSI). In this session, I’ll explain what RCSI is, how it works, and how it differs from the default Read Committed Isolation level. I’ll demonstrate how version store comes into play with this isolation level and when it can overwhelm TempDB if not managed properly. Finally, I’ll discuss how to manage the implications of enabling RCSI. By the end of this session, you'll have a clear understanding of RCSI and when to implement it in your environment for improved concurrency and performance. Speaker: Haripriya Naidu, Lead SQL Server Database Administrator Speaker Profile: Haripriya Naidu has been working as a SQL Server Database Administrator for 11 years in Boston, MA. She is passionate about databases and enjoys diving into SQL Server engine internals and optimizing performance. She is an AWS Certified Solutions Associate and won "Rookie of the Year" Award at work in 2024 for outstanding performance and "Bookworm of the Year" Award at work in 2025 for continuously learning and sharing knowledge with the team. She recently started her speaking journey with New Stars of Data and spoke at SQL Saturdays Boston, Albany and San Diego and PASS Summit 2024. The meeting is over Microsoft Teams, and the joining link is https://teams.microsoft.com/l/meetup-join/19%3ameeting_NzZkYWIyOTAtODk1MC00MjVmLWJlNjUtNTRiODZmODA2Zjdh%40thread.v2/0?context=%7b%22Tid%22%3a%22bd9727e8-f539-4c76-983c-6c30130c0bee%22%2c%22Oid%22%3a%229e8d5a64-e773-4ca2-90f6-9a266129171e%22%7d See you at the meeting!69Views0likes0CommentsData Modernization at Traditional Banks - From Legacy Mainframe to Cloud
(Date updated to 1 June 2026) Data Engineers in Toronto May 2026 Semimonthly Meeting Topic: Data Modernization at Traditional Banks - From Legacy Mainframe to Cloud Abstract: As technology evolved from the age of industrialization to the age of information, and finally to this current age of AI, the average lifecycle of technology shrank from 10 to 6, and now it is 3 years. Therefore, the definition of “legacy” has shifted. Applications developed before 2010, especially those built on mainframes or outdated technologies, are increasingly seen as candidates for modernization. Mainframe transformation has been a top priority in financial services because of its operational inefficiencies and high maintenance costs associated with mainframes when compared to modern distributed systems. Still, the majority of the core processing engines within financial services depend on Mainframe as the mission-critical business rules are embedded Speaker: Vishal Sharma, VP - Software Engineering at Broadridge Speaker Profile: As a Software Engineering leader, I bring over 20 years of expertise in enterprise architecture and digital transformation. By leading cross-functional teams, I enable the delivery of secure, scalable solutions that optimize operations and enhance client engagement. My efforts focus on integrating innovative technologies to align with strategic business goals, resulting in measurable outcomes for stakeholders. With a strong foundation in business architecture and fintech innovation, I excel in modernizing platforms to meet evolving industry demands. Equipped with certifications such as TOGAF, I prioritize seamless system integration, cost efficiency, and regulatory alignment to drive long-term value for organizations. Passionate about solving complex challenges, I work collaboratively to empower teams and achieve sustainable success. The meeting is over Microsoft Teams, and the joining link is https://teams.microsoft.com/l/meetup-join/19:meeting_NzZkYWIyOTAtODk1MC00MjVmLWJlNjUtNTRiODZmODA2Zjdh@thread.v2/0?context={"Tid":"bd9727e8-f539-4c76-983c-6c30130c0bee","Oid":"9e8d5a64-e773-4ca2-90f6-9a266129171e"} See you at the meeting!87Views0likes0Comments