Agentic Loops in the Data Stack: From Pipeline Failure to Auto-Remediation
Data Engineers in Toronto January 2027 Semimonthly Meeting Topic: Agentic Loops in the Data Stack: From Pipeline Failure to Auto-Remediation Abstract: Every data engineer knows the 2 AM pipeline failure, the one nobody notices until Friday's report is wrong. In this session, we break down five AI agents that are changing how data teams operate: from monitoring pipelines 24/7 and catching schema drift at ingestion, to closing the gap between a production failure and its root cause in minutes. We'll walk through real implementation patterns, including a baseline-learning monitoring agent and a tool-use driven incident response loop, and discuss what the shift to agentic data engineering actually means for the way teams are built and how engineers grow. Whether you're evaluating agents for your platform or already running them in production, you'll leave with concrete patterns you can apply immediately. Speaker: Varun Joshi, Senior Data Engineer at AWS Speaker Profile: Highly motivated and results-oriented Data Engineer with 12+ years of experience in designing, building,and optimizing scalable data pipelines and architectures.Proven expertise in data warehousing, ETL/ELT processes, and cloud platforms. Passionate about leveraging Artificial Intelligence (AI) and Machine Learning (ML). Designed and deployed AI-driven Data solutions, integrating LLM-powered coding assistants into Data Engineering to produce AI solutions for customers. Focused on leveraging LLMs and advanced engineering to build scalable, secure, and trustworthy platforms, resulting in significant efficiency gains, reduced on-call burden,and improved customer trust. Driving AI adoption across teams to enhance productivity, streamline deployments, and improve end-user experience. The meeting is over Microsoft Teams, and the joining link is https://vip.dataengineersintoronto.org/webinar See you at the meeting!City of Toronto Open Data Portal
Data Engineers in Toronto December 2026 Semimonthly Meeting Topic: City of Toronto Open Data Portal Abstract: The City of Toronto launched its first Open Data Portal in the fall of 2009 to meet growing demand for open data. Since then, the open data movement has gained increasing momentum within Toronto’s digital and civic spaces. Come hear the city staff that manage the open data portal (https://open.toronto.ca) pull back the curtain and discuss how it works behind the scenes and where it contributes to the city. Speaker: Mac Nichols; Supervisor, City of Toronto Open Data Speaker Profile: Mac is the supervisor of the city of Toronto's open data portal. He's worked on the portal since 2021, before which he worked in the private sector as a data engineer and analyst The meeting is over Microsoft Teams, and the joining link is https://vip.dataengineersintoronto.org/webinar See you at the meeting!The Integration Blueprint: Choosing the Right Path in Microsoft Fabric
Data Engineers in Toronto November 2026 Semimonthly Meeting Topic: The Integration Blueprint: Choosing the Right Path in Microsoft Fabric Abstract: In a world of multiple tools and endless data sources, how do you design the right integration strategy in Microsoft Fabric? Join Javier and Gaston, two Microsoft MVPs in Data Platform for a live demo-driven session that breaks down the real-world patterns, use cases, and best practices for landing, transforming, and orchestrating data in Microsoft Fabric. Whether you’re working with a Lakehouse, Data Warehouse, Eventhouse, or SQL Database, this session gives you the playbook to select and combine the right tools for the job. We’ll walk through: • Landing data using Data Pipelines, OneLake shortcuts, and external connections • Transforming and cleaning data using Notebooks (Spark) for scale and flexibility • Business logic and last-mile transformation using Dataflows Gen2 • How to orchestrate it all using Fabric Data Pipelines for repeatable, maintainable workflows • When and why to land your data into Lakehouses, Data Warehouses, Eventhouses, or SQL endpoints. You’ll walk away with: • A clear understanding of which tools to use when across the Fabric integration stack • A working knowledge of how to combine multiple integration techniques in one solution • Architecture patterns and decision criteria for building scalable data landing zones • Live demos you can replicate to accelerate your own Fabric journey Speaker: Javier Villegas, IT Director & Microsoft MVP Data Platform Speaker Profile: Javier Villegas is IT Director (DBA & BI Services) at Mediterranean Shipping Company with 30 years of experience working with SQL Server, Including Azure SQL. His specialization is Administration, Performance Tuning, High Availability and Disaster Recovery. Javier is a Microsoft MVP Data Platform since 2016 and MCT He is a frequent speaker in technical conferences and events such as SQL Saturdays, PASS Virtual Groups, PASS Marathons, 24 Hours SQL PASS , vOpen , GroupBy , Data Saturdays and Azure Global Bootcamps. He is one of the group leaders of SQL Argentina Community and former Microsoft Azure Data Advisory Board Member. The meeting is over Microsoft Teams, and the joining link is https://vip.dataengineersintoronto.org/webinar See you at the meeting!Deep Dive into Scalable, AI-Ready Spark in Microsoft Fabric
Data Engineers in Toronto November 2026 Semimonthly Meeting Topic: Deep Dive into Scalable, AI-Ready Spark in Microsoft Fabric Abstract: In this session, we’ll take a practical deep dive into Spark-based data engineering in Microsoft Fabric. We’ll walk through proven techniques and repeatable patterns for solving common and advanced data engineering challenges, covering advanced Spark SQL functions, effective approaches to semi-structured data, and strategies for building reliable, maintainable pipelines. We will be focusing on Fabric-specific aspects of Spark Notebooks, including table optimization. AI-related capabilities in Fabric Spark will also be covered, including built-in and integrated functions that support text processing, enrichment, classification, and feature engineering directly within Spark workloads, along with guidance on where these functions fit. Speaker: Iurii Iurchenko, Sr Data Engineer at Life Line Screening Speaker Profile: Iuril is an Azure advocate, Fabcon speaker, Senior Data Engineer & Tech Lead with 13 years of deep, hands-on expertise in Data Analytics, Microsoft Fabric, and the Azure data ecosystem. 2x certified in Microsoft Fabric, with 6+ successfully delivered complex projects leveraging Microsoft Fabric. Two-time SQL Saturday speaker in San Diego, Top-1% ADPList mentor, former entrepreneur, and active OHDSI CDM contributor with 7 years in consulting and 6 years in product engineering. He brings a highly practical, frontier-level skillset at the intersection of Fabric, AI, and healthcare analytics. He is currently innovating at Life Line Screening, bringing the best of Microsoft Fabric to its modern data analytics platform. The meeting is over Microsoft Teams, and the joining link is https://vip.dataengineersintoronto.org/webinar See you at the meeting!Introduction to the data build tool (dbt)
Data Engineers in Toronto October 2026 Semimonthly Meeting Topic: Introduction to the data build tool (dbt) Abstract: Many people learn from the Jaffle Shop sample dbt project. However, the complexity of the project is quite simple. What I really wanted is a project that goes over the following dbt concepts: • Seed raw data tables • Transform raw data using views • Support multiple databases with macros • Capture slowly changing dimensions type • Incremental loading of large data • Use ephemeral tables as a place holder • Use dbt utils package to make a date dimension • Create a dimensional model for reporting • Save pre-canned queries in analyses directory • Test data quality using property/schema files • Output custom data quality exceptions to a table • Create documentation based on model design In the end, I created my own sample dbt project using the Chinook database schema as the foundation. I must thank Luis Rocha for the OLTP database design and sample data. This open source project was built using an Fabric SQL Database as the target. However, it can be built on any supported database using the correct dbt adapter and ODBC driver. At the end of this presentation, a data engineer will be ready to model data for any given database or warehouse. Speaker: John Miner, Senior Data Architect at Insight Digital Innovation Speaker Profile: John Miner is a Senior Data Architect at Insight Digital Innovation helping corporations solve their business needs with various data platform solutions. He has over thirty years of data processing experience, and his architecture expertise encompasses all phases of the software project life cycle, including design, development, implementation, and maintenance of systems. His credentials include undergraduate and graduate degrees in Computer Science from the University of Rhode Island. Also, he has earned certificates from Microsoft for Database Administration (MCDBA), System Administration (MCSA), Data Management & Analytics (MCSE) and Data Science (MPP). John has been recognized with the Microsoft MVP award ten times for his outstanding contributions to the Data Platform community. When he is not busy talking to local user groups or writing blog entries on new technology, he spends time with his wife and daughter enjoying outdoor activities. Some of John’s hobbies include wood working projects, crafting a good beer and playing a game of chess. The meeting is over Microsoft Teams, and the joining link is https://vip.dataengineersintoronto.org/webinar See you at the meeting!Carreira na Europa com Microsoft Fabric: Como entrar, crescer e trabalhar na área de Dados
📅 04 de setembro de 2026 🕗 20:00 — Hora de Portugal (Lisboa) 💻 Online — Microsoft Teams 🌍 Idioma: Português Queres trabalhar na Europa na área de Dados? Já estás na Europa e queres fazer uma transição para Data Engineering, Data Analytics ou Business Intelligence? Então esta sessão é para ti. 🚀 O mercado europeu tem uma procura crescente por profissionais de Dados, Analytics e Data Engineering, e o Microsoft Fabric está a ganhar cada vez mais espaço nas organizações que procuram centralizar e modernizar as suas plataformas de dados. Nesta sessão do Fabric Lusófono, vamos falar sobre como podes utilizar o ecossistema Microsoft — especialmente Microsoft Fabric, Power BI, SQL, Azure, Python e outras tecnologias de dados — para construir uma carreira competitiva no mercado europeu. 🎯 O que vamos abordar? 🔹 Como está o mercado europeu de Dados e Analytics Que perfis são mais procurados e quais as competências que as empresas valorizam. 🔹 Microsoft Fabric como oportunidade de carreira Como o Fabric se encaixa nos papéis de Data Engineer, Analytics Engineer, Data Analyst, BI Developer e outros. 🔹 Como entrar na área de Dados na Europa Estratégias para quem está a começar ou pretende fazer uma mudança de carreira. 🔹 Como transformar conhecimento técnico em empregabilidade Certificações, projetos, GitHub, LinkedIn, portefólio e experiência prática — o que realmente pode fazer diferença. 🔹 Como construir um perfil internacional Como apresentar as tuas competências, experiência e projetos para empresas europeias. 🔹 Remote, Hybrid ou On-site? O que considerar quando procuras oportunidades em diferentes países europeus. 🔹 Do zero à primeira oportunidade Um possível caminho de aprendizagem para quem quer entrar em Data Analytics ou Data Engineering. 🌍 Para quem é esta sessão? Esta sessão é especialmente indicada para: 👨🏾💻 Profissionais de Dados que vivem fora da Europa e querem encontrar oportunidades no mercado europeu. 🌍 Profissionais que já estão na Europa e querem migrar para a área de Dados. 📊 Data Analysts, BI Developers e profissionais de Power BI que querem evoluir para Data Engineering ou Analytics Engineering. ⚙️ Data Engineers que querem fortalecer o seu conhecimento em Microsoft Fabric e posicionar-se melhor no mercado. 🎓 Estudantes e profissionais em transição de carreira que querem perceber por onde começar. 🚀 Profissionais que já trabalham com Microsoft, Azure, SQL ou Power BI e querem transformar essas competências numa carreira internacional. 💡 Mais do que aprender uma ferramenta Aprender Microsoft Fabric é importante. Mas saber construir uma carreira com essas competências é ainda mais importante. A ideia desta sessão é mostrar o caminho entre: 📚 Aprender → 🛠️ Praticar → 🧩 Construir projetos → 🎯 Criar um perfil profissional → 🇪🇺 Encontrar oportunidades Não precisas de saber tudo para começar. Precisas de saber o que aprender, como praticar e como demonstrar o teu valor ao mercado. Se tens o objetivo de trabalhar com Dados na Europa — ou simplesmente queres descobrir se esta pode ser a tua próxima carreira — junta-te a nós. Fabric Lusófono — Aprender. Partilhar. Crescer.Deneb: Develop Custom Visuals Inside Power BI
Building custom visuals in Power BI gives you total control over your scenario and results can be very rewarding. However, there's a high learning curve, particularly if you are not familiar with web development tools and technologies. If you already have experience with R and/or Python, Power BI offers visuals with an interface for you to write code in these languages, and these options can help a lot with producing tailor-made designs. Vega-Lite is a "visualization grammar" developed by the University of Washington Interactive Data Lab. It uses a declarative, JSON-based language that allows authors to build a range of bespoke visual designs with significantly less effort than coding from scratch. In this session, Daniel will introduce you to the Vega-Lite language via Deneb - a custom visual for Power BI. We will create some example visuals, as well as demonstrate some of the additional integration features with Power BI that aren't currently possible when using R & Python. 𝙈𝙚𝙚𝙩𝙞𝙣𝙜 𝙡𝙞𝙣𝙠(𝙈𝙎 𝙏𝙚𝙖𝙢𝙨): https://bit.ly/3ri3kKf 𝙋𝙚𝙧𝙨𝙞𝙖𝙣 𝙋𝘽𝙄𝙐𝙂- 𝙈𝙞𝙘𝙧𝙤𝙨𝙤𝙛𝙩 𝘾𝙤𝙢𝙢𝙪𝙣𝙞𝙩𝙮: https://bit.ly/3IAg7xT 𝙇𝙞𝙣𝙠𝙚𝙙𝙄𝙣: https://bit.ly/32tGkif 𝙏𝙚𝙡𝙚𝙜𝙧𝙖𝙢 𝘾𝙝𝙖𝙣𝙣𝙚𝙡: https://t.me/PersianPBIUG 𝙔𝙤𝙪𝙏𝙪𝙗𝙚: https://bit.ly/3hk20RL Language: English¿Por qué es importante preocuparnos por... “What If” (¡Qué pasaría si!)?
¿Qué pasaría si la compañía vende más? ¿Qué pasaría si hubiera menos porcentaje de devoluciones de productos? ¿Cuánto debo incremental el margen para alcanzar un determinado objetivo en el monto de las ventas? Son dudas que pueden surgir a diario en los negocios y que podría ser muy útil tener la opción de crear posibles escenarios en los modelos de datos para analizar qué pasaría con los datos si está o aquella variable aumenta o decrece, siendo variables de tipo porcentajes, volumen o de montos, por ejemplo. En esta sesión se aprenderá como utilizar los parámetros de tipo “What-if” en Power BI y que tipos de escenarios pueden ser de utilidad para que cada quién pueda aplicarlos en su propio entorno de trabajo. La charla está orientada tanto a desarrolladores como a analistas de datos y usuarios del negocio, para que puedan aprender su uso y puedan imaginar un sin fin de posibilidades de como poder aplicarlos con sus datos.2º Encuentro presencial grupo de usuarios Power BI Albacete
Convocamos el segundo encuentro presencial del grupo de usuarios de Power BI de Albacete, por lo que si te apasiona esta tecnología y estás en la ciudad o alrededores, serás bienvenid@. Tendremos dos sesiones, la primera, Web scrapping. Caso de uso de extracción de datos públicos por Raúl Vinuesa Arjona, y la segunda El visual adecuado. Guía práctica y estrategias de data storytelling, con Paula García Esteban. Posteriormente tendremos un momento de networking para discutir sobre la comunidad local de Power BI y terminaremos con unas #powercañas. ¡No te lo pierdas! #somospowerbi #comunidadParticipating in Data Challenge
သင့်အနေနဲ့ Data Analysis Challenge ပြိုင်ပွဲတွေမှာ ဝင်ရောက် ယှဉ်ပြိုင်ဖို့အတွက် အခက်အခဲ ဖြစ်နေပါသလား ဒီလိုဆိုရင်တော့ သင်တစ်ယောက်ထဲ အထီးမကျန်စေဖို့ Power BI Users Community ကနေ အစီအစဉ်လေး တစ်ခု ပြုလုပ်ထားပါတယ် အဲ့ဒါကတော့ လက်ရှိမှာ ပြိုင်ပွဲဝင်ရောက်ယှဉ်ပြိုင်ဖူးတဲ့သူတွေကနေ သူတို့ရဲ့ အတွေ့အကြုံတွေကို ပြန်လည် မျှဝေပေးမဲ့ Community Discussion အစီအစဉ်လေး ဖြစ်ပါတယ် See Details https://www.facebook.com/photo?fbid=235820446106050&set=a.224855370535891
