Fluxo e Caixa / Contas a Receber / Inadimplências
Originalmente desenvolvi esse dashboard para um cliente, integrado com SAP Hana e ambiente de Datawarehousing, troquei os dados e fiz uma versão de demonstração. Este dashboard consta com: Fluxo e Caixa: a comum tabela de fluxo e caixa com 4 opções de grão de data, além de páginas designadas apenas para recebimentos e pagamentos, além de opções de detalhamento. Contas a Receber: Análise temporal poderosa, insights prontos, formatação condicional, detalhamento em grande parte da página, comparação temporal, comparação com o que estava vencido, média de pagamento por cliente, média de atraso por cliente, análises com tooltips. Inadimplência: insights prontos, análise com foco no cliente, comparação temporal, análise de média de atraso, detalhamento em grande parte do dashboard, análises com tooltips. Além disso, a maioria dos visuais possui uma explicação do valor exibido ao parar com o mouse no visual e clicando no "?" que aparecerá. Quanto já foi pago? Quanto será pago? Quanto está vencido? Que títulos vencerão daqui 7 dias? Que títulos vencerão esse mês? Quem cobrar primeiro? Qual a média de atraso desse cliente? Qual o valor dos títulos desse cliente em média? Qual foi a última compra desse cliente? A quanto tempo está vencido esse título? Quais títulos estavam vencidos mês passado e foram pagos esse mês? Esse dashboard responde rapidamente essas perguntas e muitas outras.Ebola 2026 Outbreak Landscape
The 2026 Bundibugyo Ebola virus outbreak in the Democratic Republic of Congo is tracking rapidly to become the worst Ebola outbreak in history, even with vaccines currently in trials. I developed a simple report in Power BI to compare how deadly this strain is, compared to the biggest Ebola epidemic of 2014 in West Africa, and early COVID-19 globally. This report uses column charts, line charts, and a scatterplot to explore the risk landscape of the 2026 outbreak in its first 100 days. A few extra pages deep-dive into the 2026 outbreak to observe the growth of fatality rates and whether the outbreak is slowing down when viewed through a weekly rolling average. This analysis is first and foremost a data visualisation exercise, but it shows how serious Ebola outbreaks are. I hope the light at the end of the tunnel comes sooner. Many thanks to the good folks collating and managing the EVD 2026 data on GitHub.Consumer Financial Complaints Analytics
This project moved beyond simple reporting to deliver a structured, four-pillar analytical framework to understand, diagnose, and prescribe solutions for the consumer finance ecosystem. The Dashboard's Analytical Structure: Executive Snapshot: Volume, Trend, and Compliance. Objective: Provides an immediate, high-level view of the complaint landscape and overall system health (e.g., volume change, timely response rates). Root Cause Deep Dive: Product & Issue Drivers. Objective: Isolates the specific "what" and "why" behind the complaints (e.g., mortgages vs. credit reporting, and the specific issues within those products), allowing for targeted policy and product intervention. The 'Who': Company Accountability & Benchmarking. Objective: Compares company performance using metrics like "Substantiated Complaint Rate" and "Timely Response," identifying potential bad actors that require regulatory focus. Resolution Channels & Outcomes. Objective: A critical analysis of the resolution process. It answers: How timely and effective are company responses? Do outcomes differ based on the channel (Web, Phone, Mail) used for submission? Key Finding: By correlating submission channel and response speed (Page 4) with root cause (Page 2), the data reveals systemic bottlenecks that, if addressed, could dramatically increase resolution efficiency and strengthen consumer trust. This dashboard is designed to be an actionable regulatory intelligence tool. I'd welcome any feedback on the structure and analysis! eyJrIjoiOGM2OGFlN2YtZDY2MS00MDA3LTg3NjEtM2VmMjM5NWE4YzVlIiwidCI6IjkyNTcwMDE0LWZmM2QtNDAxMC04MTNkLTQxM2YwZmY5OWQ5MiJ9Model Explainability That Goes Beyond the Notebook for Data Science in Microsoft Fabric
A machine learning model can be remarkably accurate and still leave people completely unconvinced. That is one of the strange realities of working in data science. You can spend weeks cleaning data, testing algorithms, tuning parameters, and validating performance, only to reach the moment when somebody looks at a prediction and asks a very reasonable question: “Why?” Suddenly, accuracy alone does not feel like enough. A probability score might tell you what the model believes, but it does not necessarily help the person receiving that prediction understand how the model arrived there. That gap between prediction and understanding is exactly where model explainability becomes important. What you will learn: In this edition, we’re exploring model explainability in production and how SHAP, FastAPI, and Plotly can work together to make predictions easier to understand. By the time you’re done with this, you’ll have a clear view of how SHAP can explain individual model decisions, how those explanations can be served dynamically through an API, and how interactive visualizations can turn technical attribution values into something far more approachable. Source: Sahir Maharaj (https://sahirmaharaj.com) It is tempting to think of explainability as a chart you generate after training a model, but production explainability is really an ongoing capability. Every new observation can produce a different prediction, and every prediction may have a different explanation. A customer predicted to leave a service might receive a high risk score because of declining engagement, while another customer receives the same score because of repeated service issues. The prediction may look identical at the surface, but the reasoning behind it can be completely different. That difference matters when somebody needs to decide what to do next. This is where SHAP becomes particularly valuable because it gives you a structured way to describe feature contributions. Imagine a model predicting whether a machine is likely to fail. The prediction itself might tell you that failure risk is 82 percent. Useful, certainly, but incomplete. SHAP can help reveal that rising operating temperature, vibration intensity, and unusually long operating hours are pushing the prediction upward, while another factor such as recent maintenance is reducing the predicted risk. Suddenly the prediction becomes much easier to reason about. You still have a probabilistic model, but you also have something resembling an explanation of its behavior. As a data scientist, I find that this distinction between global and local understanding is especially important. During model development, I often want to understand the model globally. Which variables matter most overall? Is the model relying heavily on variables I expected it to use? Are there surprising relationships hiding in the data? In production, however, people often care about something much more specific. They want to know why this customer, this transaction, this machine, or this observation received the prediction it did. That is a local explanation, and SHAP is particularly useful for helping bridge that gap. Source: Sahir Maharaj (https://sahirmaharaj.com) You can think about the difference through a credit-risk example. Globally, a model might rely heavily on payment history, debt ratios, and income stability. That tells you something useful about the overall model. But suppose one applicant receives a higher risk prediction than expected. A general feature importance chart does not really answer the person's question. You need to understand what happened for that particular prediction. Perhaps the debt ratio increased the risk score significantly, while long-term employment reduced it. That level of explanation provides much more context than simply showing which variables matter across thousands of predictions. Explainability can also become an important debugging tool for you as the person building the model. Suppose a model performs well according to the metrics you are monitoring, but its explanations repeatedly show that one unexpected variable dominates many predictions. That should make you curious. import numpy as np import pandas as pd import shap import matplotlib.pyplot as plt from sklearn.ensemble import RandomForestClassifier from sklearn.model_selection import train_test_split np.random.seed(42) n = 800 X = pd.DataFrame({ "usage_drop": np.random.normal(20, 10, n), "support_calls": np.random.poisson(3, n), "login_days": np.random.randint(1, 30, n), "tenure_months": np.random.randint(1, 72, n), "monthly_cost": np.random.normal(80, 20, n) }) score = ( 0.08 * X["usage_drop"] + 0.45 * X["support_calls"] - 0.05 * X["login_days"] - 0.02 * X["tenure_months"] + 0.015 * X["monthly_cost"] ) y = (score + np.random.normal(0, 1, n) > np.median(score)).astype(int) X_train, X_test, y_train, y_test = train_test_split( X, y, test_size=0.25, random_state=42 ) model = RandomForestClassifier(n_estimators=150, random_state=42) model.fit(X_train, y_train) explainer = shap.TreeExplainer(model) values = explainer(X_test) class_values = values[:, :, 1] if values.values.ndim == 3 else values shap.plots.beeswarm(class_values, max_display=5) plt.show() shap.plots.waterfall(class_values[0], max_display=5) plt.show() Imagine that somebody submits new information to a prediction service. The model receives those features, processes them, and generates a result. If explainability is part of the design, the same interaction can also produce SHAP information describing the important factors behind that specific prediction. Instead of storing explanations for every imaginable case beforehand, you generate them when they are needed. FastAPI fits naturally into this kind of workflow because it gives the prediction and explanation process a consistent interface. Rather than another application needing to understand your model directly, it can send the required information to an API. The API can coordinate the prediction process, calculate the explanation, and return the relevant output. The application consuming the result does not need to know the mathematical details of SHAP or how the model itself works internally. It simply receives information in an agreed structure. That separation can make a production system much easier to manage. From what I observe when building data science workflows, this separation becomes valuable surprisingly quickly. During early experimentation, everything often exists together. Data preparation, prediction, explanation, and visualization may all happen inside one environment. That is perfectly reasonable when you are exploring an idea. Production introduces more responsibilities. The application requesting a prediction should not need access to the entire modeling environment, and your model should not depend on somebody manually generating explanations. Creating a clear service boundary helps each part of the system do its job without becoming unnecessarily tangled with everything else. Dynamic explanations also give you flexibility over how much information you return. A technical monitoring application may want detailed SHAP values for every available feature. A decision-support interface may only need the five strongest contributors. Another application may need a short summary explaining the strongest positive and negative influences. The explanation engine can be the same while the presentation changes according to the audience. That matters because explainability is not only a modeling problem. It is also a communication problem. Source: Sahir Maharaj (https://sahirmaharaj.com) Performance deserves careful attention here as well. Calculating an explanation adds work beyond producing the prediction itself, and depending on the model, the amount of additional work may not be trivial. That does not mean explanations should be avoided. It means you should think about when they are required. Some systems may need an explanation for every single prediction. Others may generate explanations only when a user requests additional detail. You might also decide that certain high-impact decisions always receive explanations while low-impact automated predictions do not. Production design is often about finding that balance between completeness and responsiveness. There is also an important consistency issue. An explanation is only useful if it corresponds to the exact model and transformation process that generated the prediction. Imagine updating your model but accidentally continuing to generate explanations using an older version. The results could look perfectly reasonable while describing behavior that no longer matches the prediction being shown. import numpy as np import pandas as pd import shap import plotly.graph_objects as go from sklearn.ensemble import GradientBoostingClassifier np.random.seed(7) n = 700 X = pd.DataFrame({ "temperature": np.random.normal(70, 12, n), "vibration": np.random.normal(4, 1.5, n), "operating_hours": np.random.normal(900, 250, n), "maintenance_days": np.random.randint(1, 120, n) }) risk = ( 0.06 * X["temperature"] + 0.7 * X["vibration"] + 0.003 * X["operating_hours"] - 0.025 * X["maintenance_days"] ) y = (risk + np.random.normal(0, 1, n) > np.median(risk)).astype(int) model = GradientBoostingClassifier(random_state=7) model.fit(X, y) explainer = shap.Explainer(model, X) row = pd.DataFrame([{ "temperature": 92, "vibration": 6.8, "operating_hours": 1250, "maintenance_days": 75 }]) prediction = model.predict_proba(row)[0, 1] explanation = explainer(row) names = row.columns.tolist() impacts = explanation.values[0] waterfall = go.Figure(go.Waterfall( orientation="h", y=names, x=impacts, measure=["relative"] * len(names), text=[f"{x:+.2f}" for x in impacts], textposition="outside" )) waterfall.update_layout( title="SHAP Explanation: What Drove This Prediction?", xaxis_title="SHAP Impact on Model Output", yaxis_title="Feature", height=450 ) waterfall.show() gauge = go.Figure(go.Indicator( mode="gauge+number+delta", value=prediction * 100, number={"suffix": "%"}, delta={"reference": 50}, title={"text": "Predicted Machine Failure Risk"}, gauge={ "axis": {"range": [0, 100]}, "steps": [ {"range": [0, 40]}, {"range": [40, 70]}, {"range": [70, 100]} ], "threshold": { "line": {"width": 4}, "thickness": 0.8, "value": prediction * 100 } } )) gauge.update_layout(height=400) gauge.show() pd.DataFrame({ "Feature": names, "Value": row.iloc[0].values, "SHAP Impact": impacts }).sort_values("SHAP Impact", key=abs, ascending=False) The third objective is turning those explanation values into something people can interpret without needing to understand every detail of SHAP. This is where visualization becomes more than decoration. Raw values can tell you exactly how features influenced a prediction, but they require effort to interpret. A Plotly visualization can organise those contributions so the strongest influences immediately stand out. Features pushing a prediction in one direction can be separated visually from those pushing it in the opposite direction, allowing somebody to understand the basic story of the prediction within a few moments. Imagine a customer churn model that predicts an unusually high probability of cancellation. A dynamic explanation might show that a recent drop in product usage is the strongest contributor, followed by repeated support contacts and a reduction in login frequency. At the same time, a long customer relationship might slightly reduce the churn prediction. That is much more meaningful than presenting a table containing feature names and decimal values. The visualization helps the reader understand not only which features mattered but also how they worked together. Source: Sahir Maharaj (https://sahirmaharaj.com) When I look at explanations intended for other people, I try not to assume that more information automatically creates more transparency. It is very easy to generate a detailed visualization containing dozens of variables simply because the values are available. The result may technically be comprehensive while being practically overwhelming. If somebody has to study a chart for several minutes before understanding the main message, the explanation probably needs refinement. In many situations, highlighting the strongest contributors and allowing additional detail to be explored when needed creates a much better experience. Interactivity can make this even more useful. Plotly allows explanations to become something people can investigate instead of merely observe. A user might hover over a feature to inspect the contribution more closely or compare several predictions to understand why similar observations received different results. Imagine comparing two loan applications that received different risk scores. An interactive explanation can make it easier to see that one prediction was strongly influenced by debt levels while another was affected primarily by inconsistent payment history. That comparison helps reveal how the model responds to different combinations of information. At the same time, visual polish should never become a substitute for clarity. A sophisticated interactive chart can create an impression of authority, and that means you have a responsibility to provide enough context around what the visualization represents. The user should understand that the chart explains the model's behavior, not necessarily the underlying truth of the real-world situation. If a feature makes a large contribution, that means the model relied heavily on that feature for the prediction. It does not automatically prove that the feature caused the outcome. Keeping that distinction clear is a major part of responsible model communication. Source: Sahir Maharaj (https://sahirmaharaj.com) So give it a try. Do not wait until you have a huge production system or a complicated machine learning platform before thinking about transparency. Start with one prediction, one explanation, and one clear visualization. Build from there as your understanding grows. The more comfortable you become explaining what your model is doing, the easier it becomes to recognise when its behaviour deserves a closer look. And that ability is valuable whether you are just entering data science or have been building models for years. If you ever need anything while exploring it, just reach out to me. I’ll be more than happy to help. Thanks for taking the time to read my post! I’d love to hear what you think and connect with you! 🙂 LinkedIn Kaggle Topmate (Free Power BI / Data Science Sessions and Resources) Website The Tech Journal (Blog) About the author Sahir Maharaj is a Lead Data Scientist who leads the design and deployment of end-to-end AI solutions that drive strategic decisions at scale. As a Microsoft MVP, he has been featured internationally, including in The Indian Express and on New York's Times Square billboards, and is a prolific content creator on LinkedIn.
Expose Data Agent schema, question interpretation, and generated query through MCP
I would like to request additional context and metadata capabilities for the Microsoft Fabric Data Agent MCP server. It would be very useful if the MCP server could expose more information about the Data Agent itself and how it processes a user's question. 1. Expose the Data Agent data schema It would be useful to retrieve through MCP the data schema available to the Data Agent, including information such as: Tables or semantic model entities Columns and fields Data types Relationships Measures Descriptions and metadata Other relevant schema information available to the Data Agent Ideally, this information could be exposed through a dedicated MCP resource or tool. This would allow an MCP client to understand what data the Data Agent has access to without having to maintain a separate copy of the schema. 2. Expose the interpreted or reformulated question It would also be very useful to retrieve information about how the Data Agent understood the user's question. For example: Original question: "How many customers did we lose last month?" Reformulated / interpreted question: "Calculate the number of customers who became inactive during the previous calendar month." If available, it would also be useful to expose structured information such as: Original user question Reformulated or normalized question Detected intent Relevant tables or entities Relevant columns or measures Filters and conditions identified from the question This would help developers understand how the Data Agent interpreted the request. 3. Expose the generated and executed query It would also be very valuable to expose the query generated by the Data Agent to answer the user's question. Depending on the underlying data source, this could include: SQL DAX KQL Other query languages supported by Fabric Data Agents For example, the MCP response or a dedicated MCP resource could expose: Query language: SQL Generated query: SELECT COUNT(*) FROM Customers WHERE ... Or: Query language: DAX Generated query: CALCULATE(...) It would also be useful to know: Which query language was selected The generated query The final query that was actually executed, if it differs The data source or semantic model targeted The tables, measures, or entities used by the query Execution status Query execution duration, when available Query errors or warnings, when applicable This information would be extremely useful for debugging, auditing, observability, and explaining how the Data Agent produced its answer. Why this would be useful Ideally, an MCP client could retrieve a structured execution context such as: Original question → Reformulated / interpreted question → Relevant schema and entities → Selected query language (SQL / DAX / KQL / etc.) → Generated query → Executed query → Result → Final Data Agent answer The goal is not to expose the model's private internal reasoning, but rather to expose the structured interpretation, generated query, schema context, and execution metadata that can safely be shared with the MCP client. These capabilities would make the Fabric Data Agent MCP server much more useful for building transparent, debuggable, auditable, and context-aware applications. Could Microsoft please consider exposing the Data Agent schema, structured question interpretation, and generated/executed queries through the MCP server?Real-time progress streaming for Fabric Data Agent MCP server
I would like to request true real-time progress streaming for the Microsoft Fabric Data Agent MCP server. Currently, when calling a published Fabric Data Agent through MCP using call_tool with a progress_callback, I receive progress events such as: analyze.database.fewshots.loading analyze.database.nl2code analyze.database.execute Message created However, these events are usually not delivered during the actual execution. For example, the request can take 15–20 seconds with no updates, and then several progress notifications arrive almost at the same time, immediately before the final response. It would be very useful if the Data Agent MCP server could emit and flush progress notifications incrementally as each step happens. Ideally, applications could display statuses such as: Understanding the question Generating the query Executing the query Processing the result Preparing the final answer This would allow developers to build a much better real-time user experience instead of showing only a loading indicator during long-running requests. The MCP transport already supports streaming and the client can receive progress notifications. The missing part appears to be real-time delivery of the Data Agent execution progress from the server. Could Microsoft please consider supporting true incremental progress streaming for the Fabric Data Agent MCP endpoint ?
Starting Data Science journey with Python - What is the next step after lists?
Hello everyone! I am a beginner starting my journey in Data Science. I have recently learned the basics of Python, including lists. Could anyone guide me on what I should learn next in Python for Data Science? Also, as a beginner, what is the best way to practice using Microsoft Fabric for Data Science? Thank you!Pizza Sales Report
Five business insights from data Most Pizza Selling In 16-20 Hours. Most Selling Large Pizza Name of Thai Chicken. At 8242, Friday Had the Highest Sum Of Quantity And Was 36.57% Higher Than Sunday, Which Had The Lowest Sum Of Quantity At 6035. Quarter 2 Has Increase Pizza Quantity. Quarter 4 Has Decrease Pizza Quantity eyJrIjoiOTA1OGYwZWYtMjVhNS00NTY0LTgzNmYtNGJhZWJkNGE1ZTViIiwidCI6ImJmYjZiODdiLTViODUtNDkxMS1hYWMxLTJkODIyMThiOGQ4ZCIsImMiOjl9ESG Risk Landscape Analysis
About the Report The ESG Risk Analysis for S&P 500 provides a data-driven assessment of Environmental, Social, and Governance (ESG) risks across leading U.S. companies. The report highlights key risk drivers, identifies high- and low-performing sectors, and evaluates company-specific exposures to ESG-related issues. Its purpose is to illuminate risk, inform action, and empower responsible leadership by integrating sustainability insights into decision-making. Key Insights: Overall ESG Risk: Most S&P 500 firms are in the Medium Risk range; a smaller group shows High or Severe risk, demanding urgent attention. Risk Components: Environmental: Elevated in Energy and Basic Materials sectors. Governance: Linked to board structure and shareholder rights. Social: Driven by labor practices, safety, and community impact. Controversies: Firms with High/Severe controversies record significantly higher risk scores. Sector Outlook: High Risk: Energy, Basic Materials, Consumer Cyclical. Lower Risk: Technology, Financials, Healthcare (with exceptions). Notable Companies: High Risk/Controversy: WFC, XOM, META, CAT. Low Risk/Controversy: XYL, WDC, WELL. Scale Factor: Large firms like Walmart and Amazon face elevated risks due to operational scale and workforce size. Benefits: Enhances transparency in corporate sustainability reporting. Enables data-driven ESG strategies and early risk mitigation. Builds investor confidence through responsible disclosure. Supports long-term value creation by linking sustainability with performance. Skills: Data Analytics · OpenAI GPT Agents · DAX · Microsoft Power BI · Data Modeling · Environmental, Social, and Governance (ESG) · SQL · Microsoft Azure · XGBoost eyJrIjoiZTZlOWQ0OTktZWRjYi00Nzc4LTllZjYtOTdiOWU3NzQxYmYyIiwidCI6IjkyNTcwMDE0LWZmM2QtNDAxMC04MTNkLTQxM2YwZmY5OWQ5MiJ9Fabric August 2026 Feature Summary
Welcome to the August 2026 Fabric update! Microsoft Fabric continues to evolve with new capabilities that help organizations build, manage, and scale their data and AI solutions more efficiently. This month's updates introduce enhancements across Fabric Platform, OneLake, Data Engineering, Conversational Analytics, Data Warehouse, Real-Time Intelligence, and Data Factory. Whether you're strengthening governance, improving performance, streamlining development workflows, or expanding AI-powered experiences, these updates are designed to help you get more value from your data while simplifying day-to-day operations. Explore the following highlights to see what's new in Microsoft Fabric this month. Events and Announcements Join us for FABCON and SQLCON in Barcelona, September 28 – October 1, 2026 Explore what’s possible with Microsoft Fabric and get up to speed on the latest in SQL, analytics, and AI. From 130 sessions and 4 keynotes to workshops, the expo, community spaces, and the Power BI DataViz World Championships, this is where the data community comes together. Learn directly from Microsoft and community experts shaping the future of Fabric and SQL. Register now and save €200 with code FABCMTY200. Fabric Platform KQL-Dashboard Embed in Fabric (Preview) A new capability that lets you add interactive KQL-Dashboard content directly into your own browser-based web applications is available. Now, you can bring Fabric analytics into the apps, portals, and workflows your users already use. Analytics are most useful when they are available where decisions happen. With Fabric Embed, you can place Fabric content inside a custom application or internal portal instead of requiring users to switch to the Fabric portal. Fabric Embed can help you: Bring interactive analytics into an existing business workflow. Explore Fabric analytics without switching between your application and the Fabric portal. Keep Fabric workspace permissions and Microsoft Entra ID identities at the center of access control. Build user-based embedded experiences for people who already have access to the underlying Fabric item. The embedded experience complements the Fabric portal. Content owners can continue to create and manage analytics in Fabric while application developers present that content in the context most useful to their users. To learn more, refer to the Microsoft Fabric Embed documentation. Git Integration – Workspace Relation API (Preview) Following our recent announcement of branch workspaces and the relationship that’s automatically created when a user performs a branch-out operation, we’re introducing the new Workspace Relations API. These endpoints let you create, query, update, and delete relationships between Fabric workspaces programmatically — and for anyone building automation around Git integration, branched workspaces, and CI/CD, it’s a big deal! The workflow is straightforward. A developer creates a feature branch. An ADO pipeline or GitHub Action then provisions a new feature workspace, configures Git, applies the right settings and permissions, and synchronizes the workspace. Finally, the Workspace Relations API links that feature workspace back to its parent — closing the loop and giving your automation a first-class, queryable connection between parent and branched workspaces. Figure: Branch workspace relation. To learn more, refer to Development process using Branch-Out experience. Git Integration and Deployment Pipeline – Item level permission restriction Starting December 1, 2026, users without read-write permissions on workspace items can't use Git integration and won’t be able to deploy a workspace or assign workspace to a stage via Deployment Pipeline. This restriction can result in loss of access to certain items because of sensitivity labels and protection policies applied to those items. To learn more, refer to Information Protection in Microsoft Fabric. OneLake Resource instance rules for OneLake (Generally Available) Resource instance rules for OneLake are ready for production workloads across enterprise analytics environments. They give workspace admins a precise way to allow access from trusted Azure resource instances while continuing to enforce network and data-level protections. Use resource instance rules when you need to enable secure service-to-service access to OneLake without relying solely on IP allowlists or requiring private networking for every integration. Combined with Private Link, IP firewall rules, and identity-based permissions, they help organizations apply layered security based on the needs of each workspace and workload. Resource instance rules support a broad set of Azure services that can present a verifiable Azure resource identity, including Azure Databricks, Azure SQL Server, Azure Data Factory, Azure Event Grid, Azure Machine Learning, and more. Configuration requires only the Azure resource ID, simplifying setup while maintaining control over which Azure resources can access OneLake. To learn more, refer to Manage inbound access to OneLake with Resource Instance Rules. Data Engineering Native Execution Engine performance improvements This month, we continued to improve the Native Execution Engine (NEE) with a new set of query execution optimizations designed to accelerate Spark workloads while reducing compute consumption. Key enhancements include broadcast joining reuse across queries, native acceleration for ranking window functions such as RANK and DENSE_RANK, and automatic materialization of reused Common Table Expressions (CTEs). Together, these optimizations eliminate redundant computation, keep more processing within the engine's vectorized execution path, and improve performance for common data engineering patterns including large joins, analytical reporting, ranking workloads, and complex transformation pipelines. Because these improvements are enabled automatically when NEE is available, customers benefit from faster execution times, lower Fabric capacity consumption, and improved price-performance without requiring code changes to existing notebooks, Spark Job Definitions, or pipelines. These optimizations are enabled by default once the Native Execution Engine is turned on, allowing customers to realize performance gains immediately without additional configuration or tuning. Customers can enable NEE at the workspace environment level by navigating to Environment > Acceleration and turning on Native Execution Engine, ensuring it is available for all Spark sessions using that environment. It can also be enabled at the session level by setting spark.native.enabled=true in Spark configuration. With NEE enabled, customers can seamlessly take advantage of the latest runtime innovations to process data faster, improve resource efficiency, and maximize the value of their Fabric capacity investments. To learn more about Native Execution Engine explore our documentation Native execution engine for Fabric Data Engineering. Fabric Runtime 2.0 (Generally Available) As the execution foundation for Microsoft Fabric's Data Engineering and Data Science experiences, Runtime 2.0 delivers a modern, high-performance platform built on Apache Spark and deeply integrated across the Fabric ecosystem. Purpose-built for large-scale data processing and analytics workloads, Runtime 2.0 represents a major advancement in performance, reliability, security, and future readiness. Built on the latest open-source innovations, it enables customers to accelerate data processing, simplify operations, and take advantage of the newest capabilities across Microsoft Fabric. This release includes significant platform upgrades, including Apache Spark 4.1, Delta Lake 4.2, Python 3.13, Java 21, Scala 2.13, and Azure Linux 3.0, providing a modern and enterprise-ready foundation for the next generation of data engineering, data science, and analytics workloads. These enhancements enable customers to take advantage of the latest open-source innovations while continuing to benefit from a fully managed, enterprise-grade experience in Microsoft Fabric. Whether you're building data pipelines, developing AI and machine learning solutions, processing streaming workloads, or powering enterprise analytics, Runtime 2.0 provides a more capable, scalable, and performant platform for your workloads. With improved performance, updated open-source foundations, and continued investment in capabilities such as the Native Execution Engine, Runtime 2.0 provides a modern platform for data engineering, data science, and analytics workloads in Microsoft Fabric. Explore the full documentation and start using Runtime 2.0 in production Runtime 2.0 in Fabric. Enhanced Spark Properties Support in Notebook and Spark Job Definition Notebook and Spark Job Definition (SJD) activities now enable users to specify Spark properties directly within the data integration pipeline. This enhancement allows Spark properties to be set inside the activity panel, ensuring that the values provided are used for activity execution. If an Environment item is linked to the Notebook or SJD and both the activity panel and Environment item define the same property, the value specified in the activity panel will take precedence and overwrite the Environment value. In the case of Notebooks, if the %%configure command is used within the notebook code to set a Spark property, the value set using %%configure will be applied for execution. This update offers users maximum flexibility, allowing Spark properties to be defined at different layers based on their specific use cases. By supporting property configuration in the activity panel, Environment item, and notebook code, users can tailor property values to meet the unique requirements of each execution of Notebook/SJD. To learn more on Transform data by running notebook and Transform data by running a Spark Job Definition activity. Conversational Analytics Enhanced Data Agent Visualizations with Fabric Visuals The data agent now uses Fabric visuals to render the charts it returns, bringing higher-quality, more consistent visualizations into your conversations with your data. When you ask a question like "Generate a bar chart of revenue by region" or "Show me my top 10 customers by sales," the data agent responds with an interactive, polished visual alongside its text and table answers, so you can spot trends, comparisons, and outliers. Because the data agent now shares the same visual foundation as Fabric Apps, charts look and behave consistently with AI-generated visuals in Fabric, with refinements to formatting, legends, tooltips, and axis scaling. Supported chart types include line, bar, stacked bar, pie, scatter, and area charts. To learn more, refer to the Get visual responses from a Fabric data agent documentation. Advanced DAX Generation for Semantic Models in Data Agents Advanced DAX generation for Power BI semantic models is now available in Fabric data agents when you use the Preview runtime. Instead of generating a DAX query in a single pass, the new system works iteratively as a specialized sub-agent that can use tools, inspect results, and refine its approach across multiple steps, providing significant improvements in response accuracy. It also uses instance value indexing to resolve values from the semantic model before generating a query, resulting in more accurate and reliable filters. This update is built on the same semantic-model query engine used across Fabric Skills, Power BI, and M365 Copilot, providing more consistent answers across Microsoft experiences. To use the new experience, open the Runtime dropdown in the data agent ribbon and switch from Standard to Preview. More improvements for semantic models in data agents are coming soon, including data source description and instructions, granular schema selection, and example queries. In the Preview runtime, the data agent uses advanced DAX generation to answer a question over a connected semantic model, enabling more accurate DAX generation and responses. To learn more, refer to the Semantic model best practices for data agent documentation. Data Agent orchestrator upgraded to GPT 5.1 The data agent orchestrator now runs on GPT-5.1, across both the standard and preview runtimes. The orchestrator handles how questions are rephrased, how work is planned across your data sources, and how the final answer is composed — so this upgrade changes behavior in all three. Most of what you see should be an improvement in answer quality and planning, but the change is not behavior-neutral: prompts tuned against the previous model may produce different results. We recommend re-running your evaluations, reviewing the results against your saved baselines, and updating your agent instructions and prompts where the new behavior doesn't match what your scripts expect. To learn more, refer to the data agent runtimes documentation. Example Query Usability Improvements in Data Agent We've made several usability improvements, for example queries. Errors now surface inline, directly alongside the query, so you can identify and correct issues without leaving the editor. The editor also resizes automatically based on the length of your query, removing the need to adjust the pane manually as you write. To learn more, refer to the example queries in data agent documentation. Add Schema Descriptions for SQL Sources in Data Agent Users can now provide tailored schema descriptions through the new schema description editor, available for SQL sources on the Preview runtime. Schema descriptions improve query generation and accuracy by giving the agent more context about what everything in your data means — use them to resolve ambiguous columns, or to give a table or field a more precise meaning than its name conveys. Instead of inferring intent from column names alone, the agent works from what your data team documented, so it selects the right tables and interprets fields the way you intended. To learn more, refer to the schema descriptions documentation. Data Agent is migrating from Assistants API to Responses API The OpenAI Assistants API that powers the orchestration layer for the Microsoft Fabric data agent, is currently scheduled to be shut down by OpenAI on August 26, 2026. After that date, direct calls to the Assistants API will stop working. If you connect to a Fabric data agent programmatically through the Assistants API, you need to migrate to the data agent Model Context Protocol (MCP) endpoint. SDK and Fabric portal users require little or no action because Microsoft will migrate those experiences internally, although conversation history may reset once. Existing agent data sources, instructions, and tools remain unchanged. To learn more, refer to Prepare your Fabric Data Agent integrations for Assistants API retirement. Fabric Data Agents in Microsoft Copilot Studio (Generally Available) Now, you can bring governed business data from Microsoft Fabric into Copilot Studio agents, so those agents can answer questions and support business processes using trusted enterprise data. Since preview, the integration has moved to the new tool-based experience: select Add a tool, search for Fabric, and add Fabric IQ Data MCP, and your agent can call the Fabric data agent like any other tool. The Fabric data agent still runs in Fabric and respects permissions on the underlying data sources. You can also publish your agent to Microsoft Teams and Microsoft 365 Copilot, so business users get data-grounded answers where they already work. To learn more, refer to the Fabric Data Agent MCS GitHub documentation for setup steps and join the community discussion to share feedback. Fabric data agents in Microsoft Foundry: Easier to connect, easier to trust Fabric data agents in Microsoft Foundry are now easier to connect and easier to monitor. The integration moves to Model Context Protocol, so your Fabric data agents appear as tools that Foundry agents can invoke when they need enterprise data in OneLake. Connecting them no longer means hunting for workspace and artifact IDs. You add the Fabric IQ (OneLake Catalog) tool, filter for data agents, and pick the ones you want by name. You can also connect more than one Fabric data agent to a single Foundry agent, so an agent can draw on a sales agent, a supply chain agent, and a customer support agent and choose the right one for the question. On the operations side, you can now view logs and traces for Fabric data agents through Foundry Observability. Traces show which tools were invoked, how long each step took, and what came back, which makes it much easier to troubleshoot an answer that looks wrong or a workflow that runs slow. This is the visibility teams need to move agents from experiments to production. The update is rolling out to all regions over the coming days. Add Fabric data agent as part of Fabric IQ to your Foundry agent. To learn more, refer to the Observability for Fabric data agents in Microsoft Foundry documentation. Add co-publishers for data agents in Microsoft 365 Copilot When you publish a Fabric data agent to Microsoft 365 Copilot, the Microsoft 365 agent platform registers the agent and records you as its only owner. That created a problem for teams. Your co-creators could still edit the data agent in Fabric, but when they tried to republish it, the operation failed, because Microsoft 365 only lets registered owners publish. Fabric access and Microsoft 365 ownership are two separate lists, so giving someone edit rights in Fabric was never enough. Now, you can avoid this with co-publishers. After you publish the data agent, open Settings, go to the Publishing pane, and add your Fabric co-creators under Microsoft 365 Copilot co-publishers. Each person you add is registered as a co-owner on the Microsoft 365 agent platform, so anyone on that list can republish the agent. Add co-publishers right after your first publish so no one hits a failure in the meantime. Publishing pane in the Fabric data agent settings, showing where you add Microsoft 365 co-publishers. To learn more, refer to the Consume a data agent from Microsoft 365 Copilot (preview) documentation. Data Warehouse Identity columns with identity insert (Generally Available) Since preview, thousands of customers have adopted IDENTITY to auto-generate surrogate keys and streamline migrations from SQL Server, Azure SQL Database, and Azure Synapse. Now we're introducing support for IDENTITY_INSERT and reseed operations - two highly needed additions - so you can insert explicit key values, migrate data in bulk with COPY INTO, and safely realign identity ranges with DBCC CHECKIDENT. Figure: Using identity insert on Fabric Data Warehouse. IDENTITY columns are available now in every Fabric Data Warehouse. To learn more, check our updated tutorial and documentation. CI/CD 2.0 with DacFx (Preview) Microsoft Fabric Data Warehouse is introducing a major update to the DacFx engine that powers schema comparison, Git integration, and deployment pipelines. DacFx builds a declarative model of your warehouse and determines the schema changes required to move safely between development, test, and production environments. Git-integrated CI/CD workflow for Microsoft Fabric, showing feature workspace synchronization, branch merging, and deployment pipeline promotion across development, test, and production workspaces. With this update, Git integration uses DacFx-based incremental extraction to produce cleaner, more focused commits. Deployment pipelines also use the updated model to generate more accurate comparisons and smarter deployment plans, with settings tuned for schema evolution. The new warehouse item definition version 2.0 updates the SQL project SDK, moves shared queries into a .sharedqueries folder, adds project-level Git configuration, and re-extracts object definitions to support constraints, identity columns, clustering, and consistent formatting. These changes make future commits easier to review and reduce noisy diffs. For more information, refer to the Upgrade Fabric Data Warehouse System File Version in a Git Integrated Fabric workspace documentation. Microsoft Fabric source control notification prompting users to apply the latest Warehouse system update, with a warning that the update will introduce differences between the workspace and its connected Git repository. The update also improves comparison accuracy. Git-connected workspaces can adopt the update when ready through the System update available experience, giving teams control over upgrade timing. Review and commit the generated changes before continuing normal development and deployment workflows. To learn more, refer to the Development and Deployment Overview documentation. Simplify Fabric Warehouse deployments with Schema Compare in VS Code Database deployments should not feel like a guessing game. With Schema Compare in Visual Studio Code, developers can see exactly what changed before those changes reach a Fabric Warehouse—bringing clarity and control to every release. Compare a Fabric Warehouse with another warehouse or a SQL database project, then review differences across tables, views, stored procedures, functions, and other database objects in a clear, object-by-object view. Choose the changes you want, update the project from the warehouse, or deploy selected changes to the target—without manually assembling and reviewing every deployment script. By keeping database projects synchronized in Git, teams gain a reliable source of truth and can bring schema changes into familiar pull-request and CI/CD workflows. The result is a safer, more intentional path from development to production, with fewer surprises at deployment time. Before applying changes, review the generated script for unsupported operations and potential data loss. To learn more, refer to the Develop warehouse projects in Visual Studio Code and Schema Compare in the MSSQL extension documentation. GPU Query Acceleration (Preview) Query Acceleration brings GPU-powered performance directly to Fabric Data Warehouse, enabling eligible analytical queries to run faster without query rewrites, special syntax, or additional systems to manage. Query Acceleration in Fabric Data Warehouse uses GPUs to accelerate the most compute-intensive portions of analytical queries, helping overcome the limits of CPU-only execution. It works transparently with existing T-SQL, Direct Query reports, applications, and tools, automatically offloading eligible operations such as scans, filters, joins, and aggregations to GPUs while the CPU continues to manage the rest of the execution pipeline. Customers can use Query Insights, Data Warehouse Monitoring, and SQL Server Management Studio (SSMS) for query execution plans to identify accelerated queries and understand how Query Acceleration is applied during query execution. Designed for analytical and high-concurrency workloads, Query Acceleration can improve throughput, reduce query latency, and deliver more consistent performance for dashboards and interactive analytics. Acceleration is applied selectively, enabling performance gains even when only part of a query is eligible for GPU execution. The capability is built with reliability in mind. Unsupported operations or runtime constraints can seamlessly fall back to CPU execution without affecting query correctness. Performance improvements depend on workload characteristics, but Microsoft benchmarks have demonstrated gains of up to 7× across reporting, application, and AI-driven analytics scenarios. Query Acceleration builds on Microsoft's Tensor Query Processor research, described in CoddSpeed: Hardware Accelerated Query Processing in Microsoft Fabric, which was selected as the SIGMOD Companion 2026 Best Industry Paper. To sign up for the Preview, please fill out the form. Metadata Sync supports Delta Checkpoint V2 (Generally Available) Metadata Sync (MD Sync) now supports Delta Checkpoint V2, enabling synchronization of modern Delta tables across both MD Sync (Legacy) and MD Sync (New). Delta Checkpoint V2 is a Delta Lake enhancement designed to improve scalability for large tables through a more efficient checkpoint structure. Previously, tables using Checkpoint V2 couldn't be synchronized and were reported as unsupported. With this release, MD Sync can discover and synchronize Delta tables that use the Checkpoint V2 format. This enhancement helps customers: Synchronize Delta tables that use Checkpoint V2. Improve interoperability with Spark, Databricks, and other Delta-based platforms. Support metadata synchronization for large-scale Delta tables more efficiently. Continue using existing checkpoint formats without any changes. MD Sync support for Delta Checkpoint V2 is available in both MD Sync (Legacy) and MD Sync (New), helping ensure consistent access to Delta tables across Fabric experiences. Secure data ingestion with COPY INTO and Workspace Identity (Generally Available) COPY INTO in Fabric Data Warehouse now supports Workspace Identity, enabling users to load approved data from OneLake or ADLS Gen2 without requiring direct access to the source files. Previously, ingestion users often needed permissions to both the target warehouse and the source storage location, or teams relied on SAS tokens, account keys, or service principals. With this release, source access can be centrally assigned to the workspace identity, while users retain only the SQL permissions required to load data into the target table. Key Capabilities: Load approved data without granting users direct access to raw storage. Use managed identity-based authentication for OneLake and ADLS Gen2 sources. Reduce reliance on SAS tokens, shared keys, and service principal secrets. Maintain separate authorization boundaries for source access and target-table permissions. Support least-privilege ingestion and separation of duties between storage and warehouse administrators. Workspace Identity support for COPY INTO is generally available in Fabric Data Warehouse, providing a simpler and more governed approach to secure data ingestion. To learn more, refer to the Ingest Data into Your Warehouse Using the COPY Statement and COPY INTO (Transact-SQL) documentation. SQL Audit Logs: More Signal, Less Noise with Predicate Filtering (Generally Available) SQL Audit Logs in Fabric Data Warehouse and SQL Analytics Endpoint now support identity-based predicate exclusion filtering, enabling administrators to reduce repetitive audit events generated by selected users and service principals. Previously, expected activity from automation identities, scheduled processes, metadata synchronization jobs, and other operational actors could create significant audit noise. With this release, administrators can configure exclusions through the API or SQL Audit Logs user experience, while activity from identities that do not match the exclusion predicate continues to be audited normally. Key Capabilities: Reduce repetitive audit events from known users and service principals. Focus investigations on higher-value and unexpected activity. Lower the storage, processing, export, and query burden associated with low-value events. Manage identity exclusions through either automated APIs or the user experience. Apply a governed audit policy aligned with organizational monitoring and compliance requirements. Identity-based predicate exclusion filtering is generally available for SQL Audit Logs in Fabric Data Warehouse and SQL Analytics Endpoint, providing a cleaner audit stream, less operational overhead, and more focused investigations. To learn more, refer to the SQL Audit Logs in Fabric Data Warehouse documentation. OneLake security improvements for SQL analytics endpoints (Generally Available) OneLake Security for SQL analytics endpoints now includes improvements for nested groups, shortcut-backed tables, column-level security, and service principals, enabling more consistent enforcement of OneLake security policies across enterprise Fabric environments. Previously, limitations with group expansion, shortcut scenarios, and service principal ownership could make centralized security difficult to apply at scale. With these improvements, customers can define security at the source lakehouse and rely on the SQL analytics endpoint to honor those policies across producer and consumer workspaces. Key Capabilities: Manage access through nested Microsoft Entra group hierarchies. Honor source-side OneLake Security policies for shortcut-backed tables in hub-and-spoke architectures. Apply column-level security consistently when users receive access through groups. Use service principals for automated deployments, pipelines, and application-owned data products, including service principal-owned lakehouses. Define security once in OneLake and reduce the need to duplicate permissions across consumer workspaces and Fabric engines. These OneLake Security improvements help make security synchronization more practical for enterprise architectures while providing consistent access control across lakehouses and SQL analytics endpoints. Microsoft is also continuing to improve security sync notifications, error handling, and permission propagation across Fabric experiences. To learn more, refer to the OneLake Security for SQL analytics endpoints documentation. Real-Time Intelligence Set Alerts Directly from Anomaly Detector (Generally Available) Detecting anomalies becomes more valuable if you can act on them. Previously, after publishing an anomaly detector configuration, you had to leave Anomaly Detector and navigate to Real-Time Hub to create an alert. This added extra steps and interrupted your workflow right after completing your configuration. With this update, you can now create alerts directly from Anomaly Detector. Once you publish a configuration, use the Set alert button in the ribbon to launch the alert creation pane without leaving Anomaly detector. If your configuration hasn't been published yet, you'll be guided through publishing first and then taken directly to the alert setup experience. This helps you move seamlessly from configuring anomaly detection to monitoring it in production. The integrated experience allows you to monitor your anomalies on each event, helping you get notified as soon as anomalies are detected. If you have more complex business logic, select on each event when to add in additional logic to your conditions. Whether you're monitoring operational metrics, business KPIs, or real-time telemetry, you can now complete the entire workflow in one place and start acting on detected anomalies faster with fewer clicks. Create alerts directly from your anomaly detector configuration and continue your workflow without navigating to another experience. Configure notifications for anomaly detector events directly within Anomaly Detector and start monitoring your published configuration immediately. Anomaly detector supports Eventhouse shortcut tables Anomaly Detector now supports Eventhouse shortcut tables, making it possible to analyze data without first copying or moving it into a dedicated Eventhouse table. You can create anomaly detectors directly on supported shortcut tables and use the same analysis, model recommendations, and continuous monitoring experiences available for native Eventhouse data sources. This expands anomaly detection to a broader range of data already connected through Eventhouse shortcuts, helping teams monitor external and federated data sources with less setup and duplication. By enabling anomaly detection directly on shortcut tables, you can move more quickly from connecting data to detecting issues, while continuing to work within a unified Real-Time Intelligence experience. To learn more, refer to the Anomaly Detection in Real-Time Intelligence documentation. Operations Agent Activity Log Understanding what your agent is doing and why is key to building trust and improving outcomes. The activity log is designed to provide that transparency. It gives you a clear view into the agent’s behavior, including the conditions it evaluated, the recommendations it generated, and how those recommendations were handled. Whether you are validating results, troubleshooting unexpected behavior, or refining your configuration, the activity log helps you better understand how decisions are being made. You can access the activity log from the Activity log section in the side navigation. It presents a chronological timeline of events with timestamps and relevant context for each entry. Selecting any event allows you to explore additional details and understand what happened at each step. In the Operation details page, you can view the operation details and status. To learn more, refer to the Create and Configure Operations Agents documentation. Eventstream MQTT connector (Generally Available) It is now easier than ever to ingest real-time data from MQTT brokers directly into Microsoft Fabric Real-Time Intelligence. MQTT is one of the most widely adopted messaging protocols for lightweight, low-bandwidth event driven messaging scenarios. Eventstream MQTT connector simplifies the ingestion of operational and IoT data into Microsoft Fabric, helping organizations turn real-time device events into actionable insights. Key Benefits: Connect to any MQTT broker and ingest messages directly into Fabric Eventstream. Production-ready reliability and support with General Availability readiness. Enterprise-grade security with support for TLS, mutual TLS (mTLS), and custom certificate authorities managed through Azure Key Vault. Private network connectivity through Eventstream's streaming connector virtual network capabilities, enabling secure access to brokers hosted in private and on-premises environments. To learn more, refer to the Add MQTT source to an eventstream documentation. Reference data enrichment in Eventstream (Preview) Eventstream now enables you to enrich real-time event streams with contextual business data using Reference Data Join. Simply add a Reference Data node to your Eventstream, select a Delta table from a Fabric Lakehouse, and use it to enrich streaming events with lookup, metadata, or reference information. You can also leverage Lakehouse shortcuts to access Delta tables across OneLake, making it easy to bring contextual data from anywhere in your Fabric environment into your real-time processing pipelines. Reference Data Join supports both no-code and SQL-based enrichment experiences. Use the built-in Join operator to visually configure INNER and LEFT OUTER joins or use the SQL operator for advanced scenarios. Select only the columns you need from the reference dataset and configure optional refresh intervals to keep slowly changing reference data up to date. This enables Eventstream to continuously use the latest lookup information for real-time enrichment, without requiring additional data movement or downstream processing pipelines. You can easily add multiple reference data sources to a single Eventstream and combine them with streaming data to create richer, more contextual event pipelines. Developers and data engineers can test and validate join conditions, preview join results, and verify SQL-based enrichment queries before deploying them into production, helping ensure accuracy and confidence in real-time data processing workflows. Reference Data Join unlocks powerful real-time enrichment scenarios in Eventstream. Users can enrich IoT telemetry with device metadata, correlate operational events with customer and product information, perform lookups against business reference datasets, and add contextual information to streaming data in flight. By bringing reference data and event processing together in a single experience, Eventstream enables customers to transform raw events into actionable business insights in real time. To learn more, refer to the Reference data join in Eventstream using Lakehouse documentation. Eventstream observability in Workspace Monitoring re-enabled with per-Eventstream control (Preview) Eventstream observability in Workspace Monitoring is back — now with granular control over which Eventstreams emit monitoring data. A new ‘Log Eventstream activity’ toggle in Eventstream Settings lets you enable or disable observability per Eventstream, so you can balance monitoring coverage with capacity consumption. When enabled, your Eventstream emits performance metrics, error counts, and health status to three tables in your Workspace Monitoring Eventhouse: EventStreamMetrics: throughput, backlog, and watermark delay EventStreamErrorMetrics: deserialization, conversion, and runtime error counts EventStreamNodeStatus: node health (Running / Failed) The toggle defaults to OFF for all Eventstreams. To get started, open any Eventstream, go to Settings, and turn on Log Eventstream activity. Your monitoring data will appear in the Workspace Monitoring database within minutes. Eventstream activity" within Monitoring. The panel highlights an active toggle switch, a description explaining that enabling this feature emits performance and error metrics to a monitoring database. To learn more, refer to the Monitor Eventstream data flows in Workspace Monitoring documentation. Eventstream UI editor improvements (Preview) We've redesigned key parts of the Eventstream editor to make building and troubleshooting faster and more intuitive. Always Publish: No more blocked publish buttons. Publish your work at any stage, the editor gives you clear, contextual guidance on what still needs attention instead of preventing you from moving forward. Inline error indicators: Errors now appear directly on the node that needs fixing, with actionable guidance on click. No more hunting through a detached error list to find what's broken. Operator and destination descriptions: Each option now includes an inline description explaining what it does, so you can build confidently without switching to docs. These changes reduce friction during authoring and make it easier to go from idea to running your pipelines. Secure Azure Event Hubs Connections in Eventstream with Workspace Identity (Preview) Bringing real time event data into Microsoft Fabric is now simpler and more secure with Azure Event Hubs integration for Eventstream. Organizations can connect Event Hubs directly to Eventstream and start routing event data to destinations such as Eventhouse for analytics and operational insights. A key capability is Workspace Identity, which removes the need to manage shared access keys. Instead, Eventstream can authenticate to Azure Event Hubs using the Fabric workspace identity. Administrators simply grant the workspace the Azure Event Hubs Data Receiver role, enabling secure access through Microsoft Entra based permissions. This approach improves security, simplifies credential management, and aligns with enterprise governance requirements. The integration supports both public and private network deployments. For Event Hubs hosted in private networks, organizations can connect through a streaming virtual network gateway while continuing to use Workspace Identity for authentication. For advanced event processing scenarios, users can enable schema support, associate schemas from the event schema registry, and route structured events to destinations such as Eventhouse. Combined with Workspace Identity, this provides a secure and scalable foundation for building real time data pipelines without the operational overhead of managing secrets or credentials. Schema Registry and Event SchemaSet Region Availability Previously, Schema Registry feature and the Event SchemaSet artifact was available for preview in 31 regions. Expanded to 10 additional regions: Geography Region Americas Central US Americas Mexico Central Americas West US 3 Europe Italy North Europe Poland Central Europe Spain Central Europe West Europe Asia Pacific Australia Southeast Asia Pacific Israel Central Asia Pacific Japan West If you were previously blocked from trying SchemaSets and schema-based Eventstream data ingestion, you can now do so in these regions. For more information on Event SchemaSets and how you can create and manage them, visit Schema Registry Overview. To learn more about configuring Eventstreams with schema-based sources, visit Use schemas in Eventstreams. Data-driven styling and UX improvements for Maps (Generally Available) Maps become most valuable when they help users understand not just where things are, but what the data means. Now, Data-Driven Styling, along with Markers Rotate by Data, Traffic Flow visualization, additional Map View options, and an improved Layer Settings experience. Together, these enhancements help organizations transform raw geospatial data into intuitive, actionable business insights. Let Your Data Tell the Story Understanding patterns hidden within geographic data can be challenging when every feature on a map looks the same. With Data-Driven Styling, Fabric Maps enables map builders to visually represent business data directly on the map, helping viewers quickly identify trends, hotspots, and outliers without inspecting individual records. The new Color by Value Range capability allows authors to style map layers using numeric measures such as revenue, utilization, sensor readings, environmental measurements, or operational KPIs. Instead of applying a single color to an entire layer, Fabric Maps visualizes value distributions chromatically, making important differences immediately visible. Organizations can choose between two visualization approaches: Gradient Styling uses continuous color transitions to reveal magnitude, trends, and geographic variation across a dataset. Step-Based Styling allows users to define custom value ranges with distinct colors, making it easy to visualize business thresholds, risk levels, performance bands, or service categories. To make these visualizations easier to interpret, Fabric Maps automatically generates corresponding data legends that explain how colors map to underlying values. This helps viewers understand the meaning behind the visualization and make decisions with greater confidence. Fabric Maps also includes thoughtfully designed color palettes, including options that support colorblind-friendly visualization scenarios, helping more users accurately interpret map-based insights. Combined with clear, automatically generated legends, these capabilities improve accessibility and make data-driven maps easier to understand across a wider range of audiences. per street and road and high-value exposure in flood-prone areas. Visualize Direction and Movement with Markers Rotate by Data Many operational scenarios involve not only location but also direction. Fabric Maps now supports Markers Rotate by Data, allowing marker symbols to automatically rotate based on values stored in a data column. This capability is available for Marker layers, enabling builders to visualize directional information directly on the map. Whether visualizing aircraft headings, vehicle movements, equipment orientation, or other operational workflows, map authors can represent direction without requiring custom visualization development. By transforming static points into directional indicators, organizations can add valuable operational context and communicate movement patterns more effectively. Add Real-World Context with Traffic Flow Visualization Location data alone doesn't always tell the full story. Fabric Maps now supports Traffic Flow overlays, allowing map builders to bring current traffic conditions into their existing map experiences. By combining business data with real-world traffic information, organizations can gain additional situational awareness for logistics operations, field service planning, transportation monitoring, and operational decision-making. The added context helps users better understand the environment surrounding their assets and activities without leaving the map experience. Configure the Right Map View for Your Audience Organizations often create maps for users across different regions and business contexts. Fabric Maps introduces additional Map View settings that allow map builders to configure how geographic information is presented, helping ensure maps are displayed in a way that aligns with organizational needs and audience expectations. This flexibility gives authors greater control over creating a consistent and intuitive viewing experience across a variety of business scenarios. A More Discoverable Authoring Experience UX research and user feedback showed that some key layer settings were difficult to discover. We updated the experience by moving geometry and visualization options—including visual type, Data-Driven Styling, and marker rotation—higher in the configuration pane. We also renamed General to Visibility, making the settings clearer and map authoring more intuitive. Turn Location Data into Business Insight Data-Driven Styling, built-in data legends, Markers Rotate by Data, Traffic Flow overlays, enhanced Map View options, and the improved Layer Settings experience help organizations transform location data into meaningful business insight. Together, these capabilities make it easier to uncover patterns, understand operational context, and communicate geospatial insights across teams. Start building with these capabilities today: explore the customization options, apply them to your own geospatial data, and create map experiences that turn location into action. To learn more, refer to the Customize a map in Microsoft Fabric documentation. Workspace Outbound Access Protection (OAP) for Operations Agent (Preview) Workspace Outbound Access Protection (OAP) in Microsoft Fabric helps admins secure outbound connections from workspace items to external resources. Admins can control outbound access by blocking unwanted connections by default and allowing only approved connections through configured rules. As organizations adopt AI-powered operations at scale, governance and security remain critical requirements. With this preview release, Microsoft Fabric introduces Outbound Access Protection (OAP) for Operations Agent, enabling workspace administrators to control the outbound actions an agent can perform. OAP applies workspace-level policies to actions such as Teams notifications, workflow triggers, and cross-workspace operations, helping organizations enforce security and compliance requirements while continuing to benefit from AI-driven automation. When OAP is enabled, Operations Agent continues to perform core functions including reasoning, recommendation generation, rule evaluation, and telemetry collection. However, outbound actions are governed by the workspace's configured access policies. Administrators gain greater visibility through in-product notifications, Teams messaging experiences, and the Operations Agent Activity Log, making it easier to identify and troubleshoot blocked actions What's new with Operations Agent and OAP? Govern outbound agent actions through workspace-level OAP policies. Control whether Operations Agent can send Teams notifications based on allowed connections. Prevent unauthorized cross-workspace actions when OAP policies restrict outbound access. Receive clear visibility when actions are blocked through in-product notifications and Teams messaging experiences. Monitor agent activity and OAP-related outcomes through the Operations Agent Activity Log. During the preview, some limitations apply. Cross-workspace actions are blocked when OAP is enabled. For example, Power Automate actions are not yet supported when OAP is applied, and only connectors that explicitly support OAP policies can be permitted. By extending Fabric's outbound governance framework to Operations Agent, organizations can adopt AI-powered operational automation with greater confidence while maintaining control over how and where agent-initiated actions are executed. Resources Workspace outbound access protection for operations agent (preview) Workspace Outbound Access Protection (OAP) Workspace Outbound Access Protection for Operations Agents Configure and manage Activator rules directly in Eventstream (Generally Available) You can now create and manage rules directly in Eventstream. Previously, setting up an alert required switching from Eventstream to Activator. While powerful, this meant moving between experiences to complete a single workflow. Now, alert creation is embedded directly into Eventstream. Capabilities for building or editing your Eventstream: Select the stream you want to monitor. Choose Set Alert. Define your condition (thresholds, aggregations, patterns). Configure the action. Create the rule. Capabilities for Activator destination created on Eventstream: Select Activator node Select Rule icon Create the rule Once you have the rule(s) created on your Eventstream, you can manage them by editing, deleting or opening in Activator. To learn more, refer to the Add a Fabric activator destination to an eventstream documentation. Data Factory Introducing Hierarchical Navigation in Monitoring Hub for Fabric Pipelines Modern data estates rarely consist of a single job running in isolation. Pipelines trigger notebooks, notebooks invoke other workloads, and business processes span multiple interconnected executions. When troubleshooting a failure or understanding lineage, customers often need visibility into how these executions relate to one another. Hierarchical Navigation in Monitoring Hub, is a new capability that helps you understand the relationships between runs and quickly navigate across upstream and downstream executions. With Hierarchical Navigation enabled, Monitoring Hub can display: Upstream runs that initiated a workload Downstream runs triggered by a workload Execution relationships across supported Fabric artifacts This provides a richer observability experience by helping you move beyond individual run monitoring and understand how your workloads operate together. This enhancement is another step toward a richer observability experience in Fabric, helping customers gain deeper insight into workload execution and dependencies at scale. To learn more, refer to the Hierarchical Navigation for Pipelines in Monitoring Hub documentation. Explore the modern Fabric Pipeline canvas (Preview) The new Fabric Pipeline canvas experience is designed to make pipeline authoring easier than ever. Key capabilities with modern canvas: Better visibility when navigating large pipeline graphs Cleaner, more structured layouts for complex orchestration logic Improved responsiveness when working with enterprise-scale workflows A more intuitive experience for pipelines with many activities and branches The modern Fabric Pipeline canvas, showing the updated node experience and option to disable the preview if needed. If you haven't tried it yet, now's the perfect time. The new experience is rolled out automatically and can be disabled at any time. Whether you're building your first pipeline or managing hundreds of activities across complex workflows, the new canvas is designed to help you stay productive and focused on what matters most. To learn more, refer to the Modern Pipeline Node Experience documentation. Upgrade Dataflow Gen1 to Dataflow Gen2 (CI/CD) using the Upgrade Wizard (Preview) The Dataflows Upgrade Wizard is a guided, end-to-end experience that upgrades your existing Power BI Dataflow Gen1 items to Dataflow Gen2 (CI/CD) in Microsoft Fabric with minimal effort. You can upgrade a single dataflow, or several dataflows from a workspace in a single flow. Previously, bringing a Gen1 dataflow into Fabric meant recreating it and repointing everything that depended on it. The Upgrade Wizard upgrades in place instead. Each dataflow keeps its ID, name, schedule, and connections, so the reports and semantic models that connect to it keep working without any changes. Before anything changes, the wizard assesses every dataflow in the workspace and tells you which ones need attention and why, such as incremental refresh settings to reconfigure or a linked entity to update, so you know what to expect before you upgrade. Why this matters Upgrade in place, with nothing to rebuild and nothing to repoint. Upgrade a whole workspace at once instead of one dataflow at a time. See what needs attention before you upgrade. Unlock Dataflow Gen2 innovations: improved performance, deeper Fabric integration, CI/CD and Git support, data destinations of your choice, richer diagnostics, Copilot-assisted authoring, and a modern data transformation foundation. The wizard is available for Dataflow Gen1 items in Premium or Fabric workspaces and requires Fabric to be enabled. To learn more, refer to the Upgrade Dataflow Gen1 to Dataflow Gen2 (CI/CD) using the Upgrade Wizard documentation. Extended watermark support in Copy job Watermark-based incremental load support enables Copy Job to efficiently ingest only new or changed data from key enterprise and SaaS data sources, avoiding costly full reloads. This reduces source-system impact, network traffic, and runtime while improving scalability for production analytics workloads. Customers can now use incremental loading across more of their critical data sources, including Salesforce, Informix, Cassandra, Greenplum, Presto, and Databricks, by leveraging Copy job’s built-in watermark mechanism and without building custom ingestion logic. To learn more, refer to the Incremental copy in Copy job documentation. Enable Change data feed during Lakehouse table creation in Copy job Copy job can now create Lakehouse tables with Change Data Feed (CDF) enabled automatically. There’s no longer a need to pre-create destination tables or manually configure Delta table properties. Simply select Enable CDF on destination and Copy job takes care of the setup for you. This ensures the table is immediately ready for incremental processing and downstream CDC scenarios, helping reduce data movement and improve replication efficiency. By eliminating manual configuration steps, it makes advanced data integration patterns much easier to adopt and operate at scale. To learn more, refer to the Automatic table creation and truncation on destination documentation. Amazon Redshift as new source in Copy job As part of our mission to enable multi-cloud data movement at petabyte scale with Copy job, we are bringing Amazon Redshift support as a source. This enables customers to seamlessly ingest data from one of AWS's most widely adopted data warehouse platforms directly into Fabric. Redshift support further strengthens Fabric's vision of delivering an open, connected, and multi-cloud data platform. To learn more, refer to the Connectors for Copy Job documentation. Copy job supports timestamps without time zone in Lakehouse Support for timestamps without time zones (timestamp_ntz) allows Fabric Lakehouse tables to preserve date and time values exactly as stored, without applying time zone conversions. Copy job can now automatically map timezone-independent datetime values to Delta Lake timestamp_ntz, ensuring greater compatibility with source systems that allow storing date and time values without time zone information. Migration Assistant for SQL database in Fabric (Generally Available) The guided, Fabric-native wizard takes you from a source SQL Server schema to a running SQL database in Fabric: upload a DACPAC, review compatibility results, deploy the schema with Copilot-assisted fix suggestions, and copy your data using built-in Fabric Copy Jobs. We've added the capability preview customers asked for most: Validate. You can now check out a DACPAC for compatibility before creating a SQL database in Fabric. Upload the file and the assistant reports which schema objects will deploy cleanly, which ones use features that aren't supported, the reason behind each failure, and the dependencies between objects — with nothing provisioned and no capacity consumed. That means you can scope migration effort, plan remediation, and get change-approval sign-off before you commit to a target database. To get started, select Migrate in your Fabric workspace and choose Migrate to SQL database in Fabric. To learn more, refer to the Fabric Migration Assistant documentation. Until next month That's a wrap for the August 2026 Microsoft Fabric Monthly Update. As always, we'll continue sharing new capabilities, enhancements, and improvements across Microsoft Fabric in future monthly updates. Thank you for being part of the Fabric community!
