A typical enterprise environment involves managing numerous Virtual Machines (VMs) and necessitates aggregating their telemetry into a centralized, scalable analytics repository. Running on top of all this infrastructure are solutions (applications, APIs, etc.) handling operational data your business care about.
Querying data across your infrastructure telemetry, application telemetry and enterprise data can give you insights allowing you to troubleshoot issues you wouldn't be able to otherwise.
Example: at an airport, a few flights missed their turnaround time SLA. Ground crew complained the gate operations app was slow. If you have your server telemetry, you might be able to find anomalies (e.g. high CPU) on those servers. But if you have business data, e.g. turnaround time per flight, the gate associated with each flight and are able to parse your API telemetry to know which server handled requests which gate, then you are likely able to obtain much more insights into your operational issues.
Azure Monitor to Fabric Eventhouse
Azure Monitor to Fabric Eventhouse enables those scenarios. It consists of three main components.
- Azure Monitor Agent (AME) collecting virtual machine telemetry.
- Azure Monitor Data Collection Rules (DCR) controlling AME and routing data to different destinations.
- Fabric Eventhouse, Fabric RTI Analytical store for telemetry, this integration also works with Azure Data Explorer.
Virtual Machines may be in Azure, On Premise, in other clouds, or a combination of the three. Currently, you can send the following Virtual Machines telemetry to Eventhouse.
- Performance Counters
- Windows Event Logs
- Linux Syslog
- IIS logs
- Firewall logs
- Custom Text Logs
- Custom JSON logs
- Prometheus Metrics
Eventhouse automatically creates tables. Schema management is built in! Once the telemetry is ingested in Eventhouse, you can use the data to:
- Run ad hoc queries, graph queries & time series analytics.
- Use Python in-query to do complex analytics.
- Use Eventhouse as a source for visualization tools such as:
- Real Time Dashboards, Power BI, Grafana, and Tableau.
- Leverage Fabric Activator
Your data is seamlessly available through Fabric OneLake, enabling integration with all services connected to OneLake. For instance, you can execute Spark jobs on the VM telemetry data as needed. With Fabric, you have access not only to your telemetry data but also to all your enterprise information. This enables you to gain valuable insights by connecting server activities with sales performance.
Try it and give us feedback!
To get started, refer to the Send virtual machine client data to Fabric and Azure Data Explorer (Preview) documentation.