Forum Discussion
how to get logs from dataflow gen2 and data pipeline to log analytics
Hi vishesh_singhal,
To help you monitor Dataflow Gen2 and Data Pipelines more effectively in Microsoft Fabric, you can configure diagnostic settings that send logs from the Monitor Hub directly to an Azure Log Analytics workspace. By default, Monitor Hub captures rich metadata such as pipeline runs, dataflow executions, and error statuses, but this data isn't automatically exported to Log Analytics unless configured explicitly.
prerequisites: The first step is ensuring prerequisites are met you’ll need to be a Fabric Admin, have an Azure subscription with a Log Analytics workspace, and be using a paid Fabric capacity (as diagnostic settings are only supported in non-trial environments). Once confirmed
configuration: open the Azure Portal and locate your Microsoft Fabric capacity resource. If the resource isn’t listed (as some tenants may not expose Fabric capacity directly yet), you can alternatively configure diagnostics at the Power BI workspace level using the Admin Portal.
Next, navigate to Azure Monitor > Diagnostic settings and select your Fabric or Power BI resource. Create a new diagnostic setting, select log categories such as DataflowActivity, pipelineRun, and PipelineActivityRun, then choose your Log Analytics workspace as the destination. After saving this configuration, logs related to Dataflow Gen2 and Pipelines will begin streaming into your Log Analytics workspace, where they can be queried and analyzed.
Thanks,
Prashanth
MS Fabric community support
Community SupportHi vishesh_singhal,
To help you monitor Dataflow Gen2 and Data Pipelines more effectively in Microsoft Fabric, you can configure diagnostic settings that send logs from the Monitor Hub directly to an Azure Log Analytics workspace. By default, Monitor Hub captures rich metadata such as pipeline runs, dataflow executions, and error statuses, but this data isn't automatically exported to Log Analytics unless configured explicitly.
prerequisites: The first step is ensuring prerequisites are met you’ll need to be a Fabric Admin, have an Azure subscription with a Log Analytics workspace, and be using a paid Fabric capacity (as diagnostic settings are only supported in non-trial environments). Once confirmed
configuration: open the Azure Portal and locate your Microsoft Fabric capacity resource. If the resource isn’t listed (as some tenants may not expose Fabric capacity directly yet), you can alternatively configure diagnostics at the Power BI workspace level using the Admin Portal.
Next, navigate to Azure Monitor > Diagnostic settings and select your Fabric or Power BI resource. Create a new diagnostic setting, select log categories such as DataflowActivity, pipelineRun, and PipelineActivityRun, then choose your Log Analytics workspace as the destination. After saving this configuration, logs related to Dataflow Gen2 and Pipelines will begin streaming into your Log Analytics workspace, where they can be queried and analyzed.
Thanks,
Prashanth
MS Fabric community support
Advocate IHi v-prasare , this response is mis-leading, I don't think Fabric Capacity provide an option to send the diagnostic logs into Log Analytics workspace from the Azure Portal directly.
It can send logs when Workspace is assigned a "Log Analytics" workspace and here there are limitations, it can't send logs for all the artifacts. Right I think it supports only Power BI and few other (I don't have the list). Pipeline is not part of it. Please double check the reply and point us to documentation if anything such available.