Forum Discussion
Lakehouse End User Usage
- 2 years ago
Hi, Barre
As of now, Microsoft Fabric does not provide a built-in, default-generated report specifically for monitoring end user usage of specific lakehouses, such as tracking which tables or views have been queried by end users. However, you can achieve this level of monitoring and create custom reports by leveraging Azure Monitor, Log Analytics, and Power BI.
Here's how you can set this up:
Enable Diagnostic Settings on Your Lakehouse: Go to the Azure portal and navigate to your Fabric Lakehouse. Set up diagnostic settings to send logs to Azure Monitor or Log Analytics. This will capture activity logs, including query execution logs.
Configure Log Analytics: If you don't have a Log Analytics workspace, create one in the Azure portal. Link your Fabric Lakehouse to the Log Analytics workspace through the diagnostic settings. Ensure that you are capturing the relevant logs (e.g., Audit logs, Query logs).
Query Logs in Log Analytics: Go to the Log Analytics workspace and use Kusto Query Language (KQL) to query the logs. You can create queries to filter and analyze the logs to find information about which tables or views have been queried.
Example KQL query to get the count of queries per table:AzureDiagnostics | where ResourceType == "FABRIC_LAKEHOUSE" | where OperationName == "Query" | summarize Count = count() by TableName, bin(TimeGenerated, 1d)Best Regards,
hackcrr
If this post helps, then please consider Accept it as the solution and kudos to this post to help the other members find it more quickly
Hi, Barre
As of now, Microsoft Fabric does not provide a built-in, default-generated report specifically for monitoring end user usage of specific lakehouses, such as tracking which tables or views have been queried by end users. However, you can achieve this level of monitoring and create custom reports by leveraging Azure Monitor, Log Analytics, and Power BI.
Here's how you can set this up:
Enable Diagnostic Settings on Your Lakehouse: Go to the Azure portal and navigate to your Fabric Lakehouse. Set up diagnostic settings to send logs to Azure Monitor or Log Analytics. This will capture activity logs, including query execution logs.
Configure Log Analytics: If you don't have a Log Analytics workspace, create one in the Azure portal. Link your Fabric Lakehouse to the Log Analytics workspace through the diagnostic settings. Ensure that you are capturing the relevant logs (e.g., Audit logs, Query logs).
Query Logs in Log Analytics: Go to the Log Analytics workspace and use Kusto Query Language (KQL) to query the logs. You can create queries to filter and analyze the logs to find information about which tables or views have been queried.
Example KQL query to get the count of queries per table:
AzureDiagnostics
| where ResourceType == "FABRIC_LAKEHOUSE"
| where OperationName == "Query"
| summarize Count = count() by TableName, bin(TimeGenerated, 1d)
Best Regards,
hackcrr
If this post helps, then please consider Accept it as the solution and kudos to this post to help the other members find it more quickly
Hi hackcrr ,
Thank you for the response.
We already have this process set up, but our KQL database only monitor semantic model activity, which is just a filter that can be adjusted I believe to include other artifacts.
I will explore this in more depth - thank you for good detailed answer.