What is KQL db in fabric generally used for storing, is it historical data or only streaming data?

[supriyapandey19]

Hi,

I wanted to understand if usually end users utilize KQL db in fabric for storing historical data as well or only streaming data. 

What is usual retention period commonly followed for KQL db as the default is unlimited.

Thanks in advance.

[Anonymous]

Hi @supriyapandey19 ,

The KQL database in Microsoft Fabric is primarily used to store and analyze real-time analytics data. It is a fully managed Kusto engine that allows queries to be executed on data using KQL (Kusto Query Language). You can use the KQL database to store historical data and process streaming data as needed.

Regarding the retention period, while you mentioned it as unlimited, it's important to note that the default data retention policy is actually set to 36,500 days, which for most practical purposes, can be considered as 'unlimited'. However, this is configurable, and users can adjust the retention period based on their specific needs. Refer: Change data policies in Real-Time Analytics - Microsoft Fabric | Microsoft Learn

If you're considering storing historical data and need guidance on how to ingest it into a KQL database, the Tutorial on getting historical data might be of interest.

For exploring data with KQL and SQL, including example queries, the Explore your data with KQL and SQL tutorial can provide valuable insights.

Best Regards,

Neeko Tang

If this post  helps, then please consider Accept it as the solution  to help the other members find it more quickly.