Event Stream unable to load the data into Lakehouse\ KQL
Hi, Looking some advice and help. I have a scenario. IOT devices messages and events data pointed to event hub (having 3-4 different message types). Without using the eventprocessing able to load the data into either lakehouse\ KQL by using event stream. But partial data loaded. When tried to use the eventprocessing with Manage Fields and Filter operations then the data is loading into both lakeshouse and KQL. Created the tables seperately and also tried to load but no luck. I am using filter operation as " column1 equals abc". Appreciate any quick help..
Anomaly Detection
Hi, The walkthrough for real-time analysis in Fabric has the query below as an example of anomaly detection in taxi driver tips in New York: nyctaxitrips | lookup (Locations) on $left.PULocationID==$right.LocationID | where Borough == "Manhattan" | make-series s1 = avg(tip_amount) on tpep_pickup_datetime from datetime(2022-06-01) to datetime(2022-06-04) step 1h | extend anomalies = series_decompose_anomalies(s1) | render anomalychart with (anomalycolumns=anomalies) What bothers me is that the detection is made over an average, so we are not really detecting the anomaly, we are detecting the hour inside which the anomaly happened. The make-series only work with an aggregation function. Is it possible to use series_decompose_anomalies to detect individual anomaly values, instead of aggregated anomaly values? How could we use the make series without aggregation? The example contained in the description page of the function series_decompose_anomalies is about web traffic and makes complete sense, because there is no anomaly on an individual value, it only exists on an aggregation. But for taxi driver tips, there is one anomaly and we can't find it aggregating. Of course I could use separate queries over the hours pointed as anomaly to discover which is the anomaly value, but I was willing to find a solution to see the anomalies in a chart with a query. Am I wrong? Is my concept wrong? Kind Regards, Dennes
Group by on eventstream's lakehouse target doesn't aggregate numeric fields
Hi, The problem is: The fields are not available to apply an aggregation function. I can make a count, but I can't make a sum, avg or other. This was on the NYTaxi sample data, close the the existing real time walkthrough on Microsoft portal, but I included a lakehouse target (kusto and lakehouse, two targets) and this happened on the transformation for the lakehouse. Is this a bug, or did I miss something? The image below illustrate the problem. The only thing which appears is "partitionId": Kind Regards, DennesKQL Shortcut OneLake Option Missing
Hi there - We want to process data from Azure Data Explorer (Kusto). using Spark. I have created shortcut using this Create a database shortcut - Microsoft Fabric | Microsoft Learn . However, I don't see option for creating shorcut on top of KQL Shortcut database i.e I want to access this data under Lakehouse using externaltable option in order to process using spark. Created ShortCut using Azure Data Explorer (Kusto). Create a database shortcut - Microsoft Fabric | Microsoft Learn OneLakeAvailability Option: I can see OneLake Availablity Option for new kql database created in Fabric but it's missig in Above Screenshot Please suggest how to resolve the issue. Thanks, Abhiram
