Enhanced Memory Metrics for Spark Streaming Jobs in Fabric

[Shyam_Prasad]

In Spark Streaming jobs running on Fabric capacity, there are currently no built-in metrics, graphs, or dashboards to display executor memory details such as free memory, consumed memory, and total memory. Providing these insights would help end users make informed decisions about scaling their environment type or workload based on resource utilization