Calculate the Spark Compute Cost

_augustine_ — Fri, 14 Jun 2024 16:28:08 GMT

I am currently using the Fabric trail version which has the F64 capacity. I have used the Fabric Metrics Dashboard and found the CU usage for my spark streaming notebook named "EventStreaming". How much will be the cost for the CU(s) & duration (s), i have utilized for this compute? Also, I would like to know whether using spark streaming notebooks will incur us more cost than mentioned in the Fabric Capacity costs?

Re: Calculate the Spark Compute Cost

Anonymous — Mon, 17 Jun 2024 02:18:02 GMT

Hi _augustine_ ,

The duration is approximately 64,299.78 seconds, which is equivalent to approximately 17.86 hours.

The cost per hour for F64 capacity is $11.52.

Let’s calculate the total cost:

Regarding your concern about whether using Spark streaming notebooks incurs more cost than the mentioned Fabric Capacity costs, it's essential to note that Spark pools are billed based on active Spark session duration. You're not billed for the time taken to acquire cluster instances from the cloud or for the time taken for initializing the Spark context. This means that the cost is directly related to the compute resources utilized during the active session of your Spark jobs.

For detailed guidance on managing and optimizing Spark compute costs, I recommend reviewing the following documentation:

Best Regards,

Neeko Tang

If this post  helps, then please consider Accept it as the solution  to help the other members find it more quickly.

topic Re: Calculate the Spark Compute Cost in Eventstream

Calculate the Spark Compute Cost

Re: Calculate the Spark Compute Cost