Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
_augustine_
New Member

Calculate the Spark Compute Cost

SparK CostSparK Cost

I am currently using the Fabric trail version which has the F64 capacity. I have used the Fabric Metrics Dashboard and found the CU usage for my spark streaming notebook named "EventStreaming". How much will be the cost for the CU(s) & duration (s), i have utilized for this compute? Also, I would like to know whether using spark streaming notebooks will incur us more cost than mentioned in the Fabric Capacity costs?

1 ACCEPTED SOLUTION
v-tangjie-msft
Community Support
Community Support

Hi  @_augustine_ ,

 

The duration is approximately 64,299.78 seconds, which is equivalent to approximately 17.86 hours.

The cost per hour for F64 capacity is $11.52.

Let’s calculate the total cost:  

 

Regarding your concern about whether using Spark streaming notebooks incurs more cost than the mentioned Fabric Capacity costs, it's essential to note that Spark pools are billed based on active Spark session duration. You're not billed for the time taken to acquire cluster instances from the cloud or for the time taken for initializing the Spark context. This means that the cost is directly related to the compute resources utilized during the active session of your Spark jobs.

 

For detailed guidance on managing and optimizing Spark compute costs, I recommend reviewing the following documentation:

 

Best Regards,

Neeko Tang

If this post  helps, then please consider Accept it as the solution  to help the other members find it more quickly. 

View solution in original post

1 REPLY 1
v-tangjie-msft
Community Support
Community Support

Hi  @_augustine_ ,

 

The duration is approximately 64,299.78 seconds, which is equivalent to approximately 17.86 hours.

The cost per hour for F64 capacity is $11.52.

Let’s calculate the total cost:  

 

Regarding your concern about whether using Spark streaming notebooks incurs more cost than the mentioned Fabric Capacity costs, it's essential to note that Spark pools are billed based on active Spark session duration. You're not billed for the time taken to acquire cluster instances from the cloud or for the time taken for initializing the Spark context. This means that the cost is directly related to the compute resources utilized during the active session of your Spark jobs.

 

For detailed guidance on managing and optimizing Spark compute costs, I recommend reviewing the following documentation:

 

Best Regards,

Neeko Tang

If this post  helps, then please consider Accept it as the solution  to help the other members find it more quickly. 

Helpful resources

Announcements
FabricCarousel_June2024

Fabric Monthly Update - June 2024

Check out the June 2024 Fabric update to learn about new features.

PBI_Carousel_NL_June

Fabric Community Update - June 2024

Get the latest Fabric updates from Build 2024, key Skills Challenge voucher deadlines, top blogs, forum posts, and product ideas.

Top Solution Authors
Top Kudoed Authors