Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get certified in Microsoft Fabric—for free! For a limited time, get a free DP-600 exam voucher to use by the end of 2024. Register now

Reply
priyankabis
Helper I
Helper I

Snowflake mirror cost

Hi Team

 

We want to do snowflake mirroring. I have read the docs as I understand that we Fabric has no associated cost to replicate. But i need to figure out the cost as snowflake. One factor I know is the wwarehouse size and the size of data. But Does fabirc keeps querying snowflake to find the delta. This will help me that in what sense Snowflake's compute willl be used,

So in a nutshell what operations will Fabric do on Snowflake which I need to consider for cost as snowflake side

 

 

Thanks

1 ACCEPTED SOLUTION
v-zhengdxu-msft
Community Support
Community Support

Hi @priyankabis 

 

When mirroring data from Snowflake to Fabric, there are indeed several operations that can incur compute costs on the Snowflake side. These operations are primarily related to the extraction of data (reading your Snowflake data to replicate it into Fabric's OneLake):
The size of the virtual warehouse and the duration it runs to execute queries for data extraction directly impact the compute costs. Larger warehouses or longer query execution times will increase costs.
Operations performed by Snowflake's cloud services, such as managing and optimizing queries, also contribute to the overall compute costs.
If Fabric frequently queries Snowflake to detect changes (deltas) in the data for replication, each of these queries will consume compute resources on Snowflake's side.

 

To manage and potentially minimize these costs, consider the following:
Ensure that the queries used for data extraction are optimized for performance. This can reduce the time the virtual warehouse needs to run, thereby reducing costs.
If possible, schedule mirroring operations during off-peak hours or less frequently, based on your data freshness requirements. This can help in managing the compute costs more effectively.
Keep an eye on the virtual warehouse's usage and performance. Snowflake provides tools and features to monitor and analyze warehouse performance, which can help in identifying opportunities for cost optimization.

 

For more detailed information on configuring Snowflake in a copy activity:

Configure Snowflake in a copy activity - Microsoft Fabric | Microsoft Learn

 

Best Regards

Zhengdong Xu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

2 REPLIES 2
v-zhengdxu-msft
Community Support
Community Support

Hi @priyankabis 

 

When mirroring data from Snowflake to Fabric, there are indeed several operations that can incur compute costs on the Snowflake side. These operations are primarily related to the extraction of data (reading your Snowflake data to replicate it into Fabric's OneLake):
The size of the virtual warehouse and the duration it runs to execute queries for data extraction directly impact the compute costs. Larger warehouses or longer query execution times will increase costs.
Operations performed by Snowflake's cloud services, such as managing and optimizing queries, also contribute to the overall compute costs.
If Fabric frequently queries Snowflake to detect changes (deltas) in the data for replication, each of these queries will consume compute resources on Snowflake's side.

 

To manage and potentially minimize these costs, consider the following:
Ensure that the queries used for data extraction are optimized for performance. This can reduce the time the virtual warehouse needs to run, thereby reducing costs.
If possible, schedule mirroring operations during off-peak hours or less frequently, based on your data freshness requirements. This can help in managing the compute costs more effectively.
Keep an eye on the virtual warehouse's usage and performance. Snowflake provides tools and features to monitor and analyze warehouse performance, which can help in identifying opportunities for cost optimization.

 

For more detailed information on configuring Snowflake in a copy activity:

Configure Snowflake in a copy activity - Microsoft Fabric | Microsoft Learn

 

Best Regards

Zhengdong Xu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

GilbertQ
Super User
Super User

Hi @priyankabis 

 

While I don't have a definitive answer, what I would suggest doing is to set up the snowflake mirroring and then watch the activity on your snowflake warehouse to see exactly what is going on and how much it is querying your snowflake.





Did I answer your question? Mark my post as a solution!

Proud to be a Super User!







Power BI Blog

Helpful resources

Announcements
November Carousel

Fabric Community Update - November 2024

Find out what's new and trending in the Fabric Community.

Live Sessions with Fabric DB

Be one of the first to start using Fabric Databases

Starting December 3, join live sessions with database experts and the Fabric product team to learn just how easy it is to get started.

Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Early Bird pricing ends December 9th.

Nov PBI Update Carousel

Power BI Monthly Update - November 2024

Check out the November 2024 Power BI update to learn about new features.