March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Early bird discount ends December 31.
Register NowBe one of the first to start using Fabric Databases. View on-demand sessions with database experts and the Microsoft product team to learn just how easy it is to get started. Watch now
Hi Team
We want to do snowflake mirroring. I have read the docs as I understand that we Fabric has no associated cost to replicate. But i need to figure out the cost as snowflake. One factor I know is the wwarehouse size and the size of data. But Does fabirc keeps querying snowflake to find the delta. This will help me that in what sense Snowflake's compute willl be used,
So in a nutshell what operations will Fabric do on Snowflake which I need to consider for cost as snowflake side
Thanks
Solved! Go to Solution.
Hi @priyankabis
When mirroring data from Snowflake to Fabric, there are indeed several operations that can incur compute costs on the Snowflake side. These operations are primarily related to the extraction of data (reading your Snowflake data to replicate it into Fabric's OneLake):
The size of the virtual warehouse and the duration it runs to execute queries for data extraction directly impact the compute costs. Larger warehouses or longer query execution times will increase costs.
Operations performed by Snowflake's cloud services, such as managing and optimizing queries, also contribute to the overall compute costs.
If Fabric frequently queries Snowflake to detect changes (deltas) in the data for replication, each of these queries will consume compute resources on Snowflake's side.
To manage and potentially minimize these costs, consider the following:
Ensure that the queries used for data extraction are optimized for performance. This can reduce the time the virtual warehouse needs to run, thereby reducing costs.
If possible, schedule mirroring operations during off-peak hours or less frequently, based on your data freshness requirements. This can help in managing the compute costs more effectively.
Keep an eye on the virtual warehouse's usage and performance. Snowflake provides tools and features to monitor and analyze warehouse performance, which can help in identifying opportunities for cost optimization.
For more detailed information on configuring Snowflake in a copy activity:
Configure Snowflake in a copy activity - Microsoft Fabric | Microsoft Learn
Best Regards
Zhengdong Xu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Hi @priyankabis
When mirroring data from Snowflake to Fabric, there are indeed several operations that can incur compute costs on the Snowflake side. These operations are primarily related to the extraction of data (reading your Snowflake data to replicate it into Fabric's OneLake):
The size of the virtual warehouse and the duration it runs to execute queries for data extraction directly impact the compute costs. Larger warehouses or longer query execution times will increase costs.
Operations performed by Snowflake's cloud services, such as managing and optimizing queries, also contribute to the overall compute costs.
If Fabric frequently queries Snowflake to detect changes (deltas) in the data for replication, each of these queries will consume compute resources on Snowflake's side.
To manage and potentially minimize these costs, consider the following:
Ensure that the queries used for data extraction are optimized for performance. This can reduce the time the virtual warehouse needs to run, thereby reducing costs.
If possible, schedule mirroring operations during off-peak hours or less frequently, based on your data freshness requirements. This can help in managing the compute costs more effectively.
Keep an eye on the virtual warehouse's usage and performance. Snowflake provides tools and features to monitor and analyze warehouse performance, which can help in identifying opportunities for cost optimization.
For more detailed information on configuring Snowflake in a copy activity:
Configure Snowflake in a copy activity - Microsoft Fabric | Microsoft Learn
Best Regards
Zhengdong Xu
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Hi @priyankabis
While I don't have a definitive answer, what I would suggest doing is to set up the snowflake mirroring and then watch the activity on your snowflake warehouse to see exactly what is going on and how much it is querying your snowflake.
March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!
Your insights matter. That’s why we created a quick survey to learn about your experience finding answers to technical questions.
Arun Ulag shares exciting details about the Microsoft Fabric Conference 2025, which will be held in Las Vegas, NV.
User | Count |
---|---|
32 | |
24 | |
12 | |
11 | |
9 |
User | Count |
---|---|
47 | |
46 | |
23 | |
12 | |
9 |