ram_eternal189's avatar
ram_eternal189
Regular Visitor
1 year ago
Status:
Needs Votes

Scheduled Refresh for Fabric Mirroring

Current Challenge:

Fabric Mirroring runs continuously, leading to unnecessary data replication and higher Snowflake costs. There is no built-in option to schedule mirroring based on specific times or external triggers.

Suggestion:

  • Add a native scheduling option for Mirroring (e.g., daily, hourly, or custom times).
  • Allow event-driven refresh, triggered by external sources like Snowflake Webhooks or Azure Event Grid.
  • Provide a data-change-based refresh, where mirroring checks for last modified timestamps before running.

Benefits:

  • Cost Optimization → Avoids unnecessary refresh cycles, reducing Snowflake compute costs.
  • Better Data Accuracy → Ensures Fabric mirrors only when the Snowflake data is fully updated.
  • Automation → Enables organizations to align Mirroring refresh with their Snowflake data pipeline schedules.

2 Comments

  • we have the same issue via snowflake.. where it is leading to significant cloud costs because it is checking unnecessarily.  Please add this feature

  • Anonymous's avatar
    Anonymous
    Not applicable

    Thanks for sharing this well thought out idea with us. Let's see if we can get more upvotes on it.

Recent ideas