Introducing staging support for Mirroring for Google BigQuery (Preview), a major enhancement that dramatically improves the speed and efficiency of initial data replication from Google BigQuery into Microsoft Fabric.
Why Staging Matters
Previously, initial replication of large datasets from BigQuery into Fabric could be time-consuming. With staging enabled, organizations are now seeing performance improvements of over 90% during the initial sync. For example, replicating 1.5 terabytes of data (over 6 billion rows) now only takes about 50 minutes, compared to a few days before.
How it Works
Staging introduces an intermediate layer that streamlines the process of bringing large datasets into Fabric, this approach:
- Optimizes throughput for bulk data ingestion.
- Reduces latency for first-time connections.
- Ensures reliability by minimizing errors during large-scale replication.
Benefits for Your Analytics
With faster data landing, teams can start analyzing and building on their BigQuery data in Fabric almost immediately. This means:
- Accelerated time-to-insight for business-critical decisions.
- Simplified workflows without complex ETL pipelines.
- Improved reliability for cross-cloud analytics scenarios.
What’s Next
To learn more and get started with using Mirroring for GBQ, refer to the following resources.