Forum Discussion
Anonymous
11 months agoNot applicable
Error in Mirrored google Big query
Hi, Q1. I am trying to mirror tables in GCP Big Query, once I set up everything its giving below error. I couldn't find any specific error message. Q2. Our data has 15 tables few crore...
- 11 months ago
Hi Anonymous,
Here’s what that message usually means and how to get unblocked, plus some cost/design guidance for BigQuery vs a custom CDC pipeline.
Troubleshooting steps:
- Treat “Running with warnings -> Internal system error occurred (ArtifactId …)” as transient first. Reseed the affected table(s): in the Mirroring item, open Configure replication, uncheck the problem table(s), Save, then re-check and Mirror database. You can also stop and start mirroring if multiple tables show it. See status meanings in Monitor replication.
- Verify gateway + permissions. BigQuery mirroring requires OPDG 3000.286.6+ and a service account with the documented BigQuery and GCS permissions (BigQueryAdmin + StorageAdmin covers them). Security requirements.
- Only tables are supported. Replace views with materialized tables before mirroring. Troubleshooting: views not supported.
- Expect some lag. BigQuery CDC has an inherent ~10–15 minute delay, and Fabric increases polling intervals when there are no changes. Tutorial and limitations.
- If it persists, open a ticket with the ArtifactId, mirrored item URL, failing table, and timestamp. BigQuery mirroring is in preview.
If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.
ajarora
9 months agoMicrosoft Employee
We are announcing support for CDC from GBQ in CopyJob as well (Ignite). If you need finer control on schedule, or polling, you can consider CopyJob along with Mirror