Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
11 months ago
Solved

Error in Mirrored google Big query

Hi,  Q1. I am trying to mirror tables in GCP Big Query, once I set up everything its giving below error.  I couldn't find any specific error message. Q2. Our data has 15 tables few crore...
  • tayloramy's avatar
    11 months ago

    Hi Anonymous, 

     

    Here’s what that message usually means and how to get unblocked, plus some cost/design guidance for BigQuery vs a custom CDC pipeline.

    Troubleshooting steps:

    1. Treat “Running with warnings -> Internal system error occurred (ArtifactId …)” as transient first. Reseed the affected table(s): in the Mirroring item, open Configure replication, uncheck the problem table(s), Save, then re-check and Mirror database. You can also stop and start mirroring if multiple tables show it. See status meanings in Monitor replication.
    2. Verify gateway + permissions. BigQuery mirroring requires OPDG 3000.286.6+ and a service account with the documented BigQuery and GCS permissions (BigQueryAdmin + StorageAdmin covers them). Security requirements
    3. Only tables are supported. Replace views with materialized tables before mirroring. Troubleshooting: views not supported
    4. Expect some lag. BigQuery CDC has an inherent ~10–15 minute delay, and Fabric increases polling intervals when there are no changes. Tutorial and limitations
    5. If it persists, open a ticket with the ArtifactId, mirrored item URL, failing table, and timestamp. BigQuery mirroring is in preview


    If you found this helpful, consider giving some Kudos. If I answered your question or solved your problem, mark this post as the solution.