Forum Discussion
Mirrored database error
Turns out Parquet works fine and as documented. It gets hosed with the CSV. Maybe its formatting?
Hi Anonymous,
Thank you for the clarification and it’s great to hear you’re exploring Open Mirroring with Airtable.
You're absolutely right that the initial CSV/Parquet file is needed to bootstrap the mirrored table, as outlined in the Open Mirroring documentation.
Consider below steps:
- Ensure you're uploading the file via the correct Open Mirroring entry point use the UI or Open Mirroring API that supports initial file ingestion and the file should typically be in Parquet or CSV format and follow the naming/schema conventions expected by your mirrored table definition.
- Avoid uploading via staging paths or from general storage folders (e.g: .../Staging/...), as these are not supported for mirrored DB initial loads.
- Double-check the table schema you created via the Open Mirroring setup it should match your CSV column names exactly.
If this helps, please mark it as “Accept as solution” and feel free to give a “Kudos” to help others in the community as well.
Thank you.
Thank you for recognizing what I am trying to do. The error was happening in the initial steps and setup, but I just tried again and didn't get it.
This is the screen right after creating the Mirrored database from step 1.
When I click Upload files as instructed in steps 2 and 3, I get this
It doesn't ask me where to store the folders.
This process creates the first folder with the first file and the associated metadata.json file.
Now that its not throwing an error in the initial wizard, the next issue is that it doesn't seem to be automatically creating nor updating a Delta Table.
Turns out Parquet works fine and as documented. It gets hosed with the CSV. Maybe its formatting?