Recreating Airbyte container with same source and destination for data replication

Summary

When recreating the Airbyte container in Docker with the same source and destination, the ingestion does not continue from the last point. The user is looking for a way to achieve this. MySQL is configured with CDC Update Method and BigQuery with Batched Standard Inserts for Loading Method.


Question

Hi, I’m using Airbyte to replicate data from MySQL to BigQuery. I’m trying to destroy the Airbyte container in Docker and recreate it (including the same source and destination as in the previous container) in order to understand if the ingestion continues from the last point it had reached. The answer is NO, but I want to understand if exists a way to do that. MySQL is configured as CDC Update Method and BigQuery as Batched Standard Inserts as Loading Method.

Thank you in advance for your help!

Andrea



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["recreate-airbyte-container", "data-replication", "mysql", "bigquery", "cdc-update-method", "batched-standard-inserts"]