Missing records during initial sync with MySQL connector using Bin Log (CDC)

Summary

When using Airbyte version 0.64.4 and MySQL connector version 3.6.5 with Bin Log (CDC) for incremental table ingestion, some records created during the initial sync are missing. Will these records be ingested in the next sync? Is there a way to fix this issue?


Question

Hi all,

I’m using airbyte version 0.64.4 and mysql connector version 3.6.5. We are using Bin LOg (CDC) and ingesting the tables incrementally. We are seeing that for the initial sync of some of our tables, some records are missing. These records are created around the time the first sync is running, how is this possible? should in the next sync this records be ingested? is there a way to fix it?



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["missing-records", "initial-sync", "mysql-connector", "bin-log-cdc", "incremental-ingestion"]