Summary
User reports failures in MySQL CDC binlog syncing after initial and incremental syncs, reverting to full syncs and ultimately failing. The issue persists across multiple destinations including BigQuery and Clickhouse, while standard replication functions correctly.
Question
Has anyone actually managed to get MySQL CDC binlog syncing working correctly? I’ve tried so many times and it invariably fails at some point after the first sync. In our latest test, the initial sync worked perfectly, as did the following 2 incremental syncs. But after that, it reverts back to doing a full sync again, and then started failing completely. We’re using version 0.50.43 of Airbyte and using the Incremental | Append + Deduped sync mode.
I have also tried with BigQuery and Clickhouse as destinations, all with the same result.
Standard replication (i.e. non CDC/Binlog) works perfectly all the time.
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.