Troubleshooting CDC Sync Lag between RDS MySQL and Bigquery via Airbyte

Summary

The user is experiencing an increasing lag between the master and replica instances of RDS MySQL after setting up CDC sync to Bigquery via Airbyte. The lag decreases when the CDC sync is stopped. The user is seeking reasons for this issue and troubleshooting steps.


Question

I have a RDS MySQL instance and it’s replica instance. I have a setup a CDC sync from replica to Bigquery via Airbyte. After setting up CDC sync, lag between master and replica started increasing. After stopping CDC sync, lag between master and replica started converging. What could be the reason. How should I troubleshoot?



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["cdc-sync", "rds-mysql", "bigquery", "airbyte", "lag", "troubleshoot"]