Issue with CDC replication from AWS RDS to BigQuery

Summary

The user is facing an issue with CDC replication from AWS RDS to BigQuery where the database crashed due to storage being full. The replication slot hadn’t synced since December 15th and was mistakenly deleted. User is seeking advice on how to proceed with data up until December 15th.


Question

Hi guys,
I recently started getting exposed to Airbyte. My team was using CDC replication from AWS RDS postgres to BigQuery. Not too long ago we ran into an issue where the DB crashed because it was storage full. The replication slot was configured to run nightly, but it was huge because it hadn’t synced since December 15th (I’m unsure why) and I made the mistake of deleting it. I’m looking for advice on how to go from here. There’s data on BigQuery up until December 15th.

Any advice would be greatly appreciated :slightly_smiling_face:



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["cdc-replication", "aws-rds", "bigquery", "storage-full", "replication-slot"]