Reducing size of raw data table in Airbyte Cloud

Summary

Airbyte Cloud user asking about reducing the size of the raw data table in the airbyte_internal schema to avoid issues with RDS Postgresql database destination and potential impact on data replication.


Question

Hello community,
I’m using Airbyte Cloud to replicate data from a MySQL database to a Postgresql database with CDC feature.
Airbyte creates me a schema airbyte_internal which is normal to store the raw data. But the size of the table in that schema is really big and it’s gonna be too big for the RDS Postgresql database destination.
Do you know if there’s a way to reduce the size of the table raws in the schema airbyte_internal?
If I delete some data in the tables, will be affecting the data replication badly?

Thank you in advance for your help.



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["airbyte-cloud", "mysql-connector", "postgresql-connector", "cdc", "airbyte-internal-schema", "table-size", "data-replication"]