Postgres to Postgres Data Ingestion Performance

Slack Knowledge Base Q&A Platform Questions
, , , ,
1

Summary

Concerns about the time taken for CDC data ingestion from Postgres to Postgres on Airbyte running on Kubernetes


Question

Hi Guys,
I have setup Airbyte on Kubernetes. I am doing postgres to postgres data ingestion. I am using CDC for data ingestion. I am concerned with the amount of time it is taking. It runs every hour
The time it took for replication is 30mins for below mentioned number of records
9776 record(s) extracted / 9776 record(s) loaded
5 MB extracted / 5 MB loaded


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["postgres-to-postgres", "data-ingestion", "cdc", "performance", "kubernetes", "airbyte-platform"]