Long Sync Time for Postgres > Postgres CDC Sync

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

The user is experiencing long sync times for a Postgres to Postgres CDC sync, even when there is no data to migrate. They are using a local setup with abctl Airbyte installation.


Question

Hi All. Is it normal for a Postgres > Postgres cdc sync to take a long time?

• I have a sample source Postgres database I set up on my local mac with cdc enabled…
• The destination Postgres is also local on my mac.
• I have a local abctl Airbyte installation.
• I am syncing 1 table with 39 records.
The initial load of 39 records took 21 min.
11.81 KB | 39 records extracted | 39 records loaded | 21m 7s
Every load after of 0 records takes ~21 min,
0 Bytes | no records extracted | no records loaded | 21m 25s
This seems to be an absurd amount of time considering there is no data to migrate. Do I have something possibly mis-configured? I have attached screenshots of my source and connection settings.


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["postgres", "cdc-sync", "abctl", "sync-time", "mis-configured"]
2

Here is my docker resource config.

3

Here are the stats on the docker container while the sync is running: