Check if Airbyte supports Change Data Capture (CDC) from PostgreSQL to ClickHouse database and how to get started.
Hi I’m new to Airbyte, and have a few question. Does it support CDC from PostgreSQL to ClickHouse database? How I do get start on this? Thanks
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.
Have a look at this page. In theory, if it handles CDC for postgres, which is does if configured the right way, the destination shouldn’t have to be aware any CDC stuff is even going on.
I’d try setting up the postgres source as described here, and running some tests with clickhouse to see how it does.
I’m not going to set it up myself, I’m just another community user and a bit busy with work of my own this week. I also don’t use Clickhouse so can’t really help test it for you. But from the docs, and my understanding of the platform, it looks like it should be possible. Go for it and see what you get!
<@U06V3L5CH7Z>, please let me know once you have set up the “CDC from PostgreSQL to Clickhouse” using Airbyte. Could you also tell me if your Clickhouse (destination) is running on Kubernetes or not. Thanks so much.