Error converting data value in CDC replication from Postgresql to Clickhouse

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

Error encountered while converting data value for ‘created_at’ field from timestamp to Long in CDC replication from Postgresql to Clickhouse. Invalid Java object for schema with type STRING.


Question

Hello community. There is a problem with CDC replication of Postgresql in Clickhouse, many errors
2024-09-13 04:39:52 ERROR i.a.w.i.VersionedAirbyteStreamFactory(internalLog):313 - ERROR debezium-postgresconnector-api_crm-change-event-source-coordinator i.d.u. Loggings(logErrorAndTraceRecord):58 Failed to correctly convert data value for ‘public.table.created_at’ of type timestamp org.apache.kafka.connect.errors.DataException: Invalid Java object for schema with type STRING: class java.lang.Long for field: ‘created_at’

How to fix it?


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["cdc-replication", "postgresql", "clickhouse", "data-conversion-error", "debezium-postgres-connector"]
2

this is source-postgres to destination-clickhouse?

3

clickhouse is probably a community connector which we havent verified. To verify source-postgres work correctly, you can sync the db to a E2E destination (/dev/null) to see if that can succeed.

4

<@U071HD82KAB> The database works exactly correctly, we have another database with a smaller volume that synchronises without errors

5

I guess it is a type conversion problem for clickhouse destination connector

6

Well, the error says so. Do you know how to fix it?