Summary
Airbyte is not preserving the schema from PostgreSQL to ClickHouse, creating generic columns instead of maintaining the original column names and data types. The user is seeking guidance on how to ensure accurate schema replication.
Question
Hi Airbyte Community,
I’m new to Airbyte and the community, and I’m facing a challenge with my ETL pipeline. I’m using Airbyte to replicate data from a PostgreSQL database to ClickHouse. While the data transfer is successful, I’ve noticed that the schema of the source tables in PostgreSQL is not preserved in ClickHouse. Instead of maintaining the original column names and data types, Airbyte creates generic columns for all the tables in ClickHouse.
Could someone guide me on how to ensure that the schema from my PostgreSQL source is accurately replicated to ClickHouse, preserving the original column names and data types? Any specific steps or configurations that I might be missing?
Additional Details:
• Source Database: PostgreSQL
• Destination Database: ClickHouse
• Airbyte Version: app://dd/dashboard/images/local/details?image=airbyte%2Fwebapp%3A0.63.13&imageId=sha256%3A832afa49814966ba874dbc8e2b16f106907213a0090afa660e88654f64ce17f6|0.63.13
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.