Summary
The user is facing an issue with disabling the type and dedupe process in the Airbyte connector for Postgres. They are trying to transfer data from SQL Server to Postgres using APIs, and despite setting ‘disable_type_dedupe’ to true in the connector configuration, it does not seem to take effect. The user is running Airbyte version 0.63.13 with the latest Postgres connector version 2.4.0.
Question
Hello!
I am testing aibyte out using docker-compose (running run-ab-platform.sh)
Trying to tranfer from sql server to postgres using APIs
On UI I see I am on relatively latest version 0.63.13 and latest connector for postgres (destination) 2.4.0
Mine is full table refresh
I see from logs most of time spent on type and dedupe process so tried to disable it but it does not seem to take effect
"destinationId": "eb276905-...",
"name": "Postgres 2",
"destinationType": "postgres",
"workspaceId": "2fe4fc8f-...",
"configuration": {
"host": "localhost",
"port": 5432,
"schema": "temp_api",
"database": "temp",
"password": "**********",
"ssl_mode": {
"mode": "disable"
},
"username": "admin_user",
"tunnel_method": {
"tunnel_method": "NO_TUNNEL"
},
"jdbc_url_params": "batchSize=1000&synchronous_commit=OFF",
"disable_type_dedupe": true
}
}```
<br>
---
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1727027196282349) if you want
to access the original thread.
[Join the conversation on Slack](https://slack.airbyte.com)
<sub>
["airbyte-connector", "sql-server", "postgres", "api", "disable-type-dedupe", "connector-configuration"]
</sub>