Issue with disabling type and dedupe process in Airbyte connector for Postgres

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

The user is facing an issue with disabling the type and dedupe process in the Airbyte connector for Postgres. They are trying to transfer data from SQL Server to Postgres using APIs, and despite setting ‘disable_type_dedupe’ to true in the connector configuration, it does not seem to take effect. The user is running Airbyte version 0.63.13 with the latest Postgres connector version 2.4.0.


Question

Hello!
I am testing aibyte out using docker-compose (running run-ab-platform.sh)
Trying to tranfer from sql server to postgres using APIs
On UI I see I am on relatively latest version 0.63.13 and latest connector for postgres (destination) 2.4.0
Mine is full table refresh
I see from logs most of time spent on type and dedupe process so tried to disable it but it does not seem to take effect

    "destinationId": "eb276905-...",
    "name": "Postgres 2",
    "destinationType": "postgres",
    "workspaceId": "2fe4fc8f-...",
    "configuration": {
        "host": "localhost",
        "port": 5432,
        "schema": "temp_api",
        "database": "temp",
        "password": "**********",
        "ssl_mode": {
            "mode": "disable"
        },
        "username": "admin_user",
        "tunnel_method": {
            "tunnel_method": "NO_TUNNEL"
        },
        "jdbc_url_params": "batchSize=1000&synchronous_commit=OFF",
        "disable_type_dedupe": true
    }
}```


<br>

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1727027196282349) if you want 
to access the original thread.

[Join the conversation on Slack](https://slack.airbyte.com)

<sub>
["airbyte-connector", "sql-server", "postgres", "api", "disable-type-dedupe", "connector-configuration"]
</sub>