Trouble adding connection and customizing docker launch command

Slack Knowledge Base Q&A Platform Questions
, , , ,
1

Summary

The user is facing trouble adding a connection in their environment and wants to customize the docker launch command by removing the ‘-rm’ parameter or using sudo.


Question

Hi, I’m having trouble adding a connection in my environment. Can you help me solve this problem? Is it possible to change the docker launch command to a custom one? without the “-rm” parameter or with sudo?

2024-07-16 13:56:43 platform > Checking if airbyte/source-postgres:3.4.23 exists…
2024-07-16 13:56:43 platform > airbyte/source-postgres:3.4.23 was found locally.
2024-07-16 13:56:43 platform > Creating docker container = source-postgres-check-d2b0cac8-77ed-4893-a9e6-8f1d05646ef6-0-mvxun with resources io.airbyte.config.ResourceRequirements@52d01020[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2024-07-16 13:56:43 platform > Preparing command: docker run --rm --init -i -w /data/d2b0cac8-77ed-4893-a9e6-8f1d05646ef6/0 --log-driver none --name source-postgres-check-d2b0cac8-77ed-4893-a9e6-8f1d05646ef6-0-mvxun --network host -v airbyte_workspace:/data -v oss_local_root:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:3.4.23 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e FIELD_SELECTION_WORKSPACES= -e USE_STREAM_CAPABLE_STATE=true -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE=dev -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT=config -e AIRBYTE_VERSION=0.63.5 -e WORKER_JOB_ID=d2b0cac8-77ed-4893-a9e6-8f1d05646ef6 airbyte/source-postgres:3.4.23 check --config source_config.json
2024-07-16 13:56:43 platform > Reading messages from protocol version 0.2.0
2024-07-16 13:56:43 platform > unable to upgrade to tcp, received 409
2024-07-16 13:56:43 platform > Check connection job subprocess finished with exit code 1
2024-07-16 13:56:43 platform > Unexpected error while checking connection:


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["trouble-adding-connection", "customizing-docker-launch-command", "docker", "connection", "sudo"]
2

I think it would require changing code for orchestrator

in logs you have whole command docker run ..., have you tried to run it?

3

Yes, I run the command but it failed - the reason is that i dont have source_config.json.
do you know maybe the structure of it?

4

https://github.com/airbytehq/airbyte/blob/c1ccff5544229fa959a0c3d81ab93bc3ede17398/airbyte-integrations/connectors/source-postgres/src/main/resources/spec.json|spec.json contains definition of structure
here’s an example: https://github.com/airbytehq/airbyte/blob/c1ccff5544229fa959a0c3d81ab93bc3ede17398/airbyte-integrations/connectors/source-postgres/src/test-integration/resources/dummy_config.json|dummy_config.json

5

Thank you, this helped - now I see that I cannot connect to the Postgres database due to the encrypted password.