Maridb connect for source and destination fails

  • Is this your first time deploying Airbyte?: Yes
  • OS Version / Instance: Debian
  • Memory / Disk: 4Gb
  • Deployment: Docker
  • Airbyte Version: latest
  • Source name/version: mysql 1.0.3
  • Destination name/version: mysql 1.0.3
  • Step: Creating the source or destination
  • Description:

Error when connecting mySQL/mariaDB as source: State code: 08S01; Message: Communications link failure The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.

Error when connecting mySQL/MariaDB as destination: Could not connect with provided configuration. HikariPool-1 - Connection is not available, request timed out after 60001ms.

There is no entry in the error log of maria.

Is this related to JDBC driver. If so, can you explain how to find if within docker and what to do about it?

Any alternative explanations are more than welcome :slight_smile:

Thanks - Valentin

Hello. Same thing happens to me.

I was going to open a new post about it.

MariaDB 10.5. I can add it as a Source normally but the same DB with the same credentials for destination fails.

Can anyone help?

Thanks.

Hi @vjmayr and @Mulen,

Thanks for this post and welcome to the community!

The compatibility with MySQL and MariaDB for our connector is very buggy and is prone to breaking. Have you both recently upgraded from an older version? Please share logs and screenshots so that I can escalate this to Github.

This is the log from when i press “Setup Destination”

airbyte-temporal    | {"level":"info","ts":"2022-10-13T11:53:02.212Z","msg":"Get dynamic config","name":"history.defaultWorkflowRetryPolicy","value":{"BackoffCoefficient":2,"InitialIntervalInSeconds":1,"MaximumAttempts":0,"MaximumIntervalCoefficient":100},"default-value":{"BackoffCoefficient":2,"InitialIntervalInSeconds":1,"MaximumAttempts":0,"MaximumIntervalCoefficient":100},"logging-call-at":"config.go:79"}
airbyte-temporal    | {"level":"info","ts":"2022-10-13T11:53:02.235Z","msg":"Get dynamic config","name":"system.enableReadFromHistoryArchival","value":true,"default-value":true,"logging-call-at":"config.go:79"}
airbyte-temporal    | {"level":"info","ts":"2022-10-13T11:53:02.236Z","msg":"Get dynamic config","name":"history.longPollExpirationInterval","value":20,"default-value":20,"logging-call-at":"config.go:79"}
airbyte-worker      | 2022-10-13 11:53:02 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/bfd63f19-055b-439d-bd10-4ea24751f8c3/0/logs.log
airbyte-worker      | 2022-10-13 11:53:02 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.14
airbyte-worker      | 2022-10-13 11:53:03 INFO i.a.c.i.LineGobbler(voidCall):114 -
airbyte-worker      | 2022-10-13 11:53:03 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK -----
airbyte-worker      | 2022-10-13 11:53:03 INFO i.a.c.i.LineGobbler(voidCall):114 -
airbyte-worker      | 2022-10-13 11:53:03 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-mysql:0.1.20 exists...
airbyte-worker      | 2022-10-13 11:53:03 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-mysql:0.1.20 was found locally.
airbyte-worker      | 2022-10-13 11:53:03 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-mysql-check-bfd63f19-055b-439d-bd10-4ea24751f8c3-0-qghnt with resources io.airbyte.config.ResourceRequirements@2e77e28f[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=]
airbyte-worker      | 2022-10-13 11:53:03 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/bfd63f19-055b-439d-bd10-4ea24751f8c3/0 --log-driver none --name destination-mysql-check-bfd63f19-055b-439d-bd10-4ea24751f8c3-0-qghnt --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_CONNECTOR_IMAGE=airbyte/destination-mysql:0.1.20 -e WORKER_JOB_ATTEMPT=0 -e AIRBYTE_VERSION=0.40.14 -e WORKER_JOB_ID=bfd63f19-055b-439d-bd10-4ea24751f8c3 airbyte/destination-mysql:0.1.20 check --config source_config.json
airbyte-worker      | 2022-10-13 11:53:04 ERROR i.a.c.i.LineGobbler(voidCall):114 - SLF4J: Class path contains multiple SLF4J bindings.
airbyte-worker      | 2022-10-13 11:53:04 ERROR i.a.c.i.LineGobbler(voidCall):114 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
airbyte-worker      | 2022-10-13 11:53:04 ERROR i.a.c.i.LineGobbler(voidCall):114 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
airbyte-worker      | 2022-10-13 11:53:04 ERROR i.a.c.i.LineGobbler(voidCall):114 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
airbyte-worker      | 2022-10-13 11:53:04 ERROR i.a.c.i.LineGobbler(voidCall):114 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
airbyte-worker      | 2022-10-13 11:53:04 ERROR i.a.c.i.LineGobbler(voidCall):114 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
airbyte-temporal    | {"level":"info","ts":"2022-10-13T11:53:04.862Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/CONNECTION_UPDATER/1","wf-task-queue-type":"Workflow","lifecycle":"Starting","logging-call-at":"taskQueueManager.go:238"}
airbyte-temporal    | {"level":"info","ts":"2022-10-13T11:53:04.862Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/CONNECTION_UPDATER/1","wf-task-queue-type":"Workflow","lifecycle":"Started","logging-call-at":"taskQueueManager.go:242"}
airbyte-worker      | 2022-10-13 11:53:05 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - 2022-10-13 11:53:05 INFO i.a.i.d.m.MySQLDestination(main):136 - starting destination: class io.airbyte.integrations.destination.mysql.MySQLDestination
airbyte-worker      | 2022-10-13 11:53:05 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - 2022-10-13 11:53:05 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json}
airbyte-worker      | 2022-10-13 11:53:05 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - 2022-10-13 11:53:05 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination
airbyte-worker      | 2022-10-13 11:53:05 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - 2022-10-13 11:53:05 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK
airbyte-worker      | 2022-10-13 11:53:05 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - 2022-10-13 11:53:05 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}
airbyte-temporal    | {"level":"info","ts":"2022-10-13T11:53:05.984Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/GET_SPEC/1","wf-task-queue-type":"Workflow","lifecycle":"Starting","logging-call-at":"taskQueueManager.go:238"}
airbyte-temporal    | {"level":"info","ts":"2022-10-13T11:53:05.984Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/GET_SPEC/1","wf-task-queue-type":"Workflow","lifecycle":"Started","logging-call-at":"taskQueueManager.go:242"}
airbyte-worker      | 2022-10-13 11:53:05 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - 2022-10-13 11:53:05 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
airbyte-worker      | 2022-10-13 11:53:05 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - 2022-10-13 11:53:05 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
airbyte-worker      | 2022-10-13 11:53:05 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - 2022-10-13 11:53:05 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
airbyte-worker      | 2022-10-13 11:53:05 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - 2022-10-13 11:53:05 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
airbyte-worker      | 2022-10-13 11:53:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - 2022-10-13 11:53:06 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL
airbyte-worker      | 2022-10-13 11:53:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - 2022-10-13 11:53:06 INFO c.z.h.HikariDataSource(<init>):80 - HikariPool-1 - Starting...
airbyte-worker      | 2022-10-13 11:53:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - 2022-10-13 11:53:06 INFO c.z.h.HikariDataSource(<init>):82 - HikariPool-1 - Start completed.
airbyte-server      | 2022-10-13 11:53:16 INFO i.a.s.RequestLogger(filter):112 - REQ 172.18.0.5 GET 200 /api/v1/health
airbyte-webapp      | 172.21.4.98 - - [13/Oct/2022:11:53:16 +0000] "GET /api/v1/health HTTP/1.1" 200 18 "http://172.21.4.122:8000/workspaces/1d2e0d74-d27e-4dcd-9c53-330e7055eebe/destination/new-destination" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:105.0) Gecko/20100101 Firefox/105.0" "-"
airbyte-temporal    | {"level":"info","ts":"2022-10-13T11:53:22.236Z","msg":"Get dynamic config","name":"frontend.sendRawWorkflowHistory","value":false,"default-value":false,"logging-call-at":"config.go:79"}
airbyte-server      | 2022-10-13 11:53:36 INFO i.a.s.RequestLogger(filter):112 - REQ 172.18.0.5 GET 200 /api/v1/health
airbyte-webapp      | 172.21.4.98 - - [13/Oct/2022:11:53:36 +0000] "GET /api/v1/health HTTP/1.1" 200 18 "http://172.21.4.122:8000/workspaces/1d2e0d74-d27e-4dcd-9c53-330e7055eebe/destination/new-destination" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:105.0) Gecko/20100101 Firefox/105.0" "-"
airbyte-server      | 2022-10-13 11:53:56 INFO i.a.s.RequestLogger(filter):112 - REQ 172.18.0.5 GET 200 /api/v1/health
airbyte-webapp      | 172.21.4.98 - - [13/Oct/2022:11:53:56 +0000] "GET /api/v1/health HTTP/1.1" 200 18 "http://172.21.4.122:8000/workspaces/1d2e0d74-d27e-4dcd-9c53-330e7055eebe/destination/new-destination" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:105.0) Gecko/20100101 Firefox/105.0" "-"
airbyte-temporal    | {"level":"info","ts":"2022-10-13T11:54:01.370Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/CHECK_CONNECTION/1","wf-task-queue-type":"Workflow","lifecycle":"Starting","logging-call-at":"taskQueueManager.go:238"}
airbyte-temporal    | {"level":"info","ts":"2022-10-13T11:54:01.370Z","msg":"none","service":"matching","component":"matching-engine","wf-task-queue-name":"/_sys/CHECK_CONNECTION/1","wf-task-queue-type":"Workflow","lifecycle":"Started","logging-call-at":"taskQueueManager.go:242"}
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - 2022-10-13 11:54:06 ERROR i.a.i.d.m.MySQLDestination(check):83 - Exception while checking connection:
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - java.sql.SQLTransientConnectionException: HikariPool-1 - Connection is not available, request timed out after 60004ms.
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.pool.HikariPool.createTimeoutException(HikariPool.java:696) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:181) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.pool.HikariPool.getConnection(HikariPool.java:146) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.HikariDataSource.getConnection(HikariDataSource.java:100) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at io.airbyte.db.jdbc.DefaultJdbcDatabase.execute(DefaultJdbcDatabase.java:43) ~[io.airbyte.airbyte-db-db-lib-0.39.21-alpha.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at io.airbyte.db.jdbc.JdbcDatabase.execute(JdbcDatabase.java:47) ~[io.airbyte.airbyte-db-db-lib-0.39.21-alpha.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at io.airbyte.integrations.destination.jdbc.JdbcSqlOperations.lambda$createSchemaIfNotExists$0(JdbcSqlOperations.java:51) ~[io.airbyte.airbyte-integrations.connectors-destination-jdbc-0.39.21-alpha.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:54) ~[io.airbyte.airbyte-integrations.bases-base-java-0.39.21-alpha.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at io.airbyte.integrations.destination.jdbc.JdbcSqlOperations.createSchemaIfNotExists(JdbcSqlOperations.java:50) ~[io.airbyte.airbyte-integrations.connectors-destination-jdbc-0.39.21-alpha.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at io.airbyte.integrations.destination.jdbc.AbstractJdbcDestination.attemptSQLCreateAndDropTableOperations(AbstractJdbcDestination.java:88) ~[io.airbyte.airbyte-integrations.connectors-destination-jdbc-0.39.21-alpha.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at io.airbyte.integrations.destination.mysql.MySQLDestination.check(MySQLDestination.java:69) ~[io.airbyte.airbyte-integrations.connectors-destination-mysql-0.39.21-alpha.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at io.airbyte.integrations.base.ssh.SshTunnel.sshWrap(SshTunnel.java:205) [io.airbyte.airbyte-integrations.bases-base-java-0.39.21-alpha.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at io.airbyte.integrations.base.ssh.SshWrappedDestination.check(SshWrappedDestination.java:53) [io.airbyte.airbyte-integrations.bases-base-java-0.39.21-alpha.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:140) [io.airbyte.airbyte-integrations.bases-base-java-0.39.21-alpha.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:107) [io.airbyte.airbyte-integrations.bases-base-java-0.39.21-alpha.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at io.airbyte.integrations.destination.mysql.MySQLDestination.main(MySQLDestination.java:137) [io.airbyte.airbyte-integrations.connectors-destination-mysql-0.39.21-alpha.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - Caused by: com.mysql.cj.jdbc.exceptions.CommunicationsException: Communications link failure
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed.
airbyte-worker      | errors: $: unknown found, object expected
airbyte-worker      | 2022-10-13 11:54:06 ERROR i.a.w.i.DefaultAirbyteStreamFactory(validate):77 - Validation failed: null
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.jdbc.exceptions.SQLError.createCommunicationsException(SQLError.java:174) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:64) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:836) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:456) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:246) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:198) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:138) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.pool.PoolBase.newConnection(PoolBase.java:359) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.pool.PoolBase.newPoolEntry(PoolBase.java:201) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.pool.HikariPool.createPoolEntry(HikariPool.java:470) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.pool.HikariPool$PoolEntryCreator.call(HikariPool.java:733) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.pool.HikariPool$PoolEntryCreator.call(HikariPool.java:712) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at java.lang.Thread.run(Thread.java:833) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - Caused by: com.mysql.cj.exceptions.CJCommunicationsException: Communications link failure
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed.
airbyte-worker      | errors: $: unknown found, object expected
airbyte-worker      | 2022-10-13 11:54:06 ERROR i.a.w.i.DefaultAirbyteStreamFactory(validate):77 - Validation failed: null
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server.
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at jdk.internal.reflect.GeneratedConstructorAccessor29.newInstance(Unknown Source) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at jdk.internal.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at java.lang.reflect.Constructor.newInstanceWithCaller(Constructor.java:499) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at java.lang.reflect.Constructor.newInstance(Constructor.java:480) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:61) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:105) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.exceptions.ExceptionFactory.createException(ExceptionFactory.java:151) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.exceptions.ExceptionFactory.createCommunicationsException(ExceptionFactory.java:167) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.protocol.a.NativeProtocol.negotiateSSLConnection(NativeProtocol.java:340) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.protocol.a.NativeAuthenticationProvider.connect(NativeAuthenticationProvider.java:167) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.protocol.a.NativeProtocol.connect(NativeProtocol.java:1348) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.NativeSession.connect(NativeSession.java:157) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.jdbc.ConnectionImpl.connectOneTryOnly(ConnectionImpl.java:956) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:826) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:456) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:246) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:198) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:138) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.pool.PoolBase.newConnection(PoolBase.java:359) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.pool.PoolBase.newPoolEntry(PoolBase.java:201) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.pool.HikariPool.createPoolEntry(HikariPool.java:470) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.pool.HikariPool$PoolEntryCreator.call(HikariPool.java:733) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.pool.HikariPool$PoolEntryCreator.call(HikariPool.java:712) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at java.lang.Thread.run(Thread.java:833) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - Caused by: javax.net.ssl.SSLHandshakeException: No appropriate protocol (protocol is disabled or cipher suites are inappropriate)
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at sun.security.ssl.HandshakeContext.<init>(HandshakeContext.java:172) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at sun.security.ssl.ClientHandshakeContext.<init>(ClientHandshakeContext.java:103) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at sun.security.ssl.TransportContext.kickstart(TransportContext.java:239) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:443) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at sun.security.ssl.SSLSocketImpl.startHandshake(SSLSocketImpl.java:421) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.protocol.ExportControlled.performTlsHandshake(ExportControlled.java:317) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.protocol.StandardSocketFactory.performTlsHandshake(StandardSocketFactory.java:188) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.protocol.a.NativeSocketConnection.performTlsHandshake(NativeSocketConnection.java:97) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.protocol.a.NativeProtocol.negotiateSSLConnection(NativeProtocol.java:331) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.protocol.a.NativeAuthenticationProvider.connect(NativeAuthenticationProvider.java:167) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.protocol.a.NativeProtocol.connect(NativeProtocol.java:1348) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.NativeSession.connect(NativeSession.java:157) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.jdbc.ConnectionImpl.connectOneTryOnly(ConnectionImpl.java:956) ~[mysql-connector-java-8.0.22.jar:8.0.22]

This is a screenshot from the error at AirByte UI

Continue log

airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.jdbc.ConnectionImpl.createNewIO(ConnectionImpl.java:826) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.jdbc.ConnectionImpl.<init>(ConnectionImpl.java:456) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.jdbc.ConnectionImpl.getInstance(ConnectionImpl.java:246) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.mysql.cj.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:198) ~[mysql-connector-java-8.0.22.jar:8.0.22]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.util.DriverDataSource.getConnection(DriverDataSource.java:138) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.pool.PoolBase.newConnection(PoolBase.java:359) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.pool.PoolBase.newPoolEntry(PoolBase.java:201) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.pool.HikariPool.createPoolEntry(HikariPool.java:470) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.pool.HikariPool$PoolEntryCreator.call(HikariPool.java:733) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at com.zaxxer.hikari.pool.HikariPool$PoolEntryCreator.call(HikariPool.java:712) ~[HikariCP-5.0.1.jar:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 -      at java.lang.Thread.run(Thread.java:833) ~[?:?]
airbyte-worker      | 2022-10-13 11:54:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - 2022-10-13 11:54:06 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated...
airbyte-worker      | 2022-10-13 11:54:07 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - 2022-10-13 11:54:07 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed.
airbyte-worker      | 2022-10-13 11:54:07 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - 2022-10-13 11:54:07 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination
airbyte-worker      | 2022-10-13 11:54:07 INFO i.a.w.i.DefaultAirbyteStreamFactory(parseJson):68 - 2022-10-13 11:54:07 INFO i.a.i.d.m.MySQLDestination(main):138 - completed destination: class io.airbyte.integrations.destination.mysql.MySQLDestination
airbyte-worker      | 2022-10-13 11:54:07 INFO i.a.c.i.LineGobbler(voidCall):114 -
airbyte-worker      | 2022-10-13 11:54:07 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK -----
airbyte-worker      | 2022-10-13 11:54:07 INFO i.a.c.i.LineGobbler(voidCall):114 -
airbyte-worker      | 2022-10-13 11:54:07 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling...
airbyte-server      | 2022-10-13 11:54:07 INFO i.a.s.RequestLogger(filter):112 - REQ 172.18.0.5 POST 200 /api/v1/scheduler/destinations/check_connection - {"connectionConfiguration":"REDACTED","destinationDefinitionId":"ca81ee7c-3163-4246-af40-094cc31e5e42"}
airbyte-webapp      | 172.21.4.98 - - [13/Oct/2022:11:54:07 +0000] "POST /api/v1/scheduler/destinations/check_connection HTTP/1.1" 200 28178 "http://172.21.4.122:8000/workspaces/1d2e0d74-d27e-4dcd-9c53-330e7055eebe/destination/new-destination" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:105.0) Gecko/20100101 Firefox/105.0" "-"
airbyte-server      | 2022-10-13 11:54:16 INFO i.a.s.RequestLogger(filter):112 - REQ 172.18.0.5 GET 200 /api/v1/health
airbyte-webapp      | 172.21.4.98 - - [13/Oct/2022:11:54:16 +0000] "GET /api/v1/health HTTP/1.1" 200 18 "http://172.21.4.122:8000/workspaces/1d2e0d74-d27e-4dcd-9c53-330e7055eebe/destination/new-destination" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:105.0) Gecko/20100101 Firefox/105.0" "-"

Any chance you saw my reply?

Thank you.

Hey @Mulen,

Sorry for the delay and thanks for the reply. I went ahead and escalated this to github: https://github.com/airbytehq/airbyte/issues/18307.

Thanks for posting the logs, curious to know if the latest version of the connectors solves this issue?

Hello.

No still for the destination is not working.

image

For the source it works just fine.

@Mulen , @sajarin - sorry for my late reply. I reworked everything. THe source was fixed through doing the docker network right. The destination works as of the last update of the connector. Thanks!

Thanks for the reply. Happy to hear it is working!

@Mulen, is it working for you as well?

@sajarin @vjmayr

Sorry but for the Destination Connector same thing happen and can’t connect, non-json response.

The latest version for Destination MySql connector i have in my dashboard is 0.1.20. Is there a new one available to test it and how to get it?

@Mulen, there is a new version of the MySQL connector (0.1.21) let me know if you can upgrade and if the latest version solves this problem.

Again, I have to mention that we don’t explicitly have a MariaDB connector so using the MySQL connector is fragile.

Hello again.

Still not working for the Destination.

From the settings, the Destination connector has version 0.1.20 and it’s the latest.

To summarize again.

The MySql connector works at Source but NOT at Destination.

@Mullen,

There are two different MySQL Destination connectors, one of them being strict-encrypt and the other being the default MySQL.

The strict-encrypt version is on 0.1.20, the default connector is on 0.1.21. If you can, can you try setting up the default connector on version 0.1.21?

Hey, i have the same issue but i only have one mysql desitination connector.
Is it also named “Mysql”?

Valentin commented that updating to latest version solved the issue. Can you try that? If doesn’t work please share the complete log file.

Sorry for the late reply.

Am i missing something? I can not find version 0.1.21.

I installed latest airbyte from scratch and the Destionation Connector of MySQL is 0.1.20.

How can i install version 0.1.21 for the destination connector?

@Mullen, I mispoke earlier, it seems like the strict-encrypt version is on 1.21 based on the dockerfile on Github: https://github.com/airbytehq/airbyte/blob/master/airbyte-integrations/connectors/destination-mysql-strict-encrypt/Dockerfile

Can you share the complete log files? Also I should mention again the MySQL connector may be very fragile when trying to use it with a mariadb database.

I’m also not able to connect to a mariadb, neither with destination-mysql nor with destination-mysql-strict-encrypt while my mariadb does not support tls/ssl, so strict-encrypt will not work anywas.
See Source MySQL - Maridb connect for source and destination fails · Issue #18307 · airbytehq/airbyte · GitHub

1 Like