RDS MYSQL Source Connector Non Json Response Error when establishing connection

My Company has been using airbyte for the last couple of months to get our data from our data sources into Bigquery. We are hosting on airbyte on a google composer. I have been trying to establish a mysql connection using ssh. I configured everything in the mysql source connector but I am getting a non-json-response error. When I look through the logs I get this:

2022-11-08 16:10:56 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):117 - Server at server presented unverified EC key: key
2022-11-08 16:10:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Established tunneling session to host. Port forwarding started on port
2022-11-08 16:10:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Starting...
2022-11-08 16:10:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Start completed.
2022-11-08 16:11:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Shutdown initiated...
2022-11-08 16:12:00 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Shutdown completed.
2022-11-08 16:12:00 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2022-11-08 16:12:00 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - completed source: class io.airbyte.integrations.source.mysql.MySqlSource
2022-11-08 16:12:00 INFO i.a.c.i.LineGobbler(voidCall):114 -
2022-11-08 16:12:00 INFO i.a.w.t.TemporalAttemptExecution(get):162 - Stopping cancellation check scheduling...
2022-11-08 16:12:00 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK -----
2022-11-08 16:12:00 INFO i.a.c.i.LineGobbler(voidCall):114 -

It seems the the connection was established but I am still getting this error. I updated mysql connector to 1.0.11 and updated airflow version as well. Has anyone faced this problem before?

Hey @kvrunner, are you using SSH rekey by any chance? Could you please provide your Airbyte version and full logs?

Here is the full log and of airbyte is .40.18

2022-11-08 16:10:51 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/ --log-driver none --name source-mysql-check-num  --network host -v airbyte:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/source-mysql:1.0.11 -e AIRBYTE_VERSION=0.40.18 -e WORKER_JOB_ID=worker  airbyte/source-mysql:1.0.11 check --config source_config.json
2022-11-08 16:10:51 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):97 - Reading messages from protocol version 0.2.0
2022-11-08 16:10:52 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - starting source: class io.airbyte.integrations.source.mysql.MySqlSource
2022-11-08 16:10:53 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - integration args: {check=null, config=source_config.json}
2022-11-08 16:10:53 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2022-11-08 16:10:53 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Command: CHECK
2022-11-08 16:10:53 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}
2022-11-08 16:10:53 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):117 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-11-08 16:10:53 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):117 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-11-08 16:10:53 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):117 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-11-08 16:10:54 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Starting connection with method: SSH_KEY_AUTH
2022-11-08 16:10:54 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - getOrCreateProvider(EdDSA) created instance of net
2022-11-08 16:10:54 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Using MinaServiceFactoryFactory
2022-11-08 16:10:56 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):117 - Server at server presented unverified EC key: sha
2022-11-08 16:10:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Established tunneling session to host. Port forwarding started on ip
2022-11-08 16:10:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Starting...
2022-11-08 16:10:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Start completed.
2022-11-08 16:11:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Shutdown initiated...
2022-11-08 16:12:00 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Shutdown completed.
2022-11-08 16:12:00 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2022-11-08 16:12:00 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - completed source: class io.airbyte.integrations.source.mysql.MySqlSource
2022-11-08 16:12:00 INFO i.a.c.i.LineGobbler(voidCall):114 -
2022-11-08 16:12:00 INFO i.a.w.t.TemporalAttemptExecution(get):162 - Stopping cancellation check scheduling...
2022-11-08 16:12:00 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK -----
2022-11-08 16:12:00 INFO i.a.c.i.LineGobbler(voidCall):114 -

Hmm I am also not sure about the Rekey but will ask the team. Will that cause any issues if do use it?

It seems like it could, please let me know when you find out!

Hey @natalyjazzviolin ,
apologies for the late response but it seems we do rekey.
This is the response I got from the team → OpenSSH runs with the default setting “RekeyLimit default none” by default, which means rekeying happens every 1 to 4 GB (depending on the actual symmetric cipher used).

Hey! This looks like a bug, so I’ve escalated it to GitHub and triaged it:
https://github.com/airbytehq/airbyte/issues/19933

Please feel free to follow up there and include any more info you find!