MySQL Source unable to connect via SSH

  • Is this your first time deploying Airbyte?: No
  • OS Version / Instance: Ubuntu
  • Memory / Disk: 64gb
  • Deployment: Docker
  • Airbyte Version: 0.39.37-alpha
  • Source name/version: MySQL 0.6.0
  • Destination name/version: NA
  • Step: Connecting to Source
  • Description: Unable to connect to MySQL source using SSH
    Error checking connection, status: Optional.empty, exit code: 1

Full logs

2022-08-02 04:13:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-02 04:13:09 INFO i.a.i.b.IntegrationRunner(runInternal):104 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2022-08-02 04:13:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-02 04:13:09 INFO i.a.i.b.IntegrationRunner(runInternal):105 - Command: CHECK
2022-08-02 04:13:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-02 04:13:09 INFO i.a.i.b.IntegrationRunner(runInternal):106 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}
2022-08-02 04:13:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-02 04:13:09 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-08-02 04:13:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-02 04:13:09 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-08-02 04:13:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-02 04:13:09 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-08-02 04:13:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-02 04:13:09 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-08-02 04:13:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-02 04:13:09 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: SSH_KEY_AUTH
2022-08-02 04:13:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-02 04:13:10 ERROR i.a.i.b.AirbyteExceptionHandler(uncaughtException):26 - Something went wrong in the connector. See the logs for more details.
2022-08-02 04:13:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - java.lang.NullPointerException: Cannot invoke "org.bouncycastle.openssl.PEMKeyPair.getPublicKeyInfo()" because "keypair" is null
2022-08-02 04:13:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.base.ssh.SshTunnel.getPrivateKeyPair(SshTunnel.java:237) ~[io.airbyte.airbyte-integrations.bases-base-java-0.39.39-alpha.jar:?]
2022-08-02 04:13:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.base.ssh.SshTunnel.openTunnel(SshTunnel.java:271) ~[io.airbyte.airbyte-integrations.bases-base-java-0.39.39-alpha.jar:?]
2022-08-02 04:13:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.base.ssh.SshTunnel.<init>(SshTunnel.java:134) ~[io.airbyte.airbyte-integrations.bases-base-java-0.39.39-alpha.jar:?]
2022-08-02 04:13:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.base.ssh.SshTunnel.getInstance(SshTunnel.java:185) ~[io.airbyte.airbyte-integrations.bases-base-java-0.39.39-alpha.jar:?]
2022-08-02 04:13:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.base.ssh.SshTunnel.sshWrap(SshTunnel.java:204) ~[io.airbyte.airbyte-integrations.bases-base-java-0.39.39-alpha.jar:?]
2022-08-02 04:13:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.base.ssh.SshWrappedSource.check(SshWrappedSource.java:40) ~[io.airbyte.airbyte-integrations.bases-base-java-0.39.39-alpha.jar:?]
2022-08-02 04:13:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:121) ~[io.airbyte.airbyte-integrations.bases-base-java-0.39.39-alpha.jar:?]
2022-08-02 04:13:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:97) ~[io.airbyte.airbyte-integrations.bases-base-java-0.39.39-alpha.jar:?]
2022-08-02 04:13:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 	at io.airbyte.integrations.source.mysql.MySqlSource.main(MySqlSource.java:211) ~[io.airbyte.airbyte-integrations.connectors-source-mysql-0.39.39-alpha.jar:?]
2022-08-02 04:13:11 ERROR i.a.w.g.DefaultCheckConnectionWorker(run):86 - Error checking connection, status: Optional.empty, exit code: 1
2022-08-02 04:13:11 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling...

Hold up, I just found this SSH Tunnel: allow using OPENSSH key format · Issue #7198 · airbytehq/airbyte · GitHub

How is this still not resolved? I imagine there’s no users that require SSH tunnel access?

Ah nice one! 7198: SSH Tunnel: allow using OPENSSH key format by kimerinn · Pull Request #14876 · airbytehq/airbyte · GitHub

Any updates on https://github.com/airbytehq/airbyte/pull/14876 I’ll return to you. You can use RSA keys and it will work but not with OPENSSH keys