Can not create MySQL destination, but source is work

  • Is this your first time deploying Airbyte?: Yes
  • OS Version / Instance: Windows
  • Memory / Disk: you can use something like 16Gb / 500Gb
  • Deployment: Docker
  • Airbyte Version: What version are you using now? 0.43.1
  • Source name/version: n/a
  • Destination name/version: MySQL
  • Step: The issue is happening during Creating Destination
  • Description: I create a source connection MySQL it works and I try it as a destination connection but didn’t work and the error is “Access denied”, what is the problem?
2023-04-26 07:58:06 INFO i.a.w.t.TemporalAttemptExecution(get):147 - Executing worker wrapper. Airbyte version: 0.43.1
2023-04-26 07:58:06 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation
2023-04-26 07:58:07 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-04-26 07:58:07 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK -----
2023-04-26 07:58:07 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-04-26 07:58:07 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-04-26 07:58:07 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-04-26 07:58:07 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-04-26 07:58:07 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-04-26 07:58:07 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-04-26 07:58:07 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: ''
2023-04-26 07:58:07 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-mysql:0.1.20 exists...
2023-04-26 07:58:07 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-mysql:0.1.20 was found locally.
2023-04-26 07:58:07 INFO i.a.w.p.DockerProcessFactory(create):133 - Creating docker container = destination-mysql-check-f466b762-e70c-4257-a754-b477951a0037-0-uumyq with resources io.airbyte.config.ResourceRequirements@7205c752[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] and allowedHosts null
2023-04-26 07:58:07 INFO i.a.w.p.DockerProcessFactory(create):184 - Preparing command: docker run --rm --init -i -w /data/f466b762-e70c-4257-a754-b477951a0037/0 --log-driver none --name destination-mysql-check-f466b762-e70c-4257-a754-b477951a0037-0-uumyq --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-mysql:0.1.20 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.43.1 -e WORKER_JOB_ID=f466b762-e70c-4257-a754-b477951a0037 airbyte/destination-mysql:0.1.20 check --config source_config.json
2023-04-26 07:58:07 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):145 - Reading messages from protocol version 0.2.0
2023-04-26 07:58:12 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Class path contains multiple SLF4J bindings.
2023-04-26 07:58:12 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2023-04-26 07:58:12 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2023-04-26 07:58:12 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2023-04-26 07:58:12 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2023-04-26 07:58:13 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2023-04-26 07:58:15 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "2023-04-26 07:58:15 \u001B[32mINFO\u001B[m i.a.i.d.m.MySQLDestination(main):136 - starting destination: class io.airbyte.integrations.destination.mysql.MySQLDestination"
2023-04-26 07:58:15 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "2023-04-26 07:58:15 \u001B[32mINFO\u001B[m i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json}"
2023-04-26 07:58:15 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "2023-04-26 07:58:15 \u001B[32mINFO\u001B[m i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination"
2023-04-26 07:58:15 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "2023-04-26 07:58:15 \u001B[32mINFO\u001B[m i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK"
2023-04-26 07:58:15 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "2023-04-26 07:58:15 \u001B[32mINFO\u001B[m i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}"
2023-04-26 07:58:15 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "2023-04-26 07:58:15 \u001B[33mWARN\u001B[m c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword"
2023-04-26 07:58:15 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "2023-04-26 07:58:15 \u001B[33mWARN\u001B[m c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword"
2023-04-26 07:58:15 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "2023-04-26 07:58:15 \u001B[33mWARN\u001B[m c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword"
2023-04-26 07:58:15 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "2023-04-26 07:58:15 \u001B[33mWARN\u001B[m c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword"
2023-04-26 07:58:16 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "2023-04-26 07:58:16 \u001B[32mINFO\u001B[m i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL"
2023-04-26 07:58:16 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "2023-04-26 07:58:16 \u001B[32mINFO\u001B[m c.z.h.HikariDataSource(<init>):80 - HikariPool-1 - Starting..."
2023-04-26 07:58:16 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "2023-04-26 07:58:16 \u001B[32mINFO\u001B[m c.z.h.HikariDataSource(<init>):82 - HikariPool-1 - Start completed."
2023-04-26 07:58:20 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "2023-04-26 07:58:20 \u001B[1;31mERROR\u001B[m i.a.i.d.m.MySQLDestination(check):83 - Exception while checking connection: "
2023-04-26 07:58:20 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "java.sql.SQLSyntaxErrorException: Access denied for user 'QA_DW'@'%' to database 'qa_dw'"
2023-04-26 07:58:20 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:120) ~[mysql-connector-java-8.0.22.jar:8.0.22]"
2023-04-26 07:58:20 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat com.mysql.cj.jdbc.exceptions.SQLError.createSQLException(SQLError.java:97) ~[mysql-connector-java-8.0.22.jar:8.0.22]"
2023-04-26 07:58:20 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat com.mysql.cj.jdbc.exceptions.SQLExceptionsMapping.translateException(SQLExceptionsMapping.java:122) ~[mysql-connector-java-8.0.22.jar:8.0.22]"
2023-04-26 07:58:20 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat com.mysql.cj.jdbc.StatementImpl.executeInternal(StatementImpl.java:764) ~[mysql-connector-java-8.0.22.jar:8.0.22]"
2023-04-26 07:58:20 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat com.mysql.cj.jdbc.StatementImpl.execute(StatementImpl.java:648) ~[mysql-connector-java-8.0.22.jar:8.0.22]"
2023-04-26 07:58:20 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat com.zaxxer.hikari.pool.ProxyStatement.execute(ProxyStatement.java:94) ~[HikariCP-5.0.1.jar:?]"
2023-04-26 07:58:20 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat com.zaxxer.hikari.pool.HikariProxyStatement.execute(HikariProxyStatement.java) ~[HikariCP-5.0.1.jar:?]"
2023-04-26 07:58:20 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat io.airbyte.db.jdbc.JdbcDatabase.lambda$execute$0(JdbcDatabase.java:47) ~[io.airbyte.airbyte-db-db-lib-0.39.21-alpha.jar:?]"
2023-04-26 07:58:20 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat io.airbyte.db.jdbc.DefaultJdbcDatabase.execute(DefaultJdbcDatabase.java:44) ~[io.airbyte.airbyte-db-db-lib-0.39.21-alpha.jar:?]"
2023-04-26 07:58:20 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat io.airbyte.db.jdbc.JdbcDatabase.execute(JdbcDatabase.java:47) ~[io.airbyte.airbyte-db-db-lib-0.39.21-alpha.jar:?]"
2023-04-26 07:58:20 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat io.airbyte.integrations.destination.jdbc.JdbcSqlOperations.lambda$createSchemaIfNotExists$0(JdbcSqlOperations.java:51) ~[io.airbyte.airbyte-integrations.connectors-destination-jdbc-0.39.21-alpha.jar:?]"
2023-04-26 07:58:20 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:54) ~[io.airbyte.airbyte-integrations.bases-base-java-0.39.21-alpha.jar:?]"
2023-04-26 07:58:20 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat io.airbyte.integrations.destination.jdbc.JdbcSqlOperations.createSchemaIfNotExists(JdbcSqlOperations.java:50) ~[io.airbyte.airbyte-integrations.connectors-destination-jdbc-0.39.21-alpha.jar:?]"
2023-04-26 07:58:21 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat io.airbyte.integrations.destination.jdbc.AbstractJdbcDestination.attemptSQLCreateAndDropTableOperations(AbstractJdbcDestination.java:88) ~[io.airbyte.airbyte-integrations.connectors-destination-jdbc-0.39.21-alpha.jar:?]"
2023-04-26 07:58:21 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat io.airbyte.integrations.destination.mysql.MySQLDestination.check(MySQLDestination.java:69) ~[io.airbyte.airbyte-integrations.connectors-destination-mysql-0.39.21-alpha.jar:?]"
2023-04-26 07:58:21 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat io.airbyte.integrations.base.ssh.SshTunnel.sshWrap(SshTunnel.java:205) [io.airbyte.airbyte-integrations.bases-base-java-0.39.21-alpha.jar:?]"
2023-04-26 07:58:21 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat io.airbyte.integrations.base.ssh.SshWrappedDestination.check(SshWrappedDestination.java:53) [io.airbyte.airbyte-integrations.bases-base-java-0.39.21-alpha.jar:?]"
2023-04-26 07:58:21 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:140) [io.airbyte.airbyte-integrations.bases-base-java-0.39.21-alpha.jar:?]"
2023-04-26 07:58:21 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:107) [io.airbyte.airbyte-integrations.bases-base-java-0.39.21-alpha.jar:?]"
2023-04-26 07:58:21 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "\tat io.airbyte.integrations.destination.mysql.MySQLDestination.main(MySQLDestination.java:137) [io.airbyte.airbyte-integrations.connectors-destination-mysql-0.39.21-alpha.jar:?]"
2023-04-26 07:58:21 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "2023-04-26 07:58:20 \u001B[32mINFO\u001B[m c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated..."
2023-04-26 07:58:21 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "2023-04-26 07:58:21 \u001B[32mINFO\u001B[m c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed."
2023-04-26 07:58:21 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "2023-04-26 07:58:21 \u001B[32mINFO\u001B[m i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination"
2023-04-26 07:58:21 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessage):119 - Deserialization failed: "2023-04-26 07:58:21 \u001B[32mINFO\u001B[m i.a.i.d.m.MySQLDestination(main):138 - completed destination: class io.airbyte.integrations.destination.mysql.MySQLDestination"
2023-04-26 07:58:21 INFO i.a.w.g.DefaultCheckConnectionWorker(run):115 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@66139f97[status=failed,message=Could not connect with provided configuration. 
Access denied for user 'QA_DW'@'%' to database 'qa_dw']
2023-04-26 07:58:21 INFO i.a.w.t.TemporalAttemptExecution(get):169 - Stopping cancellation check scheduling...
2023-04-26 07:58:21 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-04-26 07:58:21 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK -----
2023-04-26 07:58:21 INFO i.a.c.i.LineGobbler(voidCall):149 -  ```

I have ALL PRIVILEGES
1 Like

In my case also I create a source connection MySQL and it works. But then I try it as a destination connection and it didn’t work with this reason “Could not connect with provided configuration. HikariPool-1 - Connection is not available, request timed out after 60002ms.”

check_connection_destination-failure-d8294698-5d9f-4dac-9639-8643052bc2f3.txt (22.5 KB)

I solve it, you should have access as Admin on MySQL because Airbyte create a schema when you connect with it as destination