Error with MySQL Connector

Connector Questions & Issues
1

  • Is this your first time deploying Airbyte?: Yes

  • OS Version / Instance: Windows 10

  • Memory / Disk: 16Gb / 255 Gb

  • Deployment: Docker

  • Airbyte Version: 0.40.7

  • Source name/version: MySQL (Alpha)

  • Destination name/version: BigQuery

  • Step: Sync

  • Description: When I try to retrieve the information it prompts me with the following error.

    2022-09-22 06:16:50 e[32mINFOe[m i.a.a.LoggingTrackingClient(track):43 - track. version: null, userId: null, action: Connector Jobs, metadata: {job_type=sync, config.destination.big_query_client_buffer_size_mb=set, namespace_definition=destination, config.destination.loading_method.method=Standard, config.destination.dataset_location=europe-west1, config.source.port=set, frequency=1440 min, connector_source_definition_id=b5ea17b1-f170-46dc-bc31-cc744ca984c1, workspace_id=e2451fcc-5ea9-4000-8d89-563e2266b022, attempt_stage=STARTED, config.source.password._secret=set, config.source.replication_method=set, config.destination.project_id=set, attempt_id=1, connector_destination=BigQuery, connector_destination_docker_repository=airbyte/destination-bigquery, table_prefix=false, config.destination.credentials_json._secret=set, workspace_name=default, catalog.destination_sync_mode.overwrite=set, number_of_streams=2, config.destination.dataset_id=set, connector_source=Microsoft SQL Server (MSSQL), config.source.host=set, config.destination.transformation_priority=interactive, config.source.username=set, connector_source_docker_repository=airbyte/source-mssql, config.source.database=set, catalog.sync_mode.full_refresh=set, connection_id=42634717-d7f3-48f7-ba57-6c954057f7eb, job_id=18101, connector_source_version=0.4.20, connector_destination_version=1.2.1, operation.normalization=1, operation_count=1, connector_destination_definition_id=22f6c74f-5699-40ff-833c-4a879ea40133, config.source.ssl_method.ssl_method=unencrypted}
    2022-09-22 06:16:50 e[32mINFOe[m i.a.w.t.TemporalAttemptExecution(get):106 - Docker volume job log path: /tmp/workspace/18101/0/logs.log
    2022-09-22 06:16:50 e[32mINFOe[m i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.7
    2022-09-22 06:16:50 e[32mINFOe[m i.a.c.i.LineGobbler(voidCall):114 -
    2022-09-22 06:16:50 e[32mINFOe[m i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK -----
    2022-09-22 06:16:50 e[32mINFOe[m i.a.c.i.LineGobbler(voidCall):114 -
    2022-09-22 06:16:50 e[32mINFOe[m i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-mssql:0.4.20 exists…
    2022-09-22 06:16:50 e[32mINFOe[m i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-mssql:0.4.20 was found locally.
    2022-09-22 06:16:50 e[32mINFOe[m i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-mssql-check-18101-0-xshco with resources io.airbyte.config.ResourceRequirements@1e4c5def[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=]
    2022-09-22 06:16:50 e[32mINFOe[m i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/18101/0 --log-driver none --name source-mssql-check-18101-0-xshco --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_CONNECTOR_IMAGE=airbyte/source-mssql:0.4.20 -e WORKER_JOB_ATTEMPT=0 -e AIRBYTE_VERSION=0.40.7 -e WORKER_JOB_ID=18101 airbyte/source-mssql:0.4.20 check --config source_config.json
    2022-09-22 06:16:52 e[32mINFOe[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - starting source: class io.airbyte.integrations.source.mssql.MssqlSource
    2022-09-22 06:16:52 e[32mINFOe[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - integration args: {check=null, config=source_config.json}
    2022-09-22 06:16:52 e[32mINFOe[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource
    2022-09-22 06:16:52 e[32mINFOe[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Command: CHECK
    2022-09-22 06:16:52 e[32mINFOe[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Integration config: IntegrationConfig{command=CHECK, configPath=‘source_config.json’, catalogPath=‘null’, statePath=‘null’}
    2022-09-22 06:16:52 e[33mWARNe[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
    2022-09-22 06:16:52 e[33mWARNe[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
    2022-09-22 06:16:52 e[33mWARNe[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
    2022-09-22 06:16:52 e[33mWARNe[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
    2022-09-22 06:16:52 e[32mINFOe[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Starting connection with method: NO_TUNNEL
    2022-09-22 06:16:52 e[32mINFOe[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Starting…
    2022-09-22 06:16:52 e[32mINFOe[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Start completed.
    2022-09-22 06:16:53 e[32mINFOe[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Attempting to get metadata from the database to see if we can connect.
    2022-09-22 06:16:53 e[32mINFOe[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Shutdown initiated…
    2022-09-22 06:16:53 e[32mINFOe[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Shutdown completed.
    2022-09-22 06:16:53 e[32mINFOe[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource
    2022-09-22 06:16:53 e[32mINFOe[m i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - completed source: class io.airbyte.integrations.source.mssql.MssqlSource
    2022-09-22 06:16:53 e[32mINFOe[m i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling…
    2022-09-22 06:16:53 e[32mINFOe[m i.a.c.i.LineGobbler(voidCall):114 -
    2022-09-22 06:16:53 e[32mINFOe[m i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK -----
    2022-09-22 06:16:53 e[32mINFOe[m i.a.c.i.LineGobbler(voidCall):114 -
    2022-09-22 06:16:53 e[1;31mERRORe[m i.a.s.p.JobNotifier(notifyJob):133 - Unable to read configuration:
    java.lang.NullPointerException: null value in entry: max_seconds_before_source_state_message_emitted=null
    at com.google.common.collect.CollectPreconditions.checkEntryNotNull(CollectPreconditions.java:33) ~[guava-31.1-jre.jar:?]
    at com.google.common.collect.ImmutableMapEntry.(ImmutableMapEntry.java:54) ~[guava-31.1-jre.jar:?]
    at com.google.common.collect.ImmutableMap.entryOf(ImmutableMap.java:339) ~[guava-31.1-jre.jar:?]
    at com.google.common.collect.ImmutableMap$Builder.put(ImmutableMap.java:449) ~[guava-31.1-jre.jar:?]
    at io.airbyte.scheduler.persistence.job_tracker.TrackingMetadata.generateJobAttemptMetadata(TrackingMetadata.java:118) ~[io.airbyte.airbyte-scheduler-scheduler-persistence-0.40.7.jar:?]
    at io.airbyte.scheduler.persistence.JobNotifier.notifyJob(JobNotifier.java:82) ~[io.airbyte.airbyte-scheduler-scheduler-persistence-0.40.7.jar:?]
    at io.airbyte.scheduler.persistence.JobNotifier.notifyJob(JobNotifier.java:61) ~[io.airbyte.airbyte-scheduler-scheduler-persistence-0.40.7.jar:?]
    at io.airbyte.scheduler.persistence.JobNotifier.failJob(JobNotifier.java:167) ~[io.airbyte.airbyte-scheduler-scheduler-persistence-0.40.7.jar:?]
    at io.airbyte.workers.temporal.scheduling.activities.JobCreationAndStatusUpdateActivityImpl.jobFailure(JobCreationAndStatusUpdateActivityImpl.java:229) ~[io.airbyte-airbyte-workers-0.40.7.jar:?]
    at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?]
    at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?]
    at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?]
    at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?]
    at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?]
    at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?]
    at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?]
    at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
    at java.lang.Thread.run(Thread.java:1589) ~[?:?]
    2022-09-22 06:16:53 e[1;31mERRORe[m i.a.c.l.Exceptions(swallow):66 - Swallowed error.
    java.lang.NullPointerException: null value in entry: max_seconds_before_source_state_message_emitted=null
    at com.google.common.collect.CollectPreconditions.checkEntryNotNull(CollectPreconditions.java:33) ~[guava-31.1-jre.jar:?]
    at com.google.common.collect.ImmutableMapEntry.(ImmutableMapEntry.java:54) ~[guava-31.1-jre.jar:?]
    at com.google.common.collect.ImmutableMap.entryOf(ImmutableMap.java:339) ~[guava-31.1-jre.jar:?]
    at com.google.common.collect.ImmutableMap$Builder.put(ImmutableMap.java:449) ~[guava-31.1-jre.jar:?]
    at io.airbyte.scheduler.persistence.job_tracker.TrackingMetadata.generateJobAttemptMetadata(TrackingMetadata.java:118) ~[io.airbyte.airbyte-scheduler-scheduler-persistence-0.40.7.jar:?]
    at io.airbyte.scheduler.persistence.job_tracker.JobTracker.generateJobAttemptMetadata(JobTracker.java:352) ~[io.airbyte.airbyte-scheduler-scheduler-persistence-0.40.7.jar:?]
    at io.airbyte.scheduler.persistence.job_tracker.JobTracker.lambda$trackSync$3(JobTracker.java:135) ~[io.airbyte.airbyte-scheduler-scheduler-persistence-0.40.7.jar:?]
    at io.airbyte.commons.lang.Exceptions.swallow(Exceptions.java:64) ~[io.airbyte-airbyte-commons-0.40.7.jar:?]
    at io.airbyte.scheduler.persistence.job_tracker.JobTracker.trackSync(JobTracker.java:123) ~[io.airbyte.airbyte-scheduler-scheduler-persistence-0.40.7.jar:?]
    at io.airbyte.workers.temporal.scheduling.activities.JobCreationAndStatusUpdateActivityImpl.trackCompletion(JobCreationAndStatusUpdateActivityImpl.java:370) ~[io.airbyte-airbyte-workers-0.40.7.jar:?]
    at io.airbyte.workers.temporal.scheduling.activities.JobCreationAndStatusUpdateActivityImpl.jobFailure(JobCreationAndStatusUpdateActivityImpl.java:231) ~[io.airbyte-airbyte-workers-0.40.7.jar:?]
    at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?]
    at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?]
    at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?]
    at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?]
    at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?]
    at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?]
    at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?]
    at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?]
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
    at java.lang.Thread.run(Thread.java:1589) ~[?:?]
    2022-09-22 06:16:53 e[32mINFOe[m i.a.c.f.EnvVariableFeatureFlags(autoDisablesFailingConnections):18 - Auto Disable Failing Connections: false

2

Hi @matorres, thanks for your patience! We’re at an offsite this week and getting around to things a bit more slowly than usual. I’ll look into this ad hope to have some ideas for you next week!

3

Could you please tell me which connector versions you’re using? Thanks!