2023-06-02 09:39:33 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/12/0/logs.log 2023-06-02 09:39:33 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 09:39:33 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 09:39:33 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:39:33 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK ----- 2023-06-02 09:39:33 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:39:33 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:39:33 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:39:33 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:39:33 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 09:39:33 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 09:39:33 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:39:33 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-postgres:2.0.26 exists... 2023-06-02 09:39:33 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-postgres:2.0.26 was found locally. 2023-06-02 09:39:33 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = source-postgres-check-12-0-vcyhh with resources io.airbyte.config.ResourceRequirements@43d96782[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts io.airbyte.config.AllowedHosts@1c5ebce5[hosts=[localhost, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}] 2023-06-02 09:39:33 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/0 --log-driver none --name source-postgres-check-12-0-vcyhh --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:2.0.26 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=12 airbyte/source-postgres:2.0.26 check --config source_config.json 2023-06-02 09:39:33 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 09:39:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresSource(main):484 starting source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 09:39:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {check=null, config=source_config.json} 2023-06-02 09:39:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):108 Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 09:39:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):109 Command: CHECK 2023-06-02 09:39:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):110 Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2023-06-02 09:39:38 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword groups - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:39:38 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:39:38 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword group - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:39:38 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:39:38 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:39:39 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.s.SshTunnel(getInstance):204 Starting connection with method: NO_TUNNEL 2023-06-02 09:39:39 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 09:39:39 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresSource(toSslJdbcParamInternal):521 DISABLED toSslJdbcParam disable 2023-06-02 09:39:39 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource():80 HikariPool-1 - Starting... 2023-06-02 09:39:39 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource():82 HikariPool-1 - Start completed. 2023-06-02 09:39:40 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 09:39:40 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 09:39:40 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):134 Attempting to get metadata from the database to see if we can connect. 2023-06-02 09:39:40 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource(close):350 HikariPool-1 - Shutdown initiated... 2023-06-02 09:39:40 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource(close):352 HikariPool-1 - Shutdown completed. 2023-06-02 09:39:40 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):186 Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 09:39:40 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresSource(main):486 completed source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 09:39:40 INFO i.a.w.g.DefaultCheckConnectionWorker(run):115 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@682fe13c[status=succeeded,message=,additionalProperties={}] 2023-06-02 09:39:40 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:39:40 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 09:39:40 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK ----- 2023-06-02 09:39:40 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:39:40 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/12/0/logs.log 2023-06-02 09:39:40 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 09:39:40 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 09:39:40 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:39:40 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:39:40 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:39:40 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:39:40 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 09:39:40 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 09:39:40 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:39:40 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK ----- 2023-06-02 09:39:40 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:39:40 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-mysql:0.1.20 exists... 2023-06-02 09:39:40 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-mysql:0.1.20 was found locally. 2023-06-02 09:39:40 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = destination-mysql-check-12-0-qxqza with resources io.airbyte.config.ResourceRequirements@43d96782[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 09:39:40 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/0 --log-driver none --name destination-mysql-check-12-0-qxqza --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-mysql:0.1.20 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=12 airbyte/destination-mysql:0.1.20 check --config source_config.json 2023-06-02 09:39:40 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 09:39:42 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Class path contains multiple SLF4J bindings. 2023-06-02 09:39:42 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 09:39:42 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 09:39:42 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 09:39:42 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2023-06-02 09:39:42 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2023-06-02 09:39:45 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:39:45 INFO i.a.i.d.m.MySQLDestination(main):136 - starting destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 09:39:45 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:39:45 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2023-06-02 09:39:45 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:39:45 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 09:39:45 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:39:45 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK 2023-06-02 09:39:45 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:39:45 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2023-06-02 09:39:45 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:39:45 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:39:45 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:39:45 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:39:45 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:39:45 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:39:45 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:39:45 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:39:46 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:39:46 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2023-06-02 09:39:46 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:39:46 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2023-06-02 09:39:46 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:39:46 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2023-06-02 09:39:49 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:39:49 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated... 2023-06-02 09:39:49 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:39:49 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed. 2023-06-02 09:39:49 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:39:49 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 09:39:49 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:39:49 INFO i.a.i.d.m.MySQLDestination(main):138 - completed destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 09:39:50 INFO i.a.w.g.DefaultCheckConnectionWorker(run):115 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@3151dbf0[status=succeeded,message=,additionalProperties={}] 2023-06-02 09:39:50 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 09:39:50 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:39:50 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK ----- 2023-06-02 09:39:50 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:39:50 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get state 2023-06-02 09:39:50 INFO i.a.w.h.NormalizationInDestinationHelper(shouldNormalizeInDestination):52 - Requires Normalization: true Normalization Supported: false, Feature Flag Enabled: false 2023-06-02 09:39:50 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to set attempt sync config 2023-06-02 09:39:50 INFO i.a.c.t.s.DefaultTaskQueueMapper(getTaskQueue):31 - Called DefaultTaskQueueMapper getTaskQueue for geography auto 2023-06-02 09:39:51 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/12/0/logs.log 2023-06-02 09:39:51 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 09:39:51 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 09:39:51 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get the source for heartbeat 2023-06-02 09:39:51 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get the source definition 2023-06-02 09:39:51 INFO i.a.w.g.ReplicationWorkerFactory(create):95 - Setting up source... 2023-06-02 09:39:51 INFO i.a.w.g.ReplicationWorkerFactory(create):99 - Setting up destination... 2023-06-02 09:39:51 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable METRIC_CLIENT: '' 2023-06-02 09:39:51 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2023-06-02 09:39:51 INFO i.a.w.g.ReplicationWorkerFactory(create):108 - Setting up replication worker... 2023-06-02 09:39:51 INFO i.a.w.g.DefaultReplicationWorker(run):162 - start sync worker. job id: 12 attempt id: 0 2023-06-02 09:39:51 INFO i.a.w.g.DefaultReplicationWorker(run):164 - Committing states from replication activity 2023-06-02 09:39:51 INFO i.a.w.g.DefaultReplicationWorker(run):167 - Committing stats from replication activity 2023-06-02 09:39:51 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:39:51 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START REPLICATION ----- 2023-06-02 09:39:51 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:39:51 INFO i.a.w.g.DefaultReplicationWorker(run):183 - configured sync modes: {public.WTT_CustomerAssetsReading=full_refresh - overwrite, public.WTT_Customer=full_refresh - overwrite, public.WTT_Asset=full_refresh - overwrite} 2023-06-02 09:39:51 INFO i.a.w.i.DefaultAirbyteDestination(start):92 - Running destination... 2023-06-02 09:39:51 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:39:51 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:39:51 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:39:51 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:39:51 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 09:39:51 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 09:39:51 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-mysql:0.1.20 exists... 2023-06-02 09:39:51 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-mysql:0.1.20 was found locally. 2023-06-02 09:39:51 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = destination-mysql-write-12-0-zsgvp with resources io.airbyte.config.ResourceRequirements@a4df138[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 09:39:51 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/0 --log-driver none --name destination-mysql-write-12-0-zsgvp --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-mysql:0.1.20 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=12 airbyte/destination-mysql:0.1.20 write --config destination_config.json --catalog destination_catalog.json 2023-06-02 09:39:51 INFO i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):41 - Writing messages to protocol version 0.2.0 2023-06-02 09:39:51 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 09:39:51 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:39:51 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:39:51 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:39:51 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:39:51 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 09:39:51 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 09:39:51 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-postgres:2.0.26 exists... 2023-06-02 09:39:51 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-postgres:2.0.26 was found locally. 2023-06-02 09:39:51 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = source-postgres-read-12-0-wfrgj with resources io.airbyte.config.ResourceRequirements@26c7a23c[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts io.airbyte.config.AllowedHosts@703e79f1[hosts=[localhost, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}] 2023-06-02 09:39:51 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/0 --log-driver none --name source-postgres-read-12-0-wfrgj --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:2.0.26 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=12 airbyte/source-postgres:2.0.26 read --config source_config.json --catalog source_catalog.json 2023-06-02 09:39:51 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 09:39:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromDstRunnable$4):311 - Destination output thread started. 2023-06-02 09:39:51 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):94 - Starting source heartbeat check. Will check every 1 minutes. 2023-06-02 09:39:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):377 - Replication thread started. 2023-06-02 09:39:53 destination > SLF4J: Class path contains multiple SLF4J bindings. 2023-06-02 09:39:53 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 09:39:53 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 09:39:53 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 09:39:53 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2023-06-02 09:39:53 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2023-06-02 09:39:55 destination > 2023-06-02 09:39:55 INFO i.a.i.d.m.MySQLDestination(main):136 - starting destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 09:39:56 source > INFO i.a.i.s.p.PostgresSource(main):484 starting source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 09:39:56 destination > 2023-06-02 09:39:56 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2023-06-02 09:39:56 destination > 2023-06-02 09:39:56 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 09:39:56 destination > 2023-06-02 09:39:56 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE 2023-06-02 09:39:56 destination > 2023-06-02 09:39:56 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2023-06-02 09:39:56 source > INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {read=null, catalog=source_catalog.json, config=source_config.json} 2023-06-02 09:39:56 source > INFO i.a.i.b.IntegrationRunner(runInternal):108 Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 09:39:56 source > INFO i.a.i.b.IntegrationRunner(runInternal):109 Command: READ 2023-06-02 09:39:56 source > INFO i.a.i.b.IntegrationRunner(runInternal):110 Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='null'} 2023-06-02 09:39:56 destination > 2023-06-02 09:39:56 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:39:56 destination > 2023-06-02 09:39:56 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:39:56 destination > 2023-06-02 09:39:56 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:39:56 destination > 2023-06-02 09:39:56 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:39:56 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword groups - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:39:56 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:39:56 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword group - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:39:56 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:39:56 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:39:57 destination > 2023-06-02 09:39:57 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2023-06-02 09:39:57 destination > 2023-06-02 09:39:57 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2023-06-02 09:39:57 destination > 2023-06-02 09:39:57 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2023-06-02 09:39:57 source > INFO i.a.i.b.s.SshTunnel(getInstance):204 Starting connection with method: NO_TUNNEL 2023-06-02 09:39:57 source > INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 09:39:57 source > INFO i.a.i.s.r.s.StateManagerFactory(createStateManager):55 Stream state manager selected to manage state object with type STREAM. 2023-06-02 09:39:57 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):181 No cursor field set in catalog but not present in state. Stream: public_WTT_CustomerAssetsReading, New Cursor Field: null. Resetting cursor value 2023-06-02 09:39:57 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):181 No cursor field set in catalog but not present in state. Stream: public_WTT_Asset, New Cursor Field: null. Resetting cursor value 2023-06-02 09:39:57 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):181 No cursor field set in catalog but not present in state. Stream: public_WTT_Customer, New Cursor Field: null. Resetting cursor value 2023-06-02 09:39:57 source > INFO i.a.i.s.p.PostgresSource(toSslJdbcParamInternal):521 DISABLED toSslJdbcParam disable 2023-06-02 09:39:57 destination > 2023-06-02 09:39:57 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=WTT_CustomerAssetsReading, namespace=null, outputSchemaName=airbytepoc, tmpTableName=_airbyte_tmp_crv_wtt_customerassetsreading, outputTableName=_airbyte_raw_wtt_customerassetsreading, syncMode=overwrite} 2023-06-02 09:39:57 destination > 2023-06-02 09:39:57 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=WTT_Customer, namespace=null, outputSchemaName=airbytepoc, tmpTableName=_airbyte_tmp_niq_wtt_customer, outputTableName=_airbyte_raw_wtt_customer, syncMode=overwrite} 2023-06-02 09:39:57 destination > 2023-06-02 09:39:57 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=WTT_Asset, namespace=null, outputSchemaName=airbytepoc, tmpTableName=_airbyte_tmp_ijt_wtt_asset, outputTableName=_airbyte_raw_wtt_asset, syncMode=overwrite} 2023-06-02 09:39:57 source > INFO c.z.h.HikariDataSource():80 HikariPool-1 - Starting... 2023-06-02 09:39:57 destination > 2023-06-02 09:39:57 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2023-06-02 09:39:57 destination > 2023-06-02 09:39:57 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):123 - Preparing tmp tables in destination started for 3 streams 2023-06-02 09:39:57 destination > 2023-06-02 09:39:57 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream WTT_CustomerAssetsReading. schema: airbytepoc, tmp table name: _airbyte_tmp_crv_wtt_customerassetsreading 2023-06-02 09:39:57 source > INFO c.z.h.HikariDataSource():82 HikariPool-1 - Start completed. 2023-06-02 09:39:58 source > INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 09:39:58 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):440 Data source product recognized as PostgreSQL:15.3 (Debian 15.3-1.pgdg110+1) 2023-06-02 09:39:58 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):452 Discovering indexes for schema "public", table "WTT_CustomerAssetsReading" 2023-06-02 09:39:58 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_CustomerAssetsReading_pkey, Column: id, Unique: true 2023-06-02 09:39:58 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):452 Discovering indexes for schema "public", table "WTT_Customer" 2023-06-02 09:39:58 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Customer_pkey, Column: id, Unique: true 2023-06-02 09:39:58 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__customer_asset_id, Column: assetId, Unique: false 2023-06-02 09:39:58 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__customer_created_by_id, Column: createdById, Unique: false 2023-06-02 09:39:58 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__customer_updated_by_id, Column: updatedById, Unique: false 2023-06-02 09:39:58 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):452 Discovering indexes for schema "public", table "WTT_Asset" 2023-06-02 09:39:58 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Asset_Code_uk, Column: Code, Unique: true 2023-06-02 09:39:58 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Asset_Name_uk, Column: Name, Unique: true 2023-06-02 09:39:58 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Asset_pkey, Column: id, Unique: true 2023-06-02 09:39:58 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__asset_created_by_id, Column: createdById, Unique: false 2023-06-02 09:39:58 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__asset_updated_by_id, Column: updatedById, Unique: false 2023-06-02 09:39:58 source > INFO i.a.i.s.p.PostgresQueryUtils(logXminStatus):76 Xmin Status : {Number of wraparounds: 0, Xmin Transaction Value: 1142, Xmin Raw Value: 1142 2023-06-02 09:39:58 source > INFO i.a.i.s.j.AbstractJdbcSource(discoverInternal):162 Internal schemas to exclude: [catalog_history, information_schema, pg_catalog, pg_internal] 2023-06-02 09:39:58 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 09:39:58 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(accept):40 Set new fetch size: 1323960 rows 2023-06-02 09:39:58 source > INFO i.a.d.j.s.TwoStageSizeEstimator(getTargetBufferByteSize):71 Max memory limit: 6174015488, JDBC buffer size: 3704409293 2023-06-02 09:39:58 source > INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 09:39:58 source > INFO i.a.i.s.p.PostgresSource(estimateFullRefreshSyncSize):575 Estimate for table: "public"."WTT_CustomerAssetsReading" : {sync_row_count: 286, sync_bytes: 24576, total_table_row_count: 286, total_table_bytes: 24576} 2023-06-02 09:39:58 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableFullRefresh):111 Queueing query for table: WTT_CustomerAssetsReading 2023-06-02 09:39:58 source > INFO i.a.i.s.p.PostgresSource(estimateFullRefreshSyncSize):575 Estimate for table: "public"."WTT_Customer" : {sync_row_count: 7, sync_bytes: 8192, total_table_row_count: 7, total_table_bytes: 8192} 2023-06-02 09:39:58 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableFullRefresh):111 Queueing query for table: WTT_Customer 2023-06-02 09:39:58 source > INFO i.a.i.s.p.PostgresSource(estimateFullRefreshSyncSize):575 Estimate for table: "public"."WTT_Asset" : {sync_row_count: 2, sync_bytes: 8192, total_table_row_count: 2, total_table_bytes: 8192} 2023-06-02 09:39:58 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableFullRefresh):111 Queueing query for table: WTT_Asset 2023-06-02 09:39:58 source > INFO i.a.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):67 Queueing query: SELECT "sort","id","ReadingDateTime","AssetId","Value" FROM "public"."WTT_CustomerAssetsReading" 2023-06-02 09:39:58 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 09:39:58 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(accept):40 Set new fetch size: 929589 rows 2023-06-02 09:39:58 source > INFO i.a.d.j.s.TwoStageSizeEstimator(getTargetBufferByteSize):71 Max memory limit: 6174015488, JDBC buffer size: 3704409293 2023-06-02 09:39:58 destination > 2023-06-02 09:39:58 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream WTT_Customer. schema: airbytepoc, tmp table name: _airbyte_tmp_niq_wtt_customer 2023-06-02 09:39:58 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(accept):40 Set new fetch size: 12862532 rows 2023-06-02 09:39:59 destination > 2023-06-02 09:39:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream WTT_Asset. schema: airbytepoc, tmp table name: _airbyte_tmp_ijt_wtt_asset 2023-06-02 09:39:59 source > INFO i.a.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):67 Queueing query: SELECT "createdAt","updatedAt","sort","createdById","updatedById","id","name","Description","IsActive","assetId" FROM "public"."WTT_Customer" 2023-06-02 09:39:59 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 09:39:59 source > INFO i.a.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):67 Queueing query: SELECT "createdAt","updatedAt","sort","createdById","updatedById","id","Name","Code" FROM "public"."WTT_Asset" 2023-06-02 09:39:59 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 09:39:59 source > INFO i.a.i.s.r.AbstractDbSource(lambda$read$1):172 Closing database connection pool. 2023-06-02 09:39:59 source > INFO c.z.h.HikariDataSource(close):350 HikariPool-1 - Shutdown initiated... 2023-06-02 09:39:59 source > INFO c.z.h.HikariDataSource(close):352 HikariPool-1 - Shutdown completed. 2023-06-02 09:39:59 source > INFO i.a.i.s.r.AbstractDbSource(lambda$read$1):174 Closed database connection pool. 2023-06-02 09:39:59 source > INFO i.a.i.b.IntegrationRunner(runInternal):186 Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 09:39:59 source > INFO i.a.i.s.p.PostgresSource(main):486 completed source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 09:39:59 destination > 2023-06-02 09:39:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):133 - Preparing tables in destination completed. 2023-06-02 09:39:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):439 - Source has no more messages, closing connection. 2023-06-02 09:39:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):448 - Total records read: 298 (28 KB) 2023-06-02 09:39:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):464 - Schema validation was performed to a max of 10 records with errors per stream. 2023-06-02 09:39:59 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):466 - Schema validation errors found for stream public_WTT_CustomerAssetsReading. Error messages: [$.sort: null found, number expected] 2023-06-02 09:39:59 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):466 - Schema validation errors found for stream public_WTT_Customer. Error messages: [$.assetId: null found, number expected] 2023-06-02 09:39:59 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):111 - thread status... heartbeat thread: false , replication thread: true 2023-06-02 09:39:59 INFO i.a.w.g.DefaultReplicationWorker(replicate):267 - Waiting for source and destination threads to complete. 2023-06-02 09:39:59 INFO i.a.w.g.DefaultReplicationWorker(replicate):272 - One of source or destination thread complete. Waiting on the other. 2023-06-02 09:39:59 destination > 2023-06-02 09:39:59 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2023-06-02 09:39:59 destination > 2023-06-02 09:39:59 INFO i.a.i.d.b.BufferedStreamConsumer(close):171 - executing on success close procedure. 2023-06-02 09:39:59 destination > 2023-06-02 09:39:59 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing WTT_CustomerAssetsReading: 286 records (113 KB) 2023-06-02 09:39:59 destination > 2023-06-02 09:39:59 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing WTT_Customer: 7 records (113 KB) 2023-06-02 09:39:59 destination > 2023-06-02 09:39:59 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing WTT_Asset: 2 records (113 KB) 2023-06-02 09:39:59 destination > 2023-06-02 09:39:59 INFO i.a.i.d.j.SqlOperations(onDestinationCloseOperations):138 - No onDestinationCloseOperations required for this destination. 2023-06-02 09:39:59 destination > 2023-06-02 09:39:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):163 - Finalizing tables in destination started for 3 streams 2023-06-02 09:39:59 destination > 2023-06-02 09:39:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream WTT_CustomerAssetsReading. schema airbytepoc, tmp table _airbyte_tmp_crv_wtt_customerassetsreading, final table _airbyte_raw_wtt_customerassetsreading 2023-06-02 09:39:59 destination > 2023-06-02 09:39:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream WTT_Customer. schema airbytepoc, tmp table _airbyte_tmp_niq_wtt_customer, final table _airbyte_raw_wtt_customer 2023-06-02 09:39:59 destination > 2023-06-02 09:39:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream WTT_Asset. schema airbytepoc, tmp table _airbyte_tmp_ijt_wtt_asset, final table _airbyte_raw_wtt_asset 2023-06-02 09:39:59 destination > 2023-06-02 09:39:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - Executing finalization of tables. 2023-06-02 09:40:00 destination > 2023-06-02 09:40:00 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):183 - Finalizing tables in destination completed. 2023-06-02 09:40:00 destination > 2023-06-02 09:40:00 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):186 - Cleaning tmp tables in destination started for 3 streams 2023-06-02 09:40:00 destination > 2023-06-02 09:40:00 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream WTT_CustomerAssetsReading. schema airbytepoc, tmp table name: _airbyte_tmp_crv_wtt_customerassetsreading 2023-06-02 09:40:00 destination > 2023-06-02 09:40:00 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream WTT_Customer. schema airbytepoc, tmp table name: _airbyte_tmp_niq_wtt_customer 2023-06-02 09:40:00 destination > 2023-06-02 09:40:00 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream WTT_Asset. schema airbytepoc, tmp table name: _airbyte_tmp_ijt_wtt_asset 2023-06-02 09:40:00 destination > 2023-06-02 09:40:00 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):195 - Cleaning tmp tables in destination completed. 2023-06-02 09:40:00 destination > 2023-06-02 09:40:00 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 09:40:00 destination > 2023-06-02 09:40:00 INFO i.a.i.d.m.MySQLDestination(main):138 - completed destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 09:40:00 INFO i.a.w.g.DefaultReplicationWorker(replicate):274 - Source and destination threads complete. 2023-06-02 09:40:00 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):569 - sync summary: { "status" : "completed", "recordsSynced" : 295, "bytesSynced" : 29038, "startTime" : 1685698791471, "endTime" : 1685698800429, "totalStats" : { "bytesCommitted" : 29038, "bytesEmitted" : 29038, "destinationStateMessagesEmitted" : 0, "destinationWriteEndTime" : 1685698800428, "destinationWriteStartTime" : 1685698791690, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0, "recordsEmitted" : 295, "recordsCommitted" : 295, "replicationEndTime" : 1685698800429, "replicationStartTime" : 1685698791471, "sourceReadEndTime" : 1685698799378, "sourceReadStartTime" : 1685698791564, "sourceStateMessagesEmitted" : 0 }, "streamStats" : [ { "streamName" : "WTT_CustomerAssetsReading", "stats" : { "bytesCommitted" : 27240, "bytesEmitted" : 27240, "recordsEmitted" : 286, "recordsCommitted" : 286 } }, { "streamName" : "WTT_Customer", "stats" : { "bytesCommitted" : 1436, "bytesEmitted" : 1436, "recordsEmitted" : 7, "recordsCommitted" : 7 } }, { "streamName" : "WTT_Asset", "stats" : { "bytesCommitted" : 362, "bytesEmitted" : 362, "recordsEmitted" : 2, "recordsCommitted" : 2 } }, { "streamName" : "WTT_CustomerAssetsReading", "streamNamespace" : "public", "stats" : { "bytesCommitted" : 0, "bytesEmitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0 } }, { "streamName" : "WTT_Asset", "streamNamespace" : "public", "stats" : { "bytesCommitted" : 0, "bytesEmitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0 } }, { "streamName" : "WTT_Customer", "streamNamespace" : "public", "stats" : { "bytesCommitted" : 0, "bytesEmitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0 } } ] } 2023-06-02 09:40:00 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):570 - failures: [ ] 2023-06-02 09:40:00 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 09:40:00 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:00 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END REPLICATION ----- 2023-06-02 09:40:00 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:00 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):157 - sync summary: io.airbyte.config.StandardSyncOutput@1f187619[standardSyncSummary=io.airbyte.config.StandardSyncSummary@2352f07f[status=completed,recordsSynced=295,bytesSynced=29038,startTime=1685698791471,endTime=1685698800429,totalStats=io.airbyte.config.SyncStats@796dd934[bytesCommitted=29038,bytesEmitted=29038,destinationStateMessagesEmitted=0,destinationWriteEndTime=1685698800428,destinationWriteStartTime=1685698791690,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,recordsEmitted=295,recordsCommitted=295,replicationEndTime=1685698800429,replicationStartTime=1685698791471,sourceReadEndTime=1685698799378,sourceReadStartTime=1685698791564,sourceStateMessagesEmitted=0,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@73609dcc[streamName=WTT_CustomerAssetsReading,streamNamespace=,stats=io.airbyte.config.SyncStats@2f948507[bytesCommitted=27240,bytesEmitted=27240,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=286,recordsCommitted=286,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@1bf15982[streamName=WTT_Customer,streamNamespace=,stats=io.airbyte.config.SyncStats@cc297b1[bytesCommitted=1436,bytesEmitted=1436,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=7,recordsCommitted=7,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@7b3be518[streamName=WTT_Asset,streamNamespace=,stats=io.airbyte.config.SyncStats@700cebc5[bytesCommitted=362,bytesEmitted=362,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=2,recordsCommitted=2,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@6120810f[streamName=WTT_CustomerAssetsReading,streamNamespace=public,stats=io.airbyte.config.SyncStats@7947fd85[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=0,recordsCommitted=0,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@5df0d490[streamName=WTT_Asset,streamNamespace=public,stats=io.airbyte.config.SyncStats@4a354e28[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=0,recordsCommitted=0,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@2ff88698[streamName=WTT_Customer,streamNamespace=public,stats=io.airbyte.config.SyncStats@6995fd37[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=0,recordsCommitted=0,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}]],additionalProperties={}],normalizationSummary=,webhookOperationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@321ae0c1[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@523eaca4[stream=io.airbyte.protocol.models.AirbyteStream@39192c3d[name=WTT_CustomerAssetsReading,jsonSchema={"type":"object","properties":{"Value":{"airbyte_type":"integer","type":"number"},"id":{"airbyte_type":"integer","type":"number"},"sort":{"airbyte_type":"integer","type":"number"},"ReadingDateTime":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"AssetId":{"airbyte_type":"integer","type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@7f23026c[stream=io.airbyte.protocol.models.AirbyteStream@1adae9a1[name=WTT_Customer,jsonSchema={"type":"object","properties":{"createdAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"Description":{"type":"string"},"assetId":{"airbyte_type":"integer","type":"number"},"IsActive":{"type":"boolean"},"name":{"type":"string"},"id":{"airbyte_type":"integer","type":"number"},"sort":{"airbyte_type":"integer","type":"number"},"updatedById":{"airbyte_type":"integer","type":"number"},"createdById":{"airbyte_type":"integer","type":"number"},"updatedAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@3d263dd2[stream=io.airbyte.protocol.models.AirbyteStream@4d2e968f[name=WTT_Asset,jsonSchema={"type":"object","properties":{"createdAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"id":{"airbyte_type":"integer","type":"number"},"sort":{"airbyte_type":"integer","type":"number"},"updatedById":{"airbyte_type":"integer","type":"number"},"Code":{"type":"string"},"createdById":{"airbyte_type":"integer","type":"number"},"Name":{"type":"string"},"updatedAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[],commitStateAsap=true,additionalProperties={}] 2023-06-02 09:40:00 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):162 - Sync summary length: 8382 2023-06-02 09:40:00 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-06-02 09:40:00 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):134 - Using protocol v1 2023-06-02 09:40:00 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):145 - Using normalization: airbyte/normalization-mysql:0.3.0 2023-06-02 09:40:00 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/12/0/logs.log 2023-06-02 09:40:00 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 09:40:00 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 09:40:00 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:00 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START DEFAULT NORMALIZATION ----- 2023-06-02 09:40:00 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:00 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):129 - Running with normalization version: airbyte/normalization-mysql:0.3.0 2023-06-02 09:40:00 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/normalization-mysql:0.3.0 exists... 2023-06-02 09:40:00 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = normalization-mysql-normalize-12-0-nwbjl with resources io.airbyte.config.ResourceRequirements@7b4a618e[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 09:40:00 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/normalization-mysql:0.3.0 was found locally. 2023-06-02 09:40:00 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/0/normalize --log-driver none --name normalization-mysql-normalize-12-0-nwbjl --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.44.3 airbyte/normalization-mysql:0.3.0 run --integration-type mysql --config destination_config.json --catalog destination_catalog.json 2023-06-02 09:40:01 normalization > Running: transform-config --config destination_config.json --integration-type mysql --out /data/12/0/normalize 2023-06-02 09:40:02 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/12/0/normalize') 2023-06-02 09:40:02 normalization > transform_mysql 2023-06-02 09:40:03 normalization > Running: transform-catalog --integration-type mysql --profile-config-dir /data/12/0/normalize --catalog destination_catalog.json --out /data/12/0/normalize/models/generated/ --json-column _airbyte_data 2023-06-02 09:40:04 normalization > Processing destination_catalog.json... 2023-06-02 09:40:04 normalization > Generating airbyte_ctes/airbytepoc/wtt_customerassetsreading_ab1.sql from WTT_CustomerAssetsReading 2023-06-02 09:40:04 normalization > Generating airbyte_ctes/airbytepoc/wtt_customerassetsreading_ab2.sql from WTT_CustomerAssetsReading 2023-06-02 09:40:04 normalization > Generating airbyte_ctes/airbytepoc/wtt_customerassetsreading_ab3.sql from WTT_CustomerAssetsReading 2023-06-02 09:40:04 normalization > Adding drop table hook for wtt_customerassetsreading_scd to wtt_customerassetsreading 2023-06-02 09:40:04 normalization > Generating airbyte_tables/airbytepoc/wtt_customerassetsreading.sql from WTT_CustomerAssetsReading 2023-06-02 09:40:04 normalization > Generating airbyte_ctes/airbytepoc/wtt_customer_ab1.sql from WTT_Customer 2023-06-02 09:40:04 normalization > Generating airbyte_ctes/airbytepoc/wtt_customer_ab2.sql from WTT_Customer 2023-06-02 09:40:04 normalization > Generating airbyte_ctes/airbytepoc/wtt_customer_ab3.sql from WTT_Customer 2023-06-02 09:40:04 normalization > Adding drop table hook for wtt_customer_scd to wtt_customer 2023-06-02 09:40:04 normalization > Generating airbyte_tables/airbytepoc/wtt_customer.sql from WTT_Customer 2023-06-02 09:40:04 normalization > Generating airbyte_ctes/airbytepoc/wtt_asset_ab1.sql from WTT_Asset 2023-06-02 09:40:04 normalization > Generating airbyte_ctes/airbytepoc/wtt_asset_ab2.sql from WTT_Asset 2023-06-02 09:40:04 normalization > Generating airbyte_ctes/airbytepoc/wtt_asset_ab3.sql from WTT_Asset 2023-06-02 09:40:04 normalization > Adding drop table hook for wtt_asset_scd to wtt_asset 2023-06-02 09:40:04 normalization > Generating airbyte_tables/airbytepoc/wtt_asset.sql from WTT_Asset 2023-06-02 09:40:04 normalization > detected no config file for ssh, assuming ssh is off. 2023-06-02 09:40:09 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2023-06-02 09:40:09 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2023-06-02 09:40:09 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-06-02 09:40:09 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2023-06-02 09:40:09 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-06-02 09:40:14 normalization > Running with dbt=1.0.0 2023-06-02 09:40:14 normalization > Partial parse save file not found. Starting full parse. 2023-06-02 09:40:18 normalization > [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. There are 2 unused configuration paths: - models.airbyte_utils.generated.airbyte_incremental - models.airbyte_utils.generated.airbyte_views 2023-06-02 09:40:18 normalization > Found 12 models, 0 tests, 0 snapshots, 0 analyses, 591 macros, 0 operations, 0 seed files, 3 sources, 0 exposures, 0 metrics 2023-06-02 09:40:18 normalization > Concurrency: 1 threads (target='prod') 2023-06-02 09:40:19 normalization > 1 of 3 START table model airbytepoc.wtt_asset........................................................................... [RUN] 2023-06-02 09:40:19 normalization > 1 of 3 OK created table model airbytepoc.wtt_asset...................................................................... [SUCCESS 2 in 0.51s] 2023-06-02 09:40:19 normalization > 2 of 3 START table model airbytepoc.wtt_customer........................................................................ [RUN] 2023-06-02 09:40:20 normalization > 2 of 3 OK created table model airbytepoc.wtt_customer................................................................... [SUCCESS 7 in 0.45s] 2023-06-02 09:40:20 normalization > 3 of 3 START table model airbytepoc.wtt_customerassetsreading........................................................... [RUN] 2023-06-02 09:40:20 normalization > 3 of 3 OK created table model airbytepoc.wtt_customerassetsreading...................................................... [SUCCESS 286 in 0.41s] 2023-06-02 09:40:20 normalization > Finished running 3 table models in 2.29s. 2023-06-02 09:40:20 normalization > Completed successfully 2023-06-02 09:40:20 normalization > Done. PASS=3 WARN=0 ERROR=0 SKIP=0 TOTAL=3 2023-06-02 09:40:21 INFO i.a.w.n.DefaultNormalizationRunner(close):194 - Terminating normalization process... 2023-06-02 09:40:21 INFO i.a.w.n.DefaultNormalizationRunner(close):207 - Normalization process successfully terminated. 2023-06-02 09:40:21 INFO i.a.w.g.DefaultNormalizationWorker(run):97 - Normalization executed in 20 seconds for job 12. 2023-06-02 09:40:21 INFO i.a.w.g.DefaultNormalizationWorker(run):109 - Normalization summary: io.airbyte.config.NormalizationSummary@192e0f72[startTime=1685698800821,endTime=1685698821265,failures=[],additionalProperties={}] 2023-06-02 09:40:21 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:21 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 09:40:21 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END DEFAULT NORMALIZATION ----- 2023-06-02 09:40:21 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:21 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-06-02 09:40:21 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/12/0/logs.log 2023-06-02 09:40:21 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 09:40:21 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 09:40:21 INFO i.a.w.g.DbtTransformationWorker(run):61 - Running dbt transformation. 2023-06-02 09:40:21 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:21 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START DBT TRANSFORMATION ----- 2023-06-02 09:40:21 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:21 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):129 - Running with normalization version: airbyte/normalization-mysql:0.3.0 2023-06-02 09:40:21 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/normalization-mysql:0.3.0 exists... 2023-06-02 09:40:21 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/normalization-mysql:0.3.0 was found locally. 2023-06-02 09:40:21 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = normalization-mysql-normalize-12-0-btrpx with resources io.airbyte.config.ResourceRequirements@1a06169[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 09:40:21 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/0/transform --log-driver none --name normalization-mysql-normalize-12-0-btrpx --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.44.3 airbyte/normalization-mysql:0.3.0 configure-dbt --integration-type mysql --config destination_config.json --git-repo https://github.com/ranjit-battewad/dbtdemo.git 2023-06-02 09:40:22 normalization > Running: git clone --depth 5 --single-branch $GIT_REPO git_repo 2023-06-02 09:40:23 normalization > Last 5 commits in git_repo: 2023-06-02 09:40:23 normalization > a939c94 Create a dbt project 2023-06-02 09:40:23 normalization > /data/12/0/transform 2023-06-02 09:40:23 normalization > Running: transform-config --config destination_config.json --integration-type mysql --out /data/12/0/transform 2023-06-02 09:40:23 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/12/0/transform') 2023-06-02 09:40:23 normalization > transform_mysql 2023-06-02 09:40:24 normalization > Cloning into 'git_repo'... 2023-06-02 09:40:24 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if fishtownanalytics/dbt:1.0.0 exists... 2023-06-02 09:40:24 INFO i.a.c.i.LineGobbler(voidCall):149 - fishtownanalytics/dbt:1.0.0 was found locally. 2023-06-02 09:40:24 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = dbt-custom-12-0-aytfz with resources io.airbyte.config.ResourceRequirements@1a06169[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 09:40:24 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/0/transform --log-driver none --name dbt-custom-12-0-aytfz --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.44.3 --entrypoint /bin/bash fishtownanalytics/dbt:1.0.0 entrypoint.sh run 2023-06-02 09:40:25 dbt > Running from /data/12/0/transform/git_repo 2023-06-02 09:40:25 dbt > detected no config file for ssh, assuming ssh is off. 2023-06-02 09:40:25 dbt > Running: dbt run --profiles-dir=/data/12/0/transform --project-dir=/data/12/0/transform/git_repo 2023-06-02 09:40:30 dbt > 09:40:30 Error importing adapter: No module named 'dbt.adapters.mysql' 2023-06-02 09:40:30 dbt > 09:40:30 Encountered an error while reading profiles: 2023-06-02 09:40:30 dbt > 09:40:30 ERROR: Runtime Error 2023-06-02 09:40:30 dbt > Credentials in profile "normalize", target "prod" invalid: Runtime Error 2023-06-02 09:40:30 dbt > Could not find adapter type mysql! 2023-06-02 09:40:30 dbt > 09:40:30 Defined profiles: 2023-06-02 09:40:30 dbt > 09:40:30 - normalize 2023-06-02 09:40:30 dbt > 09:40:30 2023-06-02 09:40:30 dbt > For more information on configuring profiles, please consult the dbt docs: 2023-06-02 09:40:30 dbt > 2023-06-02 09:40:30 dbt > https://docs.getdbt.com/docs/configure-your-profile 2023-06-02 09:40:30 dbt > 2023-06-02 09:40:30 dbt > 09:40:30 Encountered an error: 2023-06-02 09:40:30 dbt > Runtime Error 2023-06-02 09:40:30 dbt > Could not run dbt 2023-06-02 09:40:30 INFO i.a.w.n.DefaultNormalizationRunner(close):194 - Terminating normalization process... 2023-06-02 09:40:30 INFO i.a.w.n.DefaultNormalizationRunner(close):207 - Normalization process successfully terminated. 2023-06-02 09:40:30 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$5):198 - Completing future exceptionally... io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:75) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Caused by: io.airbyte.workers.exception.WorkerException: DBT Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:71) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] ... 3 more Suppressed: io.airbyte.workers.exception.WorkerException: Dbt transformation process wasn't successful at io.airbyte.workers.general.DbtTransformationRunner.close(DbtTransformationRunner.java:156) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:60) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] 2023-06-02 09:40:30 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 09:40:30 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-06-02 09:40:30 WARN i.t.i.a.ActivityTaskExecutors$BaseActivityTaskExecutor(execute):114 - Activity failure. ActivityId=f2de2ace-d487-3353-8c82-3760d99575ed, activityType=Run, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:305) ~[io.airbyte-airbyte-commons-temporal-0.44.3.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.run(DbtTransformationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?] at io.temporal.internal.activity.RootActivityInboundCallsInterceptor$POJOActivityInboundCallsInterceptor.executeActivity(RootActivityInboundCallsInterceptor.java:64) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.RootActivityInboundCallsInterceptor.execute(RootActivityInboundCallsInterceptor.java:43) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.ActivityTaskExecutors$BaseActivityTaskExecutor.execute(ActivityTaskExecutors.java:95) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.ActivityTaskHandlerImpl.handle(ActivityTaskHandlerImpl.java:92) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handleActivity(ActivityWorker.java:241) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:206) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:179) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.17.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:57) ~[temporal-serviceclient-1.17.0.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:461) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:52) ~[temporal-sdk-1.17.0.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:167) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.lambda$run$3(DbtTransformationActivityImpl.java:134) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:300) ~[io.airbyte-airbyte-commons-temporal-0.44.3.jar:?] ... 14 more Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.lambda$run$3(DbtTransformationActivityImpl.java:134) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:300) ~[io.airbyte-airbyte-commons-temporal-0.44.3.jar:?] ... 14 more Caused by: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:75) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: DBT Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:71) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] ... 1 more Suppressed: io.airbyte.workers.exception.WorkerException: Dbt transformation process wasn't successful at io.airbyte.workers.general.DbtTransformationRunner.close(DbtTransformationRunner.java:156) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:60) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] 2023-06-02 09:40:42 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to Get a connection by connection Id 2023-06-02 09:40:42 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get the most recent source actor catalog 2023-06-02 09:40:42 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to Get a connection by connection Id 2023-06-02 09:40:31 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/12/1/logs.log 2023-06-02 09:40:31 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 09:40:31 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 09:40:31 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:40:31 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:40:31 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:31 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:40:31 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:40:31 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 09:40:31 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 09:40:31 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK ----- 2023-06-02 09:40:31 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:31 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-postgres:2.0.26 exists... 2023-06-02 09:40:31 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-postgres:2.0.26 was found locally. 2023-06-02 09:40:31 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = source-postgres-check-12-1-odbpv with resources io.airbyte.config.ResourceRequirements@43d96782[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts io.airbyte.config.AllowedHosts@d13b7a0[hosts=[localhost, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}] 2023-06-02 09:40:31 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/1 --log-driver none --name source-postgres-check-12-1-odbpv --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:2.0.26 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=1 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=12 airbyte/source-postgres:2.0.26 check --config source_config.json 2023-06-02 09:40:31 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 09:40:36 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresSource(main):484 starting source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 09:40:36 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {check=null, config=source_config.json} 2023-06-02 09:40:36 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):108 Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 09:40:36 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):109 Command: CHECK 2023-06-02 09:40:36 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):110 Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2023-06-02 09:40:36 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword groups - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:40:36 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:40:36 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword group - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:40:36 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:40:36 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:40:37 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.s.SshTunnel(getInstance):204 Starting connection with method: NO_TUNNEL 2023-06-02 09:40:37 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 09:40:37 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresSource(toSslJdbcParamInternal):521 DISABLED toSslJdbcParam disable 2023-06-02 09:40:37 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource():80 HikariPool-1 - Starting... 2023-06-02 09:40:37 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource():82 HikariPool-1 - Start completed. 2023-06-02 09:40:37 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 09:40:37 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 09:40:37 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):134 Attempting to get metadata from the database to see if we can connect. 2023-06-02 09:40:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource(close):350 HikariPool-1 - Shutdown initiated... 2023-06-02 09:40:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource(close):352 HikariPool-1 - Shutdown completed. 2023-06-02 09:40:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):186 Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 09:40:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresSource(main):486 completed source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 09:40:38 INFO i.a.w.g.DefaultCheckConnectionWorker(run):115 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@44185f30[status=succeeded,message=,additionalProperties={}] 2023-06-02 09:40:38 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:38 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK ----- 2023-06-02 09:40:38 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 09:40:38 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:38 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/12/1/logs.log 2023-06-02 09:40:38 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 09:40:38 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 09:40:38 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:38 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK ----- 2023-06-02 09:40:38 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:40:38 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:40:38 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:40:38 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:40:38 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 09:40:38 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 09:40:38 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:38 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-mysql:0.1.20 exists... 2023-06-02 09:40:38 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-mysql:0.1.20 was found locally. 2023-06-02 09:40:38 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = destination-mysql-check-12-1-jjtvq with resources io.airbyte.config.ResourceRequirements@43d96782[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 09:40:38 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/1 --log-driver none --name destination-mysql-check-12-1-jjtvq --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-mysql:0.1.20 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=1 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=12 airbyte/destination-mysql:0.1.20 check --config source_config.json 2023-06-02 09:40:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 09:40:39 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Class path contains multiple SLF4J bindings. 2023-06-02 09:40:39 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 09:40:39 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 09:40:39 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 09:40:39 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2023-06-02 09:40:39 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2023-06-02 09:40:40 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:40:40 INFO i.a.i.d.m.MySQLDestination(main):136 - starting destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 09:40:40 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:40:40 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2023-06-02 09:40:40 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:40:40 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 09:40:40 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:40:40 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK 2023-06-02 09:40:40 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:40:40 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2023-06-02 09:40:40 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:40:40 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:40:40 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:40:40 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:40:40 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:40:40 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:40:40 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:40:40 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:40:41 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:40:41 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2023-06-02 09:40:41 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:40:41 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2023-06-02 09:40:41 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:40:41 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2023-06-02 09:40:42 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:40:42 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated... 2023-06-02 09:40:42 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:40:42 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed. 2023-06-02 09:40:42 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:40:42 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 09:40:42 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:40:42 INFO i.a.i.d.m.MySQLDestination(main):138 - completed destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 09:40:42 INFO i.a.w.g.DefaultCheckConnectionWorker(run):115 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@527b4680[status=succeeded,message=,additionalProperties={}] 2023-06-02 09:40:42 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 09:40:42 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:42 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK ----- 2023-06-02 09:40:42 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:42 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get state 2023-06-02 09:40:42 INFO i.a.w.h.NormalizationInDestinationHelper(shouldNormalizeInDestination):52 - Requires Normalization: true Normalization Supported: false, Feature Flag Enabled: false 2023-06-02 09:40:42 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to set attempt sync config 2023-06-02 09:40:42 INFO i.a.c.t.s.DefaultTaskQueueMapper(getTaskQueue):31 - Called DefaultTaskQueueMapper getTaskQueue for geography auto 2023-06-02 09:40:42 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/12/1/logs.log 2023-06-02 09:40:42 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 09:40:42 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 09:40:43 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get the source for heartbeat 2023-06-02 09:40:43 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get the source definition 2023-06-02 09:40:43 INFO i.a.w.g.ReplicationWorkerFactory(create):95 - Setting up source... 2023-06-02 09:40:43 INFO i.a.w.g.ReplicationWorkerFactory(create):99 - Setting up destination... 2023-06-02 09:40:43 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable METRIC_CLIENT: '' 2023-06-02 09:40:43 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2023-06-02 09:40:43 INFO i.a.w.g.ReplicationWorkerFactory(create):108 - Setting up replication worker... 2023-06-02 09:40:43 INFO i.a.w.g.DefaultReplicationWorker(run):162 - start sync worker. job id: 12 attempt id: 1 2023-06-02 09:40:43 INFO i.a.w.g.DefaultReplicationWorker(run):164 - Committing states from replication activity 2023-06-02 09:40:43 INFO i.a.w.g.DefaultReplicationWorker(run):167 - Committing stats from replication activity 2023-06-02 09:40:43 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:43 INFO i.a.w.g.DefaultReplicationWorker(run):183 - configured sync modes: {public.WTT_CustomerAssetsReading=full_refresh - overwrite, public.WTT_Customer=full_refresh - overwrite, public.WTT_Asset=full_refresh - overwrite} 2023-06-02 09:40:43 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START REPLICATION ----- 2023-06-02 09:40:43 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:43 INFO i.a.w.i.DefaultAirbyteDestination(start):92 - Running destination... 2023-06-02 09:40:43 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:40:43 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:40:43 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:40:43 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:40:43 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 09:40:43 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 09:40:43 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-mysql:0.1.20 exists... 2023-06-02 09:40:43 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-mysql:0.1.20 was found locally. 2023-06-02 09:40:43 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = destination-mysql-write-12-1-vsdkn with resources io.airbyte.config.ResourceRequirements@1c7e54a6[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 09:40:43 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/1 --log-driver none --name destination-mysql-write-12-1-vsdkn --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-mysql:0.1.20 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=1 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=12 airbyte/destination-mysql:0.1.20 write --config destination_config.json --catalog destination_catalog.json 2023-06-02 09:40:43 INFO i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):41 - Writing messages to protocol version 0.2.0 2023-06-02 09:40:43 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 09:40:43 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:40:43 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:40:43 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:40:43 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:40:43 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 09:40:43 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 09:40:43 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-postgres:2.0.26 exists... 2023-06-02 09:40:43 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-postgres:2.0.26 was found locally. 2023-06-02 09:40:43 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = source-postgres-read-12-1-fsxrw with resources io.airbyte.config.ResourceRequirements@5a6cad85[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts io.airbyte.config.AllowedHosts@c20d363[hosts=[localhost, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}] 2023-06-02 09:40:43 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/1 --log-driver none --name source-postgres-read-12-1-fsxrw --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:2.0.26 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=1 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=12 airbyte/source-postgres:2.0.26 read --config source_config.json --catalog source_catalog.json 2023-06-02 09:40:43 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 09:40:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromDstRunnable$4):311 - Destination output thread started. 2023-06-02 09:40:43 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):94 - Starting source heartbeat check. Will check every 1 minutes. 2023-06-02 09:40:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):377 - Replication thread started. 2023-06-02 09:40:43 destination > SLF4J: Class path contains multiple SLF4J bindings. 2023-06-02 09:40:43 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 09:40:43 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 09:40:43 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 09:40:43 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2023-06-02 09:40:44 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2023-06-02 09:40:45 destination > 2023-06-02 09:40:45 INFO i.a.i.d.m.MySQLDestination(main):136 - starting destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 09:40:45 source > INFO i.a.i.s.p.PostgresSource(main):484 starting source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 09:40:45 destination > 2023-06-02 09:40:45 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2023-06-02 09:40:45 destination > 2023-06-02 09:40:45 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 09:40:45 destination > 2023-06-02 09:40:45 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE 2023-06-02 09:40:46 destination > 2023-06-02 09:40:45 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2023-06-02 09:40:46 source > INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {read=null, catalog=source_catalog.json, config=source_config.json} 2023-06-02 09:40:46 source > INFO i.a.i.b.IntegrationRunner(runInternal):108 Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 09:40:46 source > INFO i.a.i.b.IntegrationRunner(runInternal):109 Command: READ 2023-06-02 09:40:46 source > INFO i.a.i.b.IntegrationRunner(runInternal):110 Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='null'} 2023-06-02 09:40:46 destination > 2023-06-02 09:40:46 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:40:46 destination > 2023-06-02 09:40:46 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:40:46 destination > 2023-06-02 09:40:46 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:40:46 destination > 2023-06-02 09:40:46 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:40:46 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword groups - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:40:46 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:40:46 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword group - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:40:46 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:40:46 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:40:47 destination > 2023-06-02 09:40:47 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2023-06-02 09:40:47 source > INFO i.a.i.b.s.SshTunnel(getInstance):204 Starting connection with method: NO_TUNNEL 2023-06-02 09:40:47 source > INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 09:40:47 source > INFO i.a.i.s.r.s.StateManagerFactory(createStateManager):55 Stream state manager selected to manage state object with type STREAM. 2023-06-02 09:40:47 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):181 No cursor field set in catalog but not present in state. Stream: public_WTT_CustomerAssetsReading, New Cursor Field: null. Resetting cursor value 2023-06-02 09:40:47 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):181 No cursor field set in catalog but not present in state. Stream: public_WTT_Asset, New Cursor Field: null. Resetting cursor value 2023-06-02 09:40:47 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):181 No cursor field set in catalog but not present in state. Stream: public_WTT_Customer, New Cursor Field: null. Resetting cursor value 2023-06-02 09:40:47 source > INFO i.a.i.s.p.PostgresSource(toSslJdbcParamInternal):521 DISABLED toSslJdbcParam disable 2023-06-02 09:40:47 destination > 2023-06-02 09:40:47 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2023-06-02 09:40:47 source > INFO c.z.h.HikariDataSource():80 HikariPool-1 - Starting... 2023-06-02 09:40:47 destination > 2023-06-02 09:40:47 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2023-06-02 09:40:47 destination > 2023-06-02 09:40:47 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=WTT_CustomerAssetsReading, namespace=null, outputSchemaName=airbytepoc, tmpTableName=_airbyte_tmp_ydu_wtt_customerassetsreading, outputTableName=_airbyte_raw_wtt_customerassetsreading, syncMode=overwrite} 2023-06-02 09:40:47 destination > 2023-06-02 09:40:47 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=WTT_Customer, namespace=null, outputSchemaName=airbytepoc, tmpTableName=_airbyte_tmp_fmk_wtt_customer, outputTableName=_airbyte_raw_wtt_customer, syncMode=overwrite} 2023-06-02 09:40:47 destination > 2023-06-02 09:40:47 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=WTT_Asset, namespace=null, outputSchemaName=airbytepoc, tmpTableName=_airbyte_tmp_oen_wtt_asset, outputTableName=_airbyte_raw_wtt_asset, syncMode=overwrite} 2023-06-02 09:40:47 source > INFO c.z.h.HikariDataSource():82 HikariPool-1 - Start completed. 2023-06-02 09:40:47 destination > 2023-06-02 09:40:47 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2023-06-02 09:40:47 destination > 2023-06-02 09:40:47 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):123 - Preparing tmp tables in destination started for 3 streams 2023-06-02 09:40:47 destination > 2023-06-02 09:40:47 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream WTT_CustomerAssetsReading. schema: airbytepoc, tmp table name: _airbyte_tmp_ydu_wtt_customerassetsreading 2023-06-02 09:40:48 source > INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 09:40:48 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):440 Data source product recognized as PostgreSQL:15.3 (Debian 15.3-1.pgdg110+1) 2023-06-02 09:40:48 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):452 Discovering indexes for schema "public", table "WTT_CustomerAssetsReading" 2023-06-02 09:40:48 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_CustomerAssetsReading_pkey, Column: id, Unique: true 2023-06-02 09:40:48 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):452 Discovering indexes for schema "public", table "WTT_Customer" 2023-06-02 09:40:48 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Customer_pkey, Column: id, Unique: true 2023-06-02 09:40:48 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__customer_asset_id, Column: assetId, Unique: false 2023-06-02 09:40:48 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__customer_created_by_id, Column: createdById, Unique: false 2023-06-02 09:40:48 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__customer_updated_by_id, Column: updatedById, Unique: false 2023-06-02 09:40:48 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):452 Discovering indexes for schema "public", table "WTT_Asset" 2023-06-02 09:40:48 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Asset_Code_uk, Column: Code, Unique: true 2023-06-02 09:40:48 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Asset_Name_uk, Column: Name, Unique: true 2023-06-02 09:40:48 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Asset_pkey, Column: id, Unique: true 2023-06-02 09:40:48 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__asset_created_by_id, Column: createdById, Unique: false 2023-06-02 09:40:48 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__asset_updated_by_id, Column: updatedById, Unique: false 2023-06-02 09:40:48 source > INFO i.a.i.s.p.PostgresQueryUtils(logXminStatus):76 Xmin Status : {Number of wraparounds: 0, Xmin Transaction Value: 1142, Xmin Raw Value: 1142 2023-06-02 09:40:48 source > INFO i.a.i.s.j.AbstractJdbcSource(discoverInternal):162 Internal schemas to exclude: [catalog_history, information_schema, pg_catalog, pg_internal] 2023-06-02 09:40:48 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 09:40:48 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(accept):40 Set new fetch size: 1323960 rows 2023-06-02 09:40:48 source > INFO i.a.d.j.s.TwoStageSizeEstimator(getTargetBufferByteSize):71 Max memory limit: 6174015488, JDBC buffer size: 3704409293 2023-06-02 09:40:48 source > INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 09:40:48 source > INFO i.a.i.s.p.PostgresSource(estimateFullRefreshSyncSize):575 Estimate for table: "public"."WTT_CustomerAssetsReading" : {sync_row_count: 286, sync_bytes: 24576, total_table_row_count: 286, total_table_bytes: 24576} 2023-06-02 09:40:48 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableFullRefresh):111 Queueing query for table: WTT_CustomerAssetsReading 2023-06-02 09:40:48 source > INFO i.a.i.s.p.PostgresSource(estimateFullRefreshSyncSize):575 Estimate for table: "public"."WTT_Customer" : {sync_row_count: 7, sync_bytes: 8192, total_table_row_count: 7, total_table_bytes: 8192} 2023-06-02 09:40:48 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableFullRefresh):111 Queueing query for table: WTT_Customer 2023-06-02 09:40:48 source > INFO i.a.i.s.p.PostgresSource(estimateFullRefreshSyncSize):575 Estimate for table: "public"."WTT_Asset" : {sync_row_count: 2, sync_bytes: 8192, total_table_row_count: 2, total_table_bytes: 8192} 2023-06-02 09:40:48 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableFullRefresh):111 Queueing query for table: WTT_Asset 2023-06-02 09:40:48 source > INFO i.a.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):67 Queueing query: SELECT "sort","id","ReadingDateTime","AssetId","Value" FROM "public"."WTT_CustomerAssetsReading" 2023-06-02 09:40:48 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 09:40:48 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(accept):40 Set new fetch size: 929589 rows 2023-06-02 09:40:48 source > INFO i.a.d.j.s.TwoStageSizeEstimator(getTargetBufferByteSize):71 Max memory limit: 6174015488, JDBC buffer size: 3704409293 2023-06-02 09:40:48 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(accept):40 Set new fetch size: 12862532 rows 2023-06-02 09:40:49 destination > 2023-06-02 09:40:49 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream WTT_Customer. schema: airbytepoc, tmp table name: _airbyte_tmp_fmk_wtt_customer 2023-06-02 09:40:49 source > INFO i.a.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):67 Queueing query: SELECT "createdAt","updatedAt","sort","createdById","updatedById","id","name","Description","IsActive","assetId" FROM "public"."WTT_Customer" 2023-06-02 09:40:49 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 09:40:49 destination > 2023-06-02 09:40:49 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream WTT_Asset. schema: airbytepoc, tmp table name: _airbyte_tmp_oen_wtt_asset 2023-06-02 09:40:49 source > INFO i.a.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):67 Queueing query: SELECT "createdAt","updatedAt","sort","createdById","updatedById","id","Name","Code" FROM "public"."WTT_Asset" 2023-06-02 09:40:49 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 09:40:49 source > INFO i.a.i.s.r.AbstractDbSource(lambda$read$1):172 Closing database connection pool. 2023-06-02 09:40:49 source > INFO c.z.h.HikariDataSource(close):350 HikariPool-1 - Shutdown initiated... 2023-06-02 09:40:49 source > INFO c.z.h.HikariDataSource(close):352 HikariPool-1 - Shutdown completed. 2023-06-02 09:40:49 source > INFO i.a.i.s.r.AbstractDbSource(lambda$read$1):174 Closed database connection pool. 2023-06-02 09:40:49 source > INFO i.a.i.b.IntegrationRunner(runInternal):186 Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 09:40:49 source > INFO i.a.i.s.p.PostgresSource(main):486 completed source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 09:40:49 destination > 2023-06-02 09:40:49 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):133 - Preparing tables in destination completed. 2023-06-02 09:40:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):439 - Source has no more messages, closing connection. 2023-06-02 09:40:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):448 - Total records read: 298 (28 KB) 2023-06-02 09:40:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):464 - Schema validation was performed to a max of 10 records with errors per stream. 2023-06-02 09:40:49 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):466 - Schema validation errors found for stream public_WTT_CustomerAssetsReading. Error messages: [$.sort: null found, number expected] 2023-06-02 09:40:49 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):466 - Schema validation errors found for stream public_WTT_Customer. Error messages: [$.assetId: null found, number expected] 2023-06-02 09:40:49 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):111 - thread status... heartbeat thread: false , replication thread: true 2023-06-02 09:40:49 INFO i.a.w.g.DefaultReplicationWorker(replicate):267 - Waiting for source and destination threads to complete. 2023-06-02 09:40:49 INFO i.a.w.g.DefaultReplicationWorker(replicate):272 - One of source or destination thread complete. Waiting on the other. 2023-06-02 09:40:49 destination > 2023-06-02 09:40:49 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2023-06-02 09:40:49 destination > 2023-06-02 09:40:49 INFO i.a.i.d.b.BufferedStreamConsumer(close):171 - executing on success close procedure. 2023-06-02 09:40:49 destination > 2023-06-02 09:40:49 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing WTT_CustomerAssetsReading: 286 records (113 KB) 2023-06-02 09:40:49 destination > 2023-06-02 09:40:49 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing WTT_Customer: 7 records (113 KB) 2023-06-02 09:40:49 destination > 2023-06-02 09:40:49 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing WTT_Asset: 2 records (113 KB) 2023-06-02 09:40:49 destination > 2023-06-02 09:40:49 INFO i.a.i.d.j.SqlOperations(onDestinationCloseOperations):138 - No onDestinationCloseOperations required for this destination. 2023-06-02 09:40:49 destination > 2023-06-02 09:40:49 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):163 - Finalizing tables in destination started for 3 streams 2023-06-02 09:40:49 destination > 2023-06-02 09:40:49 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream WTT_CustomerAssetsReading. schema airbytepoc, tmp table _airbyte_tmp_ydu_wtt_customerassetsreading, final table _airbyte_raw_wtt_customerassetsreading 2023-06-02 09:40:49 destination > 2023-06-02 09:40:49 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream WTT_Customer. schema airbytepoc, tmp table _airbyte_tmp_fmk_wtt_customer, final table _airbyte_raw_wtt_customer 2023-06-02 09:40:49 destination > 2023-06-02 09:40:49 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream WTT_Asset. schema airbytepoc, tmp table _airbyte_tmp_oen_wtt_asset, final table _airbyte_raw_wtt_asset 2023-06-02 09:40:49 destination > 2023-06-02 09:40:49 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - Executing finalization of tables. 2023-06-02 09:40:50 destination > 2023-06-02 09:40:50 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):183 - Finalizing tables in destination completed. 2023-06-02 09:40:50 destination > 2023-06-02 09:40:50 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):186 - Cleaning tmp tables in destination started for 3 streams 2023-06-02 09:40:50 destination > 2023-06-02 09:40:50 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream WTT_CustomerAssetsReading. schema airbytepoc, tmp table name: _airbyte_tmp_ydu_wtt_customerassetsreading 2023-06-02 09:40:50 destination > 2023-06-02 09:40:50 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream WTT_Customer. schema airbytepoc, tmp table name: _airbyte_tmp_fmk_wtt_customer 2023-06-02 09:40:50 destination > 2023-06-02 09:40:50 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream WTT_Asset. schema airbytepoc, tmp table name: _airbyte_tmp_oen_wtt_asset 2023-06-02 09:40:50 destination > 2023-06-02 09:40:50 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):195 - Cleaning tmp tables in destination completed. 2023-06-02 09:40:50 destination > 2023-06-02 09:40:50 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 09:40:50 destination > 2023-06-02 09:40:50 INFO i.a.i.d.m.MySQLDestination(main):138 - completed destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 09:40:50 INFO i.a.w.g.DefaultReplicationWorker(replicate):274 - Source and destination threads complete. 2023-06-02 09:40:50 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):569 - sync summary: { "status" : "completed", "recordsSynced" : 295, "bytesSynced" : 29038, "startTime" : 1685698843038, "endTime" : 1685698850351, "totalStats" : { "bytesCommitted" : 29038, "bytesEmitted" : 29038, "destinationStateMessagesEmitted" : 0, "destinationWriteEndTime" : 1685698850350, "destinationWriteStartTime" : 1685698843147, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0, "recordsEmitted" : 295, "recordsCommitted" : 295, "replicationEndTime" : 1685698850351, "replicationStartTime" : 1685698843038, "sourceReadEndTime" : 1685698849285, "sourceReadStartTime" : 1685698843085, "sourceStateMessagesEmitted" : 0 }, "streamStats" : [ { "streamName" : "WTT_CustomerAssetsReading", "stats" : { "bytesCommitted" : 27240, "bytesEmitted" : 27240, "recordsEmitted" : 286, "recordsCommitted" : 286 } }, { "streamName" : "WTT_Customer", "stats" : { "bytesCommitted" : 1436, "bytesEmitted" : 1436, "recordsEmitted" : 7, "recordsCommitted" : 7 } }, { "streamName" : "WTT_Asset", "stats" : { "bytesCommitted" : 362, "bytesEmitted" : 362, "recordsEmitted" : 2, "recordsCommitted" : 2 } }, { "streamName" : "WTT_CustomerAssetsReading", "streamNamespace" : "public", "stats" : { "bytesCommitted" : 0, "bytesEmitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0 } }, { "streamName" : "WTT_Asset", "streamNamespace" : "public", "stats" : { "bytesCommitted" : 0, "bytesEmitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0 } }, { "streamName" : "WTT_Customer", "streamNamespace" : "public", "stats" : { "bytesCommitted" : 0, "bytesEmitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0 } } ] } 2023-06-02 09:40:50 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):570 - failures: [ ] 2023-06-02 09:40:50 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 09:40:50 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:50 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END REPLICATION ----- 2023-06-02 09:40:50 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:50 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):157 - sync summary: io.airbyte.config.StandardSyncOutput@47a2a807[standardSyncSummary=io.airbyte.config.StandardSyncSummary@64be4422[status=completed,recordsSynced=295,bytesSynced=29038,startTime=1685698843038,endTime=1685698850351,totalStats=io.airbyte.config.SyncStats@77562eaf[bytesCommitted=29038,bytesEmitted=29038,destinationStateMessagesEmitted=0,destinationWriteEndTime=1685698850350,destinationWriteStartTime=1685698843147,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,recordsEmitted=295,recordsCommitted=295,replicationEndTime=1685698850351,replicationStartTime=1685698843038,sourceReadEndTime=1685698849285,sourceReadStartTime=1685698843085,sourceStateMessagesEmitted=0,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@6313d988[streamName=WTT_CustomerAssetsReading,streamNamespace=,stats=io.airbyte.config.SyncStats@31a3b77d[bytesCommitted=27240,bytesEmitted=27240,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=286,recordsCommitted=286,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@272a6a3f[streamName=WTT_Customer,streamNamespace=,stats=io.airbyte.config.SyncStats@614f0b23[bytesCommitted=1436,bytesEmitted=1436,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=7,recordsCommitted=7,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@1ced511b[streamName=WTT_Asset,streamNamespace=,stats=io.airbyte.config.SyncStats@305905a4[bytesCommitted=362,bytesEmitted=362,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=2,recordsCommitted=2,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@44d6ea02[streamName=WTT_CustomerAssetsReading,streamNamespace=public,stats=io.airbyte.config.SyncStats@5d59f7a8[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=0,recordsCommitted=0,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@2bca1091[streamName=WTT_Asset,streamNamespace=public,stats=io.airbyte.config.SyncStats@53465469[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=0,recordsCommitted=0,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@20b322f9[streamName=WTT_Customer,streamNamespace=public,stats=io.airbyte.config.SyncStats@32c575f0[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=0,recordsCommitted=0,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}]],additionalProperties={}],normalizationSummary=,webhookOperationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@4970b5a1[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@28f445fa[stream=io.airbyte.protocol.models.AirbyteStream@11e90ef7[name=WTT_CustomerAssetsReading,jsonSchema={"type":"object","properties":{"Value":{"airbyte_type":"integer","type":"number"},"id":{"airbyte_type":"integer","type":"number"},"sort":{"airbyte_type":"integer","type":"number"},"ReadingDateTime":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"AssetId":{"airbyte_type":"integer","type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@81a83cf[stream=io.airbyte.protocol.models.AirbyteStream@440be2d0[name=WTT_Customer,jsonSchema={"type":"object","properties":{"createdAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"Description":{"type":"string"},"assetId":{"airbyte_type":"integer","type":"number"},"IsActive":{"type":"boolean"},"name":{"type":"string"},"id":{"airbyte_type":"integer","type":"number"},"sort":{"airbyte_type":"integer","type":"number"},"updatedById":{"airbyte_type":"integer","type":"number"},"createdById":{"airbyte_type":"integer","type":"number"},"updatedAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@4e5ab43e[stream=io.airbyte.protocol.models.AirbyteStream@171d95b4[name=WTT_Asset,jsonSchema={"type":"object","properties":{"createdAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"id":{"airbyte_type":"integer","type":"number"},"sort":{"airbyte_type":"integer","type":"number"},"updatedById":{"airbyte_type":"integer","type":"number"},"Code":{"type":"string"},"createdById":{"airbyte_type":"integer","type":"number"},"Name":{"type":"string"},"updatedAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[],commitStateAsap=true,additionalProperties={}] 2023-06-02 09:40:50 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):162 - Sync summary length: 8382 2023-06-02 09:40:50 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-06-02 09:40:50 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):134 - Using protocol v1 2023-06-02 09:40:50 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):145 - Using normalization: airbyte/normalization-mysql:0.3.0 2023-06-02 09:40:50 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/12/1/logs.log 2023-06-02 09:40:50 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 09:40:50 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 09:40:50 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:50 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):129 - Running with normalization version: airbyte/normalization-mysql:0.3.0 2023-06-02 09:40:50 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START DEFAULT NORMALIZATION ----- 2023-06-02 09:40:50 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:40:50 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/normalization-mysql:0.3.0 exists... 2023-06-02 09:40:50 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/normalization-mysql:0.3.0 was found locally. 2023-06-02 09:40:50 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = normalization-mysql-normalize-12-1-hbxqp with resources io.airbyte.config.ResourceRequirements@481c68b8[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 09:40:50 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/1/normalize --log-driver none --name normalization-mysql-normalize-12-1-hbxqp --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.44.3 airbyte/normalization-mysql:0.3.0 run --integration-type mysql --config destination_config.json --catalog destination_catalog.json 2023-06-02 09:40:51 normalization > Running: transform-config --config destination_config.json --integration-type mysql --out /data/12/1/normalize 2023-06-02 09:40:52 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/12/1/normalize') 2023-06-02 09:40:52 normalization > transform_mysql 2023-06-02 09:40:52 normalization > Running: transform-catalog --integration-type mysql --profile-config-dir /data/12/1/normalize --catalog destination_catalog.json --out /data/12/1/normalize/models/generated/ --json-column _airbyte_data 2023-06-02 09:40:53 normalization > Processing destination_catalog.json... 2023-06-02 09:40:53 normalization > Generating airbyte_ctes/airbytepoc/wtt_customerassetsreading_ab1.sql from WTT_CustomerAssetsReading 2023-06-02 09:40:53 normalization > Generating airbyte_ctes/airbytepoc/wtt_customerassetsreading_ab2.sql from WTT_CustomerAssetsReading 2023-06-02 09:40:53 normalization > Generating airbyte_ctes/airbytepoc/wtt_customerassetsreading_ab3.sql from WTT_CustomerAssetsReading 2023-06-02 09:40:53 normalization > Adding drop table hook for wtt_customerassetsreading_scd to wtt_customerassetsreading 2023-06-02 09:40:53 normalization > Generating airbyte_tables/airbytepoc/wtt_customerassetsreading.sql from WTT_CustomerAssetsReading 2023-06-02 09:40:53 normalization > Generating airbyte_ctes/airbytepoc/wtt_customer_ab1.sql from WTT_Customer 2023-06-02 09:40:53 normalization > Generating airbyte_ctes/airbytepoc/wtt_customer_ab2.sql from WTT_Customer 2023-06-02 09:40:53 normalization > Generating airbyte_ctes/airbytepoc/wtt_customer_ab3.sql from WTT_Customer 2023-06-02 09:40:53 normalization > Adding drop table hook for wtt_customer_scd to wtt_customer 2023-06-02 09:40:53 normalization > Generating airbyte_tables/airbytepoc/wtt_customer.sql from WTT_Customer 2023-06-02 09:40:53 normalization > Generating airbyte_ctes/airbytepoc/wtt_asset_ab1.sql from WTT_Asset 2023-06-02 09:40:53 normalization > Generating airbyte_ctes/airbytepoc/wtt_asset_ab2.sql from WTT_Asset 2023-06-02 09:40:53 normalization > Generating airbyte_ctes/airbytepoc/wtt_asset_ab3.sql from WTT_Asset 2023-06-02 09:40:53 normalization > Adding drop table hook for wtt_asset_scd to wtt_asset 2023-06-02 09:40:53 normalization > Generating airbyte_tables/airbytepoc/wtt_asset.sql from WTT_Asset 2023-06-02 09:40:53 normalization > detected no config file for ssh, assuming ssh is off. 2023-06-02 09:40:56 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2023-06-02 09:40:56 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2023-06-02 09:40:56 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-06-02 09:40:56 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2023-06-02 09:40:56 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-06-02 09:41:00 normalization > Running with dbt=1.0.0 2023-06-02 09:41:00 normalization > Partial parse save file not found. Starting full parse. 2023-06-02 09:41:02 normalization > [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. There are 2 unused configuration paths: - models.airbyte_utils.generated.airbyte_incremental - models.airbyte_utils.generated.airbyte_views 2023-06-02 09:41:02 normalization > Found 12 models, 0 tests, 0 snapshots, 0 analyses, 591 macros, 0 operations, 0 seed files, 3 sources, 0 exposures, 0 metrics 2023-06-02 09:41:02 normalization > Concurrency: 1 threads (target='prod') 2023-06-02 09:41:02 normalization > 1 of 3 START table model airbytepoc.wtt_asset........................................................................... [RUN] 2023-06-02 09:41:03 normalization > 1 of 3 OK created table model airbytepoc.wtt_asset...................................................................... [SUCCESS 2 in 0.23s] 2023-06-02 09:41:03 normalization > 2 of 3 START table model airbytepoc.wtt_customer........................................................................ [RUN] 2023-06-02 09:41:03 normalization > 2 of 3 OK created table model airbytepoc.wtt_customer................................................................... [SUCCESS 7 in 0.18s] 2023-06-02 09:41:03 normalization > 3 of 3 START table model airbytepoc.wtt_customerassetsreading........................................................... [RUN] 2023-06-02 09:41:03 normalization > 3 of 3 OK created table model airbytepoc.wtt_customerassetsreading...................................................... [SUCCESS 286 in 0.26s] 2023-06-02 09:41:03 normalization > Finished running 3 table models in 1.06s. 2023-06-02 09:41:03 normalization > Completed successfully 2023-06-02 09:41:03 normalization > Done. PASS=3 WARN=0 ERROR=0 SKIP=0 TOTAL=3 2023-06-02 09:41:03 INFO i.a.w.n.DefaultNormalizationRunner(close):194 - Terminating normalization process... 2023-06-02 09:41:03 INFO i.a.w.n.DefaultNormalizationRunner(close):207 - Normalization process successfully terminated. 2023-06-02 09:41:03 INFO i.a.w.g.DefaultNormalizationWorker(run):97 - Normalization executed in 13 seconds for job 12. 2023-06-02 09:41:03 INFO i.a.w.g.DefaultNormalizationWorker(run):109 - Normalization summary: io.airbyte.config.NormalizationSummary@390f442d[startTime=1685698850654,endTime=1685698863936,failures=[],additionalProperties={}] 2023-06-02 09:41:03 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 09:41:03 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-06-02 09:41:03 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:03 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END DEFAULT NORMALIZATION ----- 2023-06-02 09:41:03 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:04 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/12/1/logs.log 2023-06-02 09:41:04 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 09:41:04 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 09:41:04 INFO i.a.w.g.DbtTransformationWorker(run):61 - Running dbt transformation. 2023-06-02 09:41:04 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):129 - Running with normalization version: airbyte/normalization-mysql:0.3.0 2023-06-02 09:41:04 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:04 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START DBT TRANSFORMATION ----- 2023-06-02 09:41:04 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:04 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/normalization-mysql:0.3.0 exists... 2023-06-02 09:41:04 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/normalization-mysql:0.3.0 was found locally. 2023-06-02 09:41:04 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = normalization-mysql-normalize-12-1-peiyr with resources io.airbyte.config.ResourceRequirements@50ee8643[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 09:41:04 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/1/transform --log-driver none --name normalization-mysql-normalize-12-1-peiyr --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.44.3 airbyte/normalization-mysql:0.3.0 configure-dbt --integration-type mysql --config destination_config.json --git-repo https://github.com/ranjit-battewad/dbtdemo.git 2023-06-02 09:41:04 normalization > Running: git clone --depth 5 --single-branch $GIT_REPO git_repo 2023-06-02 09:41:05 normalization > Last 5 commits in git_repo: 2023-06-02 09:41:05 normalization > a939c94 Create a dbt project 2023-06-02 09:41:05 normalization > /data/12/1/transform 2023-06-02 09:41:05 normalization > Running: transform-config --config destination_config.json --integration-type mysql --out /data/12/1/transform 2023-06-02 09:41:06 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/12/1/transform') 2023-06-02 09:41:06 normalization > transform_mysql 2023-06-02 09:41:07 normalization > Cloning into 'git_repo'... 2023-06-02 09:41:07 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if fishtownanalytics/dbt:1.0.0 exists... 2023-06-02 09:41:07 INFO i.a.c.i.LineGobbler(voidCall):149 - fishtownanalytics/dbt:1.0.0 was found locally. 2023-06-02 09:41:07 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = dbt-custom-12-1-cluog with resources io.airbyte.config.ResourceRequirements@50ee8643[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 09:41:07 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/1/transform --log-driver none --name dbt-custom-12-1-cluog --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.44.3 --entrypoint /bin/bash fishtownanalytics/dbt:1.0.0 entrypoint.sh run 2023-06-02 09:41:07 dbt > Running from /data/12/1/transform/git_repo 2023-06-02 09:41:07 dbt > detected no config file for ssh, assuming ssh is off. 2023-06-02 09:41:07 dbt > Running: dbt run --profiles-dir=/data/12/1/transform --project-dir=/data/12/1/transform/git_repo 2023-06-02 09:41:12 dbt > 09:41:12 Error importing adapter: No module named 'dbt.adapters.mysql' 2023-06-02 09:41:12 dbt > 09:41:12 Encountered an error while reading profiles: 2023-06-02 09:41:12 dbt > 09:41:12 ERROR: Runtime Error 2023-06-02 09:41:12 dbt > Credentials in profile "normalize", target "prod" invalid: Runtime Error 2023-06-02 09:41:12 dbt > Could not find adapter type mysql! 2023-06-02 09:41:12 dbt > 09:41:12 Defined profiles: 2023-06-02 09:41:12 dbt > 09:41:12 - normalize 2023-06-02 09:41:12 dbt > 09:41:12 2023-06-02 09:41:12 dbt > For more information on configuring profiles, please consult the dbt docs: 2023-06-02 09:41:12 dbt > 2023-06-02 09:41:12 dbt > https://docs.getdbt.com/docs/configure-your-profile 2023-06-02 09:41:12 dbt > 2023-06-02 09:41:12 dbt > 09:41:12 Encountered an error: 2023-06-02 09:41:12 dbt > Runtime Error 2023-06-02 09:41:12 dbt > Could not run dbt 2023-06-02 09:41:12 INFO i.a.w.n.DefaultNormalizationRunner(close):194 - Terminating normalization process... 2023-06-02 09:41:12 INFO i.a.w.n.DefaultNormalizationRunner(close):207 - Normalization process successfully terminated. 2023-06-02 09:41:12 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$5):198 - Completing future exceptionally... io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:75) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Caused by: io.airbyte.workers.exception.WorkerException: DBT Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:71) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] ... 3 more Suppressed: io.airbyte.workers.exception.WorkerException: Dbt transformation process wasn't successful at io.airbyte.workers.general.DbtTransformationRunner.close(DbtTransformationRunner.java:156) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:60) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] 2023-06-02 09:41:12 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 09:41:12 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-06-02 09:41:12 WARN i.t.i.a.ActivityTaskExecutors$BaseActivityTaskExecutor(execute):114 - Activity failure. ActivityId=eb7dcec0-9eb8-30e7-b237-d31c70e1cf5b, activityType=Run, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:305) ~[io.airbyte-airbyte-commons-temporal-0.44.3.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.run(DbtTransformationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?] at io.temporal.internal.activity.RootActivityInboundCallsInterceptor$POJOActivityInboundCallsInterceptor.executeActivity(RootActivityInboundCallsInterceptor.java:64) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.RootActivityInboundCallsInterceptor.execute(RootActivityInboundCallsInterceptor.java:43) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.ActivityTaskExecutors$BaseActivityTaskExecutor.execute(ActivityTaskExecutors.java:95) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.ActivityTaskHandlerImpl.handle(ActivityTaskHandlerImpl.java:92) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handleActivity(ActivityWorker.java:241) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:206) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:179) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.17.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:57) ~[temporal-serviceclient-1.17.0.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:461) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:52) ~[temporal-sdk-1.17.0.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:167) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.lambda$run$3(DbtTransformationActivityImpl.java:134) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:300) ~[io.airbyte-airbyte-commons-temporal-0.44.3.jar:?] ... 14 more Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.lambda$run$3(DbtTransformationActivityImpl.java:134) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:300) ~[io.airbyte-airbyte-commons-temporal-0.44.3.jar:?] ... 14 more Caused by: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:75) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: DBT Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:71) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] ... 1 more Suppressed: io.airbyte.workers.exception.WorkerException: Dbt transformation process wasn't successful at io.airbyte.workers.general.DbtTransformationRunner.close(DbtTransformationRunner.java:156) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:60) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] 2023-06-02 09:41:22 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to Get a connection by connection Id 2023-06-02 09:41:22 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get the most recent source actor catalog 2023-06-02 09:41:22 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to Get a connection by connection Id 2023-06-02 09:41:13 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/12/2/logs.log 2023-06-02 09:41:13 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 09:41:13 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 09:41:13 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:41:13 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:13 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:41:13 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:41:13 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK ----- 2023-06-02 09:41:13 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:41:13 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:13 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 09:41:13 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 09:41:13 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-postgres:2.0.26 exists... 2023-06-02 09:41:13 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-postgres:2.0.26 was found locally. 2023-06-02 09:41:13 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = source-postgres-check-12-2-bplsw with resources io.airbyte.config.ResourceRequirements@43d96782[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts io.airbyte.config.AllowedHosts@49504dd8[hosts=[localhost, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}] 2023-06-02 09:41:13 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/2 --log-driver none --name source-postgres-check-12-2-bplsw --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:2.0.26 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=2 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=12 airbyte/source-postgres:2.0.26 check --config source_config.json 2023-06-02 09:41:13 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 09:41:15 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresSource(main):484 starting source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 09:41:15 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {check=null, config=source_config.json} 2023-06-02 09:41:15 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):108 Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 09:41:15 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):109 Command: CHECK 2023-06-02 09:41:15 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):110 Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2023-06-02 09:41:16 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword groups - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:41:16 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:41:16 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword group - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:41:16 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:41:16 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:41:16 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.s.SshTunnel(getInstance):204 Starting connection with method: NO_TUNNEL 2023-06-02 09:41:16 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 09:41:16 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresSource(toSslJdbcParamInternal):521 DISABLED toSslJdbcParam disable 2023-06-02 09:41:16 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource():80 HikariPool-1 - Starting... 2023-06-02 09:41:16 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource():82 HikariPool-1 - Start completed. 2023-06-02 09:41:17 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 09:41:17 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 09:41:17 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):134 Attempting to get metadata from the database to see if we can connect. 2023-06-02 09:41:17 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource(close):350 HikariPool-1 - Shutdown initiated... 2023-06-02 09:41:17 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource(close):352 HikariPool-1 - Shutdown completed. 2023-06-02 09:41:17 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):186 Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 09:41:17 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresSource(main):486 completed source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 09:41:17 INFO i.a.w.g.DefaultCheckConnectionWorker(run):115 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@53290144[status=succeeded,message=,additionalProperties={}] 2023-06-02 09:41:17 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 09:41:17 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:17 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK ----- 2023-06-02 09:41:17 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:17 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/12/2/logs.log 2023-06-02 09:41:17 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 09:41:17 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 09:41:17 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:41:17 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:41:17 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:41:17 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:41:17 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 09:41:17 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 09:41:17 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:17 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK ----- 2023-06-02 09:41:17 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:17 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-mysql:0.1.20 exists... 2023-06-02 09:41:17 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-mysql:0.1.20 was found locally. 2023-06-02 09:41:17 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = destination-mysql-check-12-2-prelc with resources io.airbyte.config.ResourceRequirements@43d96782[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 09:41:17 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/2 --log-driver none --name destination-mysql-check-12-2-prelc --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-mysql:0.1.20 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=2 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=12 airbyte/destination-mysql:0.1.20 check --config source_config.json 2023-06-02 09:41:17 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 09:41:18 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Class path contains multiple SLF4J bindings. 2023-06-02 09:41:18 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 09:41:18 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 09:41:18 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 09:41:18 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2023-06-02 09:41:18 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2023-06-02 09:41:19 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:41:19 INFO i.a.i.d.m.MySQLDestination(main):136 - starting destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 09:41:19 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:41:19 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2023-06-02 09:41:19 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:41:19 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 09:41:19 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:41:19 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK 2023-06-02 09:41:19 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:41:19 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2023-06-02 09:41:19 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:41:19 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:41:19 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:41:19 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:41:19 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:41:19 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:41:19 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:41:19 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:41:20 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:41:20 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2023-06-02 09:41:20 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:41:20 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2023-06-02 09:41:20 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:41:20 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2023-06-02 09:41:21 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:41:21 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated... 2023-06-02 09:41:21 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:41:21 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed. 2023-06-02 09:41:21 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:41:21 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 09:41:21 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 09:41:21 INFO i.a.i.d.m.MySQLDestination(main):138 - completed destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 09:41:21 INFO i.a.w.g.DefaultCheckConnectionWorker(run):115 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@2935e85e[status=succeeded,message=,additionalProperties={}] 2023-06-02 09:41:21 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:21 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK ----- 2023-06-02 09:41:21 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:21 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 09:41:22 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get state 2023-06-02 09:41:22 INFO i.a.w.h.NormalizationInDestinationHelper(shouldNormalizeInDestination):52 - Requires Normalization: true Normalization Supported: false, Feature Flag Enabled: false 2023-06-02 09:41:22 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to set attempt sync config 2023-06-02 09:41:22 INFO i.a.c.t.s.DefaultTaskQueueMapper(getTaskQueue):31 - Called DefaultTaskQueueMapper getTaskQueue for geography auto 2023-06-02 09:41:22 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/12/2/logs.log 2023-06-02 09:41:22 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 09:41:22 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 09:41:22 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get the source for heartbeat 2023-06-02 09:41:22 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get the source definition 2023-06-02 09:41:22 INFO i.a.w.g.ReplicationWorkerFactory(create):95 - Setting up source... 2023-06-02 09:41:22 INFO i.a.w.g.ReplicationWorkerFactory(create):99 - Setting up destination... 2023-06-02 09:41:22 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable METRIC_CLIENT: '' 2023-06-02 09:41:22 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2023-06-02 09:41:22 INFO i.a.w.g.ReplicationWorkerFactory(create):108 - Setting up replication worker... 2023-06-02 09:41:22 INFO i.a.w.g.DefaultReplicationWorker(run):162 - start sync worker. job id: 12 attempt id: 2 2023-06-02 09:41:22 INFO i.a.w.g.DefaultReplicationWorker(run):164 - Committing states from replication activity 2023-06-02 09:41:22 INFO i.a.w.g.DefaultReplicationWorker(run):167 - Committing stats from replication activity 2023-06-02 09:41:22 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:22 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START REPLICATION ----- 2023-06-02 09:41:22 INFO i.a.w.g.DefaultReplicationWorker(run):183 - configured sync modes: {public.WTT_CustomerAssetsReading=full_refresh - overwrite, public.WTT_Customer=full_refresh - overwrite, public.WTT_Asset=full_refresh - overwrite} 2023-06-02 09:41:22 INFO i.a.w.i.DefaultAirbyteDestination(start):92 - Running destination... 2023-06-02 09:41:22 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:22 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:41:22 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:41:22 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:41:22 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:41:22 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 09:41:22 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 09:41:22 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-mysql:0.1.20 exists... 2023-06-02 09:41:22 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-mysql:0.1.20 was found locally. 2023-06-02 09:41:22 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = destination-mysql-write-12-2-uhbgy with resources io.airbyte.config.ResourceRequirements@32e6fa3f[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 09:41:22 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/2 --log-driver none --name destination-mysql-write-12-2-uhbgy --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-mysql:0.1.20 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=2 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=12 airbyte/destination-mysql:0.1.20 write --config destination_config.json --catalog destination_catalog.json 2023-06-02 09:41:22 INFO i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):41 - Writing messages to protocol version 0.2.0 2023-06-02 09:41:22 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 09:41:22 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:41:22 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 09:41:22 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:41:22 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 09:41:22 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 09:41:22 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 09:41:22 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-postgres:2.0.26 exists... 2023-06-02 09:41:22 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-postgres:2.0.26 was found locally. 2023-06-02 09:41:22 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = source-postgres-read-12-2-tdsmu with resources io.airbyte.config.ResourceRequirements@7ec70a6b[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts io.airbyte.config.AllowedHosts@2c733961[hosts=[localhost, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}] 2023-06-02 09:41:22 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/2 --log-driver none --name source-postgres-read-12-2-tdsmu --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:2.0.26 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=2 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=12 airbyte/source-postgres:2.0.26 read --config source_config.json --catalog source_catalog.json 2023-06-02 09:41:22 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 09:41:22 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):94 - Starting source heartbeat check. Will check every 1 minutes. 2023-06-02 09:41:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):377 - Replication thread started. 2023-06-02 09:41:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromDstRunnable$4):311 - Destination output thread started. 2023-06-02 09:41:24 destination > SLF4J: Class path contains multiple SLF4J bindings. 2023-06-02 09:41:24 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 09:41:24 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 09:41:24 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 09:41:24 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2023-06-02 09:41:24 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2023-06-02 09:41:27 destination > 2023-06-02 09:41:27 INFO i.a.i.d.m.MySQLDestination(main):136 - starting destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 09:41:27 destination > 2023-06-02 09:41:27 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2023-06-02 09:41:27 destination > 2023-06-02 09:41:27 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 09:41:27 destination > 2023-06-02 09:41:27 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE 2023-06-02 09:41:27 destination > 2023-06-02 09:41:27 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2023-06-02 09:41:27 source > INFO i.a.i.s.p.PostgresSource(main):484 starting source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 09:41:27 source > INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {read=null, catalog=source_catalog.json, config=source_config.json} 2023-06-02 09:41:27 source > INFO i.a.i.b.IntegrationRunner(runInternal):108 Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 09:41:27 source > INFO i.a.i.b.IntegrationRunner(runInternal):109 Command: READ 2023-06-02 09:41:28 source > INFO i.a.i.b.IntegrationRunner(runInternal):110 Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='null'} 2023-06-02 09:41:28 destination > 2023-06-02 09:41:28 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:41:28 destination > 2023-06-02 09:41:28 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:41:28 destination > 2023-06-02 09:41:28 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:41:28 destination > 2023-06-02 09:41:28 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:41:28 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword groups - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:41:28 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:41:28 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword group - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:41:28 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:41:28 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 09:41:28 destination > 2023-06-02 09:41:28 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2023-06-02 09:41:29 destination > 2023-06-02 09:41:29 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2023-06-02 09:41:29 source > INFO i.a.i.b.s.SshTunnel(getInstance):204 Starting connection with method: NO_TUNNEL 2023-06-02 09:41:29 source > INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 09:41:29 source > INFO i.a.i.s.r.s.StateManagerFactory(createStateManager):55 Stream state manager selected to manage state object with type STREAM. 2023-06-02 09:41:29 destination > 2023-06-02 09:41:29 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2023-06-02 09:41:29 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):181 No cursor field set in catalog but not present in state. Stream: public_WTT_CustomerAssetsReading, New Cursor Field: null. Resetting cursor value 2023-06-02 09:41:29 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):181 No cursor field set in catalog but not present in state. Stream: public_WTT_Asset, New Cursor Field: null. Resetting cursor value 2023-06-02 09:41:29 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):181 No cursor field set in catalog but not present in state. Stream: public_WTT_Customer, New Cursor Field: null. Resetting cursor value 2023-06-02 09:41:29 source > INFO i.a.i.s.p.PostgresSource(toSslJdbcParamInternal):521 DISABLED toSslJdbcParam disable 2023-06-02 09:41:29 destination > 2023-06-02 09:41:29 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=WTT_CustomerAssetsReading, namespace=null, outputSchemaName=airbytepoc, tmpTableName=_airbyte_tmp_cot_wtt_customerassetsreading, outputTableName=_airbyte_raw_wtt_customerassetsreading, syncMode=overwrite} 2023-06-02 09:41:29 destination > 2023-06-02 09:41:29 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=WTT_Customer, namespace=null, outputSchemaName=airbytepoc, tmpTableName=_airbyte_tmp_hrd_wtt_customer, outputTableName=_airbyte_raw_wtt_customer, syncMode=overwrite} 2023-06-02 09:41:29 destination > 2023-06-02 09:41:29 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=WTT_Asset, namespace=null, outputSchemaName=airbytepoc, tmpTableName=_airbyte_tmp_xnr_wtt_asset, outputTableName=_airbyte_raw_wtt_asset, syncMode=overwrite} 2023-06-02 09:41:29 source > INFO c.z.h.HikariDataSource():80 HikariPool-1 - Starting... 2023-06-02 09:41:29 destination > 2023-06-02 09:41:29 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2023-06-02 09:41:29 destination > 2023-06-02 09:41:29 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):123 - Preparing tmp tables in destination started for 3 streams 2023-06-02 09:41:29 destination > 2023-06-02 09:41:29 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream WTT_CustomerAssetsReading. schema: airbytepoc, tmp table name: _airbyte_tmp_cot_wtt_customerassetsreading 2023-06-02 09:41:29 source > INFO c.z.h.HikariDataSource():82 HikariPool-1 - Start completed. 2023-06-02 09:41:30 source > INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 09:41:30 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):440 Data source product recognized as PostgreSQL:15.3 (Debian 15.3-1.pgdg110+1) 2023-06-02 09:41:30 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):452 Discovering indexes for schema "public", table "WTT_CustomerAssetsReading" 2023-06-02 09:41:30 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_CustomerAssetsReading_pkey, Column: id, Unique: true 2023-06-02 09:41:30 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):452 Discovering indexes for schema "public", table "WTT_Customer" 2023-06-02 09:41:30 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Customer_pkey, Column: id, Unique: true 2023-06-02 09:41:30 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__customer_asset_id, Column: assetId, Unique: false 2023-06-02 09:41:30 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__customer_created_by_id, Column: createdById, Unique: false 2023-06-02 09:41:30 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__customer_updated_by_id, Column: updatedById, Unique: false 2023-06-02 09:41:30 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):452 Discovering indexes for schema "public", table "WTT_Asset" 2023-06-02 09:41:30 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Asset_Code_uk, Column: Code, Unique: true 2023-06-02 09:41:30 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Asset_Name_uk, Column: Name, Unique: true 2023-06-02 09:41:30 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Asset_pkey, Column: id, Unique: true 2023-06-02 09:41:30 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__asset_created_by_id, Column: createdById, Unique: false 2023-06-02 09:41:30 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__asset_updated_by_id, Column: updatedById, Unique: false 2023-06-02 09:41:30 source > INFO i.a.i.s.p.PostgresQueryUtils(logXminStatus):76 Xmin Status : {Number of wraparounds: 0, Xmin Transaction Value: 1142, Xmin Raw Value: 1142 2023-06-02 09:41:30 source > INFO i.a.i.s.j.AbstractJdbcSource(discoverInternal):162 Internal schemas to exclude: [catalog_history, information_schema, pg_catalog, pg_internal] 2023-06-02 09:41:30 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 09:41:30 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(accept):40 Set new fetch size: 1323960 rows 2023-06-02 09:41:30 source > INFO i.a.d.j.s.TwoStageSizeEstimator(getTargetBufferByteSize):71 Max memory limit: 6174015488, JDBC buffer size: 3704409293 2023-06-02 09:41:30 source > INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 09:41:30 source > INFO i.a.i.s.p.PostgresSource(estimateFullRefreshSyncSize):575 Estimate for table: "public"."WTT_CustomerAssetsReading" : {sync_row_count: 286, sync_bytes: 24576, total_table_row_count: 286, total_table_bytes: 24576} 2023-06-02 09:41:30 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableFullRefresh):111 Queueing query for table: WTT_CustomerAssetsReading 2023-06-02 09:41:30 source > INFO i.a.i.s.p.PostgresSource(estimateFullRefreshSyncSize):575 Estimate for table: "public"."WTT_Customer" : {sync_row_count: 7, sync_bytes: 8192, total_table_row_count: 7, total_table_bytes: 8192} 2023-06-02 09:41:30 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableFullRefresh):111 Queueing query for table: WTT_Customer 2023-06-02 09:41:30 source > INFO i.a.i.s.p.PostgresSource(estimateFullRefreshSyncSize):575 Estimate for table: "public"."WTT_Asset" : {sync_row_count: 2, sync_bytes: 8192, total_table_row_count: 2, total_table_bytes: 8192} 2023-06-02 09:41:30 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableFullRefresh):111 Queueing query for table: WTT_Asset 2023-06-02 09:41:30 source > INFO i.a.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):67 Queueing query: SELECT "sort","id","ReadingDateTime","AssetId","Value" FROM "public"."WTT_CustomerAssetsReading" 2023-06-02 09:41:30 destination > 2023-06-02 09:41:30 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream WTT_Customer. schema: airbytepoc, tmp table name: _airbyte_tmp_hrd_wtt_customer 2023-06-02 09:41:30 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 09:41:30 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(accept):40 Set new fetch size: 929589 rows 2023-06-02 09:41:30 source > INFO i.a.d.j.s.TwoStageSizeEstimator(getTargetBufferByteSize):71 Max memory limit: 6174015488, JDBC buffer size: 3704409293 2023-06-02 09:41:31 destination > 2023-06-02 09:41:31 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream WTT_Asset. schema: airbytepoc, tmp table name: _airbyte_tmp_xnr_wtt_asset 2023-06-02 09:41:31 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(accept):40 Set new fetch size: 12862532 rows 2023-06-02 09:41:31 destination > 2023-06-02 09:41:31 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):133 - Preparing tables in destination completed. 2023-06-02 09:41:31 source > INFO i.a.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):67 Queueing query: SELECT "createdAt","updatedAt","sort","createdById","updatedById","id","name","Description","IsActive","assetId" FROM "public"."WTT_Customer" 2023-06-02 09:41:31 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 09:41:31 source > INFO i.a.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):67 Queueing query: SELECT "createdAt","updatedAt","sort","createdById","updatedById","id","Name","Code" FROM "public"."WTT_Asset" 2023-06-02 09:41:31 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 09:41:31 source > INFO i.a.i.s.r.AbstractDbSource(lambda$read$1):172 Closing database connection pool. 2023-06-02 09:41:31 source > INFO c.z.h.HikariDataSource(close):350 HikariPool-1 - Shutdown initiated... 2023-06-02 09:41:31 source > INFO c.z.h.HikariDataSource(close):352 HikariPool-1 - Shutdown completed. 2023-06-02 09:41:31 source > INFO i.a.i.s.r.AbstractDbSource(lambda$read$1):174 Closed database connection pool. 2023-06-02 09:41:31 source > INFO i.a.i.b.IntegrationRunner(runInternal):186 Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 09:41:31 source > INFO i.a.i.s.p.PostgresSource(main):486 completed source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 09:41:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):448 - Total records read: 298 (28 KB) 2023-06-02 09:41:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):464 - Schema validation was performed to a max of 10 records with errors per stream. 2023-06-02 09:41:31 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):466 - Schema validation errors found for stream public_WTT_CustomerAssetsReading. Error messages: [$.sort: null found, number expected] 2023-06-02 09:41:31 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):466 - Schema validation errors found for stream public_WTT_Customer. Error messages: [$.assetId: null found, number expected] 2023-06-02 09:41:31 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):111 - thread status... heartbeat thread: false , replication thread: true 2023-06-02 09:41:31 INFO i.a.w.g.DefaultReplicationWorker(replicate):267 - Waiting for source and destination threads to complete. 2023-06-02 09:41:31 INFO i.a.w.g.DefaultReplicationWorker(replicate):272 - One of source or destination thread complete. Waiting on the other. 2023-06-02 09:41:31 destination > 2023-06-02 09:41:31 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2023-06-02 09:41:31 destination > 2023-06-02 09:41:31 INFO i.a.i.d.b.BufferedStreamConsumer(close):171 - executing on success close procedure. 2023-06-02 09:41:31 destination > 2023-06-02 09:41:31 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing WTT_CustomerAssetsReading: 286 records (113 KB) 2023-06-02 09:41:32 destination > 2023-06-02 09:41:32 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing WTT_Customer: 7 records (113 KB) 2023-06-02 09:41:32 destination > 2023-06-02 09:41:32 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing WTT_Asset: 2 records (113 KB) 2023-06-02 09:41:32 destination > 2023-06-02 09:41:32 INFO i.a.i.d.j.SqlOperations(onDestinationCloseOperations):138 - No onDestinationCloseOperations required for this destination. 2023-06-02 09:41:32 destination > 2023-06-02 09:41:32 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):163 - Finalizing tables in destination started for 3 streams 2023-06-02 09:41:32 destination > 2023-06-02 09:41:32 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream WTT_CustomerAssetsReading. schema airbytepoc, tmp table _airbyte_tmp_cot_wtt_customerassetsreading, final table _airbyte_raw_wtt_customerassetsreading 2023-06-02 09:41:32 destination > 2023-06-02 09:41:32 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream WTT_Customer. schema airbytepoc, tmp table _airbyte_tmp_hrd_wtt_customer, final table _airbyte_raw_wtt_customer 2023-06-02 09:41:32 destination > 2023-06-02 09:41:32 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream WTT_Asset. schema airbytepoc, tmp table _airbyte_tmp_xnr_wtt_asset, final table _airbyte_raw_wtt_asset 2023-06-02 09:41:32 destination > 2023-06-02 09:41:32 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - Executing finalization of tables. 2023-06-02 09:41:32 destination > 2023-06-02 09:41:32 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):183 - Finalizing tables in destination completed. 2023-06-02 09:41:32 destination > 2023-06-02 09:41:32 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):186 - Cleaning tmp tables in destination started for 3 streams 2023-06-02 09:41:32 destination > 2023-06-02 09:41:32 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream WTT_CustomerAssetsReading. schema airbytepoc, tmp table name: _airbyte_tmp_cot_wtt_customerassetsreading 2023-06-02 09:41:32 destination > 2023-06-02 09:41:32 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream WTT_Customer. schema airbytepoc, tmp table name: _airbyte_tmp_hrd_wtt_customer 2023-06-02 09:41:32 destination > 2023-06-02 09:41:32 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream WTT_Asset. schema airbytepoc, tmp table name: _airbyte_tmp_xnr_wtt_asset 2023-06-02 09:41:32 destination > 2023-06-02 09:41:32 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):195 - Cleaning tmp tables in destination completed. 2023-06-02 09:41:32 destination > 2023-06-02 09:41:32 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 09:41:32 destination > 2023-06-02 09:41:32 INFO i.a.i.d.m.MySQLDestination(main):138 - completed destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 09:41:32 INFO i.a.w.g.DefaultReplicationWorker(replicate):274 - Source and destination threads complete. 2023-06-02 09:41:32 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):569 - sync summary: { "status" : "completed", "recordsSynced" : 295, "bytesSynced" : 29038, "startTime" : 1685698882694, "endTime" : 1685698892669, "totalStats" : { "bytesCommitted" : 29038, "bytesEmitted" : 29038, "destinationStateMessagesEmitted" : 0, "destinationWriteEndTime" : 1685698892666, "destinationWriteStartTime" : 1685698882902, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0, "recordsEmitted" : 295, "recordsCommitted" : 295, "replicationEndTime" : 1685698892669, "replicationStartTime" : 1685698882694, "sourceReadEndTime" : 1685698891686, "sourceReadStartTime" : 1685698882784, "sourceStateMessagesEmitted" : 0 }, "streamStats" : [ { "streamName" : "WTT_CustomerAssetsReading", "stats" : { "bytesCommitted" : 27240, "bytesEmitted" : 27240, "recordsEmitted" : 286, "recordsCommitted" : 286 } }, { "streamName" : "WTT_Customer", "stats" : { "bytesCommitted" : 1436, "bytesEmitted" : 1436, "recordsEmitted" : 7, "recordsCommitted" : 7 } }, { "streamName" : "WTT_Asset", "stats" : { "bytesCommitted" : 362, "bytesEmitted" : 362, "recordsEmitted" : 2, "recordsCommitted" : 2 } }, { "streamName" : "WTT_CustomerAssetsReading", "streamNamespace" : "public", "stats" : { "bytesCommitted" : 0, "bytesEmitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0 } }, { "streamName" : "WTT_Asset", "streamNamespace" : "public", "stats" : { "bytesCommitted" : 0, "bytesEmitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0 } }, { "streamName" : "WTT_Customer", "streamNamespace" : "public", "stats" : { "bytesCommitted" : 0, "bytesEmitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0 } } ] } 2023-06-02 09:41:32 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):570 - failures: [ ] 2023-06-02 09:41:32 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:32 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END REPLICATION ----- 2023-06-02 09:41:32 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 09:41:32 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:32 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):157 - sync summary: io.airbyte.config.StandardSyncOutput@5b058883[standardSyncSummary=io.airbyte.config.StandardSyncSummary@640a65db[status=completed,recordsSynced=295,bytesSynced=29038,startTime=1685698882694,endTime=1685698892669,totalStats=io.airbyte.config.SyncStats@79e61a9d[bytesCommitted=29038,bytesEmitted=29038,destinationStateMessagesEmitted=0,destinationWriteEndTime=1685698892666,destinationWriteStartTime=1685698882902,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,recordsEmitted=295,recordsCommitted=295,replicationEndTime=1685698892669,replicationStartTime=1685698882694,sourceReadEndTime=1685698891686,sourceReadStartTime=1685698882784,sourceStateMessagesEmitted=0,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@742e4cd2[streamName=WTT_CustomerAssetsReading,streamNamespace=,stats=io.airbyte.config.SyncStats@3989344[bytesCommitted=27240,bytesEmitted=27240,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=286,recordsCommitted=286,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@348b1a51[streamName=WTT_Customer,streamNamespace=,stats=io.airbyte.config.SyncStats@7d70ccaf[bytesCommitted=1436,bytesEmitted=1436,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=7,recordsCommitted=7,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@7b3e570f[streamName=WTT_Asset,streamNamespace=,stats=io.airbyte.config.SyncStats@3c7be99f[bytesCommitted=362,bytesEmitted=362,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=2,recordsCommitted=2,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@50ce25d3[streamName=WTT_CustomerAssetsReading,streamNamespace=public,stats=io.airbyte.config.SyncStats@2b209ed1[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=0,recordsCommitted=0,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@222f3295[streamName=WTT_Asset,streamNamespace=public,stats=io.airbyte.config.SyncStats@41fb005e[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=0,recordsCommitted=0,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@60ba550f[streamName=WTT_Customer,streamNamespace=public,stats=io.airbyte.config.SyncStats@4f4389df[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=0,recordsCommitted=0,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}]],additionalProperties={}],normalizationSummary=,webhookOperationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@1423b138[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@d43ba12[stream=io.airbyte.protocol.models.AirbyteStream@3f639498[name=WTT_CustomerAssetsReading,jsonSchema={"type":"object","properties":{"Value":{"airbyte_type":"integer","type":"number"},"id":{"airbyte_type":"integer","type":"number"},"sort":{"airbyte_type":"integer","type":"number"},"ReadingDateTime":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"AssetId":{"airbyte_type":"integer","type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@6cbdffda[stream=io.airbyte.protocol.models.AirbyteStream@651e2904[name=WTT_Customer,jsonSchema={"type":"object","properties":{"createdAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"Description":{"type":"string"},"assetId":{"airbyte_type":"integer","type":"number"},"IsActive":{"type":"boolean"},"name":{"type":"string"},"id":{"airbyte_type":"integer","type":"number"},"sort":{"airbyte_type":"integer","type":"number"},"updatedById":{"airbyte_type":"integer","type":"number"},"createdById":{"airbyte_type":"integer","type":"number"},"updatedAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@751d9c9f[stream=io.airbyte.protocol.models.AirbyteStream@567911f0[name=WTT_Asset,jsonSchema={"type":"object","properties":{"createdAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"id":{"airbyte_type":"integer","type":"number"},"sort":{"airbyte_type":"integer","type":"number"},"updatedById":{"airbyte_type":"integer","type":"number"},"Code":{"type":"string"},"createdById":{"airbyte_type":"integer","type":"number"},"Name":{"type":"string"},"updatedAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[],commitStateAsap=true,additionalProperties={}] 2023-06-02 09:41:32 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):162 - Sync summary length: 8381 2023-06-02 09:41:32 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-06-02 09:41:32 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):134 - Using protocol v1 2023-06-02 09:41:32 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):145 - Using normalization: airbyte/normalization-mysql:0.3.0 2023-06-02 09:41:32 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/12/2/logs.log 2023-06-02 09:41:32 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 09:41:32 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 09:41:32 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):129 - Running with normalization version: airbyte/normalization-mysql:0.3.0 2023-06-02 09:41:32 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:32 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START DEFAULT NORMALIZATION ----- 2023-06-02 09:41:32 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:32 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/normalization-mysql:0.3.0 exists... 2023-06-02 09:41:33 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/normalization-mysql:0.3.0 was found locally. 2023-06-02 09:41:33 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = normalization-mysql-normalize-12-2-rvfmf with resources io.airbyte.config.ResourceRequirements@9df10c8[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 09:41:33 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/2/normalize --log-driver none --name normalization-mysql-normalize-12-2-rvfmf --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.44.3 airbyte/normalization-mysql:0.3.0 run --integration-type mysql --config destination_config.json --catalog destination_catalog.json 2023-06-02 09:41:33 normalization > Running: transform-config --config destination_config.json --integration-type mysql --out /data/12/2/normalize 2023-06-02 09:41:34 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/12/2/normalize') 2023-06-02 09:41:34 normalization > transform_mysql 2023-06-02 09:41:34 normalization > Running: transform-catalog --integration-type mysql --profile-config-dir /data/12/2/normalize --catalog destination_catalog.json --out /data/12/2/normalize/models/generated/ --json-column _airbyte_data 2023-06-02 09:41:35 normalization > Processing destination_catalog.json... 2023-06-02 09:41:35 normalization > Generating airbyte_ctes/airbytepoc/wtt_customerassetsreading_ab1.sql from WTT_CustomerAssetsReading 2023-06-02 09:41:35 normalization > Generating airbyte_ctes/airbytepoc/wtt_customerassetsreading_ab2.sql from WTT_CustomerAssetsReading 2023-06-02 09:41:35 normalization > Generating airbyte_ctes/airbytepoc/wtt_customerassetsreading_ab3.sql from WTT_CustomerAssetsReading 2023-06-02 09:41:35 normalization > Adding drop table hook for wtt_customerassetsreading_scd to wtt_customerassetsreading 2023-06-02 09:41:35 normalization > Generating airbyte_tables/airbytepoc/wtt_customerassetsreading.sql from WTT_CustomerAssetsReading 2023-06-02 09:41:35 normalization > Generating airbyte_ctes/airbytepoc/wtt_customer_ab1.sql from WTT_Customer 2023-06-02 09:41:35 normalization > Generating airbyte_ctes/airbytepoc/wtt_customer_ab2.sql from WTT_Customer 2023-06-02 09:41:35 normalization > Generating airbyte_ctes/airbytepoc/wtt_customer_ab3.sql from WTT_Customer 2023-06-02 09:41:35 normalization > Adding drop table hook for wtt_customer_scd to wtt_customer 2023-06-02 09:41:35 normalization > Generating airbyte_tables/airbytepoc/wtt_customer.sql from WTT_Customer 2023-06-02 09:41:35 normalization > Generating airbyte_ctes/airbytepoc/wtt_asset_ab1.sql from WTT_Asset 2023-06-02 09:41:35 normalization > Generating airbyte_ctes/airbytepoc/wtt_asset_ab2.sql from WTT_Asset 2023-06-02 09:41:35 normalization > Generating airbyte_ctes/airbytepoc/wtt_asset_ab3.sql from WTT_Asset 2023-06-02 09:41:35 normalization > Adding drop table hook for wtt_asset_scd to wtt_asset 2023-06-02 09:41:35 normalization > Generating airbyte_tables/airbytepoc/wtt_asset.sql from WTT_Asset 2023-06-02 09:41:35 normalization > detected no config file for ssh, assuming ssh is off. 2023-06-02 09:41:41 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2023-06-02 09:41:41 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2023-06-02 09:41:42 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-06-02 09:41:42 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2023-06-02 09:41:42 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-06-02 09:41:48 normalization > Running with dbt=1.0.0 2023-06-02 09:41:48 normalization > Partial parse save file not found. Starting full parse. 2023-06-02 09:41:51 normalization > [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. There are 2 unused configuration paths: - models.airbyte_utils.generated.airbyte_incremental - models.airbyte_utils.generated.airbyte_views 2023-06-02 09:41:51 normalization > Found 12 models, 0 tests, 0 snapshots, 0 analyses, 591 macros, 0 operations, 0 seed files, 3 sources, 0 exposures, 0 metrics 2023-06-02 09:41:51 normalization > Concurrency: 1 threads (target='prod') 2023-06-02 09:41:52 normalization > 1 of 3 START table model airbytepoc.wtt_asset........................................................................... [RUN] 2023-06-02 09:41:52 normalization > 1 of 3 OK created table model airbytepoc.wtt_asset...................................................................... [SUCCESS 2 in 0.46s] 2023-06-02 09:41:52 normalization > 2 of 3 START table model airbytepoc.wtt_customer........................................................................ [RUN] 2023-06-02 09:41:53 normalization > 2 of 3 OK created table model airbytepoc.wtt_customer................................................................... [SUCCESS 7 in 0.32s] 2023-06-02 09:41:53 normalization > 3 of 3 START table model airbytepoc.wtt_customerassetsreading........................................................... [RUN] 2023-06-02 09:41:53 normalization > 3 of 3 OK created table model airbytepoc.wtt_customerassetsreading...................................................... [SUCCESS 286 in 0.33s] 2023-06-02 09:41:53 normalization > Finished running 3 table models in 1.88s. 2023-06-02 09:41:53 normalization > Completed successfully 2023-06-02 09:41:53 normalization > Done. PASS=3 WARN=0 ERROR=0 SKIP=0 TOTAL=3 2023-06-02 09:41:54 INFO i.a.w.n.DefaultNormalizationRunner(close):194 - Terminating normalization process... 2023-06-02 09:41:54 INFO i.a.w.n.DefaultNormalizationRunner(close):207 - Normalization process successfully terminated. 2023-06-02 09:41:54 INFO i.a.w.g.DefaultNormalizationWorker(run):97 - Normalization executed in 21 seconds for job 12. 2023-06-02 09:41:54 INFO i.a.w.g.DefaultNormalizationWorker(run):109 - Normalization summary: io.airbyte.config.NormalizationSummary@4c7998a3[startTime=1685698892945,endTime=1685698914016,failures=[],additionalProperties={}] 2023-06-02 09:41:54 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 09:41:54 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-06-02 09:41:54 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:54 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END DEFAULT NORMALIZATION ----- 2023-06-02 09:41:54 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:54 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/12/2/logs.log 2023-06-02 09:41:54 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 09:41:54 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 09:41:54 INFO i.a.w.g.DbtTransformationWorker(run):61 - Running dbt transformation. 2023-06-02 09:41:54 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:54 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START DBT TRANSFORMATION ----- 2023-06-02 09:41:54 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 09:41:54 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):129 - Running with normalization version: airbyte/normalization-mysql:0.3.0 2023-06-02 09:41:54 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/normalization-mysql:0.3.0 exists... 2023-06-02 09:41:54 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/normalization-mysql:0.3.0 was found locally. 2023-06-02 09:41:54 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = normalization-mysql-normalize-12-2-uopun with resources io.airbyte.config.ResourceRequirements@16375d33[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 09:41:54 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/2/transform --log-driver none --name normalization-mysql-normalize-12-2-uopun --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.44.3 airbyte/normalization-mysql:0.3.0 configure-dbt --integration-type mysql --config destination_config.json --git-repo https://github.com/ranjit-battewad/dbtdemo.git 2023-06-02 09:41:55 normalization > Running: git clone --depth 5 --single-branch $GIT_REPO git_repo 2023-06-02 09:41:56 normalization > Last 5 commits in git_repo: 2023-06-02 09:41:56 normalization > a939c94 Create a dbt project 2023-06-02 09:41:56 normalization > /data/12/2/transform 2023-06-02 09:41:56 normalization > Running: transform-config --config destination_config.json --integration-type mysql --out /data/12/2/transform 2023-06-02 09:41:57 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/12/2/transform') 2023-06-02 09:41:57 normalization > transform_mysql 2023-06-02 09:41:58 normalization > Cloning into 'git_repo'... 2023-06-02 09:41:58 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if fishtownanalytics/dbt:1.0.0 exists... 2023-06-02 09:41:58 INFO i.a.c.i.LineGobbler(voidCall):149 - fishtownanalytics/dbt:1.0.0 was found locally. 2023-06-02 09:41:58 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = dbt-custom-12-2-yxcqh with resources io.airbyte.config.ResourceRequirements@16375d33[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 09:41:58 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/12/2/transform --log-driver none --name dbt-custom-12-2-yxcqh --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.44.3 --entrypoint /bin/bash fishtownanalytics/dbt:1.0.0 entrypoint.sh run 2023-06-02 09:41:59 dbt > Running from /data/12/2/transform/git_repo 2023-06-02 09:41:59 dbt > detected no config file for ssh, assuming ssh is off. 2023-06-02 09:41:59 dbt > Running: dbt run --profiles-dir=/data/12/2/transform --project-dir=/data/12/2/transform/git_repo 2023-06-02 09:42:03 dbt > 09:42:03 Error importing adapter: No module named 'dbt.adapters.mysql' 2023-06-02 09:42:03 dbt > 09:42:03 Encountered an error while reading profiles: 2023-06-02 09:42:03 dbt > 09:42:03 ERROR: Runtime Error 2023-06-02 09:42:03 dbt > Credentials in profile "normalize", target "prod" invalid: Runtime Error 2023-06-02 09:42:03 dbt > Could not find adapter type mysql! 2023-06-02 09:42:03 dbt > 09:42:03 Defined profiles: 2023-06-02 09:42:03 dbt > 09:42:03 - normalize 2023-06-02 09:42:03 dbt > 09:42:03 2023-06-02 09:42:03 dbt > For more information on configuring profiles, please consult the dbt docs: 2023-06-02 09:42:03 dbt > 2023-06-02 09:42:03 dbt > https://docs.getdbt.com/docs/configure-your-profile 2023-06-02 09:42:03 dbt > 2023-06-02 09:42:03 dbt > 09:42:03 Encountered an error: 2023-06-02 09:42:03 dbt > Runtime Error 2023-06-02 09:42:03 dbt > Could not run dbt 2023-06-02 09:42:03 INFO i.a.w.n.DefaultNormalizationRunner(close):194 - Terminating normalization process... 2023-06-02 09:42:03 INFO i.a.w.n.DefaultNormalizationRunner(close):207 - Normalization process successfully terminated. 2023-06-02 09:42:03 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$5):198 - Completing future exceptionally... io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:75) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Caused by: io.airbyte.workers.exception.WorkerException: DBT Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:71) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] ... 3 more Suppressed: io.airbyte.workers.exception.WorkerException: Dbt transformation process wasn't successful at io.airbyte.workers.general.DbtTransformationRunner.close(DbtTransformationRunner.java:156) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:60) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] 2023-06-02 09:42:03 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 09:42:03 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-06-02 09:42:03 WARN i.t.i.a.ActivityTaskExecutors$BaseActivityTaskExecutor(execute):114 - Activity failure. ActivityId=1cbd1638-5861-36b1-a12b-002f8728e914, activityType=Run, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:305) ~[io.airbyte-airbyte-commons-temporal-0.44.3.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.run(DbtTransformationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?] at io.temporal.internal.activity.RootActivityInboundCallsInterceptor$POJOActivityInboundCallsInterceptor.executeActivity(RootActivityInboundCallsInterceptor.java:64) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.RootActivityInboundCallsInterceptor.execute(RootActivityInboundCallsInterceptor.java:43) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.ActivityTaskExecutors$BaseActivityTaskExecutor.execute(ActivityTaskExecutors.java:95) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.ActivityTaskHandlerImpl.handle(ActivityTaskHandlerImpl.java:92) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handleActivity(ActivityWorker.java:241) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:206) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:179) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.17.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:57) ~[temporal-serviceclient-1.17.0.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:461) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:52) ~[temporal-sdk-1.17.0.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:167) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.lambda$run$3(DbtTransformationActivityImpl.java:134) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:300) ~[io.airbyte-airbyte-commons-temporal-0.44.3.jar:?] ... 14 more Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.lambda$run$3(DbtTransformationActivityImpl.java:134) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:300) ~[io.airbyte-airbyte-commons-temporal-0.44.3.jar:?] ... 14 more Caused by: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:75) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: DBT Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:71) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] ... 1 more Suppressed: io.airbyte.workers.exception.WorkerException: Dbt transformation process wasn't successful at io.airbyte.workers.general.DbtTransformationRunner.close(DbtTransformationRunner.java:156) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:60) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] 2023-06-02 09:42:04 INFO i.a.c.f.EnvVariableFeatureFlags(autoDisablesFailingConnections):36 - Auto Disable Failing Connections: false