2023-06-02 08:56:52 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/10/0/logs.log 2023-06-02 08:56:52 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 08:56:52 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 08:56:52 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:56:52 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:56:52 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK ----- 2023-06-02 08:56:52 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:56:52 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:56:52 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:56:52 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:56:52 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 08:56:52 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 08:56:52 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-postgres:2.0.26 exists... 2023-06-02 08:56:52 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-postgres:2.0.26 was found locally. 2023-06-02 08:56:52 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = source-postgres-check-10-0-kjzdj with resources io.airbyte.config.ResourceRequirements@43d96782[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts io.airbyte.config.AllowedHosts@15bec5ea[hosts=[localhost, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}] 2023-06-02 08:56:52 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/0 --log-driver none --name source-postgres-check-10-0-kjzdj --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:2.0.26 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=10 airbyte/source-postgres:2.0.26 check --config source_config.json 2023-06-02 08:56:52 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 08:56:54 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresSource(main):484 starting source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 08:56:54 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {check=null, config=source_config.json} 2023-06-02 08:56:54 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):108 Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 08:56:54 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):109 Command: CHECK 2023-06-02 08:56:54 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):110 Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2023-06-02 08:56:55 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword groups - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:56:55 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:56:55 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword group - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:56:55 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:56:55 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:56:55 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.s.SshTunnel(getInstance):204 Starting connection with method: NO_TUNNEL 2023-06-02 08:56:55 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 08:56:55 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresSource(toSslJdbcParamInternal):521 DISABLED toSslJdbcParam disable 2023-06-02 08:56:55 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource():80 HikariPool-1 - Starting... 2023-06-02 08:56:55 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource():82 HikariPool-1 - Start completed. 2023-06-02 08:56:55 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 08:56:55 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 08:56:55 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):134 Attempting to get metadata from the database to see if we can connect. 2023-06-02 08:56:55 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource(close):350 HikariPool-1 - Shutdown initiated... 2023-06-02 08:56:55 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource(close):352 HikariPool-1 - Shutdown completed. 2023-06-02 08:56:55 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):186 Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 08:56:55 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresSource(main):486 completed source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 08:56:55 INFO i.a.w.g.DefaultCheckConnectionWorker(run):115 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@3563c025[status=succeeded,message=,additionalProperties={}] 2023-06-02 08:56:56 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 08:56:56 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:56:56 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK ----- 2023-06-02 08:56:56 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:56:56 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/10/0/logs.log 2023-06-02 08:56:56 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 08:56:56 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 08:56:56 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:56:56 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:56:56 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:56:56 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:56:56 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 08:56:56 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 08:56:56 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:56:56 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK ----- 2023-06-02 08:56:56 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:56:56 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-mysql:0.1.20 exists... 2023-06-02 08:56:56 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-mysql:0.1.20 was found locally. 2023-06-02 08:56:56 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = destination-mysql-check-10-0-afifk with resources io.airbyte.config.ResourceRequirements@43d96782[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 08:56:56 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/0 --log-driver none --name destination-mysql-check-10-0-afifk --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-mysql:0.1.20 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=10 airbyte/destination-mysql:0.1.20 check --config source_config.json 2023-06-02 08:56:56 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 08:56:57 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Class path contains multiple SLF4J bindings. 2023-06-02 08:56:57 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 08:56:57 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 08:56:57 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 08:56:57 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2023-06-02 08:56:57 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2023-06-02 08:56:58 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:56:58 INFO i.a.i.d.m.MySQLDestination(main):136 - starting destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 08:56:58 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:56:58 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2023-06-02 08:56:58 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:56:58 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 08:56:58 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:56:58 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK 2023-06-02 08:56:58 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:56:58 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2023-06-02 08:56:59 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:56:59 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:56:59 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:56:59 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:56:59 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:56:59 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:56:59 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:56:59 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:56:59 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:56:59 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2023-06-02 08:57:00 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:00 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2023-06-02 08:57:00 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:00 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2023-06-02 08:57:01 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:01 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated... 2023-06-02 08:57:01 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:01 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed. 2023-06-02 08:57:01 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:01 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 08:57:01 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:01 INFO i.a.i.d.m.MySQLDestination(main):138 - completed destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 08:57:01 INFO i.a.w.g.DefaultCheckConnectionWorker(run):115 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@35a117cd[status=succeeded,message=,additionalProperties={}] 2023-06-02 08:57:01 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 08:57:01 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:01 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK ----- 2023-06-02 08:57:01 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:02 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get state 2023-06-02 08:57:02 INFO i.a.w.h.NormalizationInDestinationHelper(shouldNormalizeInDestination):52 - Requires Normalization: true Normalization Supported: false, Feature Flag Enabled: false 2023-06-02 08:57:02 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to set attempt sync config 2023-06-02 08:57:02 INFO i.a.c.t.s.DefaultTaskQueueMapper(getTaskQueue):31 - Called DefaultTaskQueueMapper getTaskQueue for geography auto 2023-06-02 08:57:03 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/10/0/logs.log 2023-06-02 08:57:03 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 08:57:03 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 08:57:03 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get the source for heartbeat 2023-06-02 08:57:03 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get the source definition 2023-06-02 08:57:03 INFO i.a.w.g.ReplicationWorkerFactory(create):95 - Setting up source... 2023-06-02 08:57:03 INFO i.a.w.g.ReplicationWorkerFactory(create):99 - Setting up destination... 2023-06-02 08:57:03 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable METRIC_CLIENT: '' 2023-06-02 08:57:03 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2023-06-02 08:57:03 INFO i.a.w.g.ReplicationWorkerFactory(create):108 - Setting up replication worker... 2023-06-02 08:57:03 INFO i.a.w.g.DefaultReplicationWorker(run):162 - start sync worker. job id: 10 attempt id: 0 2023-06-02 08:57:03 INFO i.a.w.g.DefaultReplicationWorker(run):164 - Committing states from replication activity 2023-06-02 08:57:03 INFO i.a.w.g.DefaultReplicationWorker(run):167 - Committing stats from replication activity 2023-06-02 08:57:03 INFO i.a.w.g.DefaultReplicationWorker(run):183 - configured sync modes: {public.WTT_CustomerAssetsReading=full_refresh - overwrite, public.WTT_Customer=full_refresh - overwrite, public.WTT_Asset=full_refresh - overwrite} 2023-06-02 08:57:03 INFO i.a.w.i.DefaultAirbyteDestination(start):92 - Running destination... 2023-06-02 08:57:03 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:57:03 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:57:03 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:57:03 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:57:03 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 08:57:03 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 08:57:03 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:03 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START REPLICATION ----- 2023-06-02 08:57:03 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:03 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-mysql:0.1.20 exists... 2023-06-02 08:57:03 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-mysql:0.1.20 was found locally. 2023-06-02 08:57:03 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = destination-mysql-write-10-0-jfaxs with resources io.airbyte.config.ResourceRequirements@5ada9614[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 08:57:03 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/0 --log-driver none --name destination-mysql-write-10-0-jfaxs --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-mysql:0.1.20 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=10 airbyte/destination-mysql:0.1.20 write --config destination_config.json --catalog destination_catalog.json 2023-06-02 08:57:03 INFO i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):41 - Writing messages to protocol version 0.2.0 2023-06-02 08:57:03 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 08:57:03 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:57:03 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:57:03 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:57:03 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:57:03 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 08:57:03 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 08:57:03 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-postgres:2.0.26 exists... 2023-06-02 08:57:03 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-postgres:2.0.26 was found locally. 2023-06-02 08:57:03 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = source-postgres-read-10-0-zqixy with resources io.airbyte.config.ResourceRequirements@764eb6f9[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts io.airbyte.config.AllowedHosts@ced7cf9[hosts=[localhost, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}] 2023-06-02 08:57:03 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/0 --log-driver none --name source-postgres-read-10-0-zqixy --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:2.0.26 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=10 airbyte/source-postgres:2.0.26 read --config source_config.json --catalog source_catalog.json 2023-06-02 08:57:03 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 08:57:03 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):94 - Starting source heartbeat check. Will check every 1 minutes. 2023-06-02 08:57:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):377 - Replication thread started. 2023-06-02 08:57:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromDstRunnable$4):311 - Destination output thread started. 2023-06-02 08:57:04 destination > SLF4J: Class path contains multiple SLF4J bindings. 2023-06-02 08:57:04 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 08:57:04 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 08:57:04 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 08:57:04 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2023-06-02 08:57:05 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2023-06-02 08:57:07 destination > 2023-06-02 08:57:07 INFO i.a.i.d.m.MySQLDestination(main):136 - starting destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 08:57:08 destination > 2023-06-02 08:57:08 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2023-06-02 08:57:08 destination > 2023-06-02 08:57:08 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 08:57:08 destination > 2023-06-02 08:57:08 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE 2023-06-02 08:57:08 destination > 2023-06-02 08:57:08 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2023-06-02 08:57:08 source > INFO i.a.i.s.p.PostgresSource(main):484 starting source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 08:57:09 source > INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {read=null, catalog=source_catalog.json, config=source_config.json} 2023-06-02 08:57:09 source > INFO i.a.i.b.IntegrationRunner(runInternal):108 Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 08:57:09 source > INFO i.a.i.b.IntegrationRunner(runInternal):109 Command: READ 2023-06-02 08:57:09 source > INFO i.a.i.b.IntegrationRunner(runInternal):110 Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='null'} 2023-06-02 08:57:09 destination > 2023-06-02 08:57:09 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:09 destination > 2023-06-02 08:57:09 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:09 destination > 2023-06-02 08:57:09 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:09 destination > 2023-06-02 08:57:09 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:10 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword groups - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:10 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:10 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword group - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:10 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:10 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:10 destination > 2023-06-02 08:57:10 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2023-06-02 08:57:10 destination > 2023-06-02 08:57:10 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2023-06-02 08:57:10 destination > 2023-06-02 08:57:10 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2023-06-02 08:57:10 destination > 2023-06-02 08:57:10 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=WTT_CustomerAssetsReading, namespace=null, outputSchemaName=airbytepoc, tmpTableName=_airbyte_tmp_oow_wtt_customerassetsreading, outputTableName=_airbyte_raw_wtt_customerassetsreading, syncMode=overwrite} 2023-06-02 08:57:10 destination > 2023-06-02 08:57:10 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=WTT_Customer, namespace=null, outputSchemaName=airbytepoc, tmpTableName=_airbyte_tmp_ubz_wtt_customer, outputTableName=_airbyte_raw_wtt_customer, syncMode=overwrite} 2023-06-02 08:57:10 destination > 2023-06-02 08:57:10 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=WTT_Asset, namespace=null, outputSchemaName=airbytepoc, tmpTableName=_airbyte_tmp_mcl_wtt_asset, outputTableName=_airbyte_raw_wtt_asset, syncMode=overwrite} 2023-06-02 08:57:11 destination > 2023-06-02 08:57:11 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2023-06-02 08:57:11 destination > 2023-06-02 08:57:11 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):123 - Preparing tmp tables in destination started for 3 streams 2023-06-02 08:57:11 destination > 2023-06-02 08:57:11 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream WTT_CustomerAssetsReading. schema: airbytepoc, tmp table name: _airbyte_tmp_oow_wtt_customerassetsreading 2023-06-02 08:57:11 source > INFO i.a.i.b.s.SshTunnel(getInstance):204 Starting connection with method: NO_TUNNEL 2023-06-02 08:57:11 source > INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 08:57:11 source > INFO i.a.i.s.r.s.StateManagerFactory(createStateManager):55 Stream state manager selected to manage state object with type STREAM. 2023-06-02 08:57:11 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):181 No cursor field set in catalog but not present in state. Stream: public_WTT_CustomerAssetsReading, New Cursor Field: null. Resetting cursor value 2023-06-02 08:57:11 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):181 No cursor field set in catalog but not present in state. Stream: public_WTT_Asset, New Cursor Field: null. Resetting cursor value 2023-06-02 08:57:11 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):181 No cursor field set in catalog but not present in state. Stream: public_WTT_Customer, New Cursor Field: null. Resetting cursor value 2023-06-02 08:57:11 source > INFO i.a.i.s.p.PostgresSource(toSslJdbcParamInternal):521 DISABLED toSslJdbcParam disable 2023-06-02 08:57:11 source > INFO c.z.h.HikariDataSource():80 HikariPool-1 - Starting... 2023-06-02 08:57:11 source > INFO c.z.h.HikariDataSource():82 HikariPool-1 - Start completed. 2023-06-02 08:57:12 source > INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 08:57:12 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):440 Data source product recognized as PostgreSQL:15.3 (Debian 15.3-1.pgdg110+1) 2023-06-02 08:57:12 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):452 Discovering indexes for schema "public", table "WTT_CustomerAssetsReading" 2023-06-02 08:57:12 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_CustomerAssetsReading_pkey, Column: id, Unique: true 2023-06-02 08:57:12 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):452 Discovering indexes for schema "public", table "WTT_Customer" 2023-06-02 08:57:12 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Customer_pkey, Column: id, Unique: true 2023-06-02 08:57:12 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__customer_asset_id, Column: assetId, Unique: false 2023-06-02 08:57:12 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__customer_created_by_id, Column: createdById, Unique: false 2023-06-02 08:57:12 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__customer_updated_by_id, Column: updatedById, Unique: false 2023-06-02 08:57:12 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):452 Discovering indexes for schema "public", table "WTT_Asset" 2023-06-02 08:57:12 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Asset_Code_uk, Column: Code, Unique: true 2023-06-02 08:57:12 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Asset_Name_uk, Column: Name, Unique: true 2023-06-02 08:57:12 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Asset_pkey, Column: id, Unique: true 2023-06-02 08:57:12 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__asset_created_by_id, Column: createdById, Unique: false 2023-06-02 08:57:12 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__asset_updated_by_id, Column: updatedById, Unique: false 2023-06-02 08:57:12 destination > 2023-06-02 08:57:12 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream WTT_Customer. schema: airbytepoc, tmp table name: _airbyte_tmp_ubz_wtt_customer 2023-06-02 08:57:12 source > INFO i.a.i.s.p.PostgresQueryUtils(logXminStatus):76 Xmin Status : {Number of wraparounds: 0, Xmin Transaction Value: 1142, Xmin Raw Value: 1142 2023-06-02 08:57:12 source > INFO i.a.i.s.j.AbstractJdbcSource(discoverInternal):162 Internal schemas to exclude: [catalog_history, information_schema, pg_catalog, pg_internal] 2023-06-02 08:57:12 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 08:57:12 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(accept):40 Set new fetch size: 1323960 rows 2023-06-02 08:57:12 source > INFO i.a.d.j.s.TwoStageSizeEstimator(getTargetBufferByteSize):71 Max memory limit: 6174015488, JDBC buffer size: 3704409293 2023-06-02 08:57:12 destination > 2023-06-02 08:57:12 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream WTT_Asset. schema: airbytepoc, tmp table name: _airbyte_tmp_mcl_wtt_asset 2023-06-02 08:57:12 destination > 2023-06-02 08:57:12 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):133 - Preparing tables in destination completed. 2023-06-02 08:57:12 source > INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 08:57:13 source > INFO i.a.i.s.p.PostgresSource(estimateFullRefreshSyncSize):575 Estimate for table: "public"."WTT_CustomerAssetsReading" : {sync_row_count: 286, sync_bytes: 24576, total_table_row_count: 286, total_table_bytes: 24576} 2023-06-02 08:57:13 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableFullRefresh):111 Queueing query for table: WTT_CustomerAssetsReading 2023-06-02 08:57:13 source > INFO i.a.i.s.p.PostgresSource(estimateFullRefreshSyncSize):575 Estimate for table: "public"."WTT_Customer" : {sync_row_count: 7, sync_bytes: 8192, total_table_row_count: 7, total_table_bytes: 8192} 2023-06-02 08:57:13 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableFullRefresh):111 Queueing query for table: WTT_Customer 2023-06-02 08:57:13 source > INFO i.a.i.s.p.PostgresSource(estimateFullRefreshSyncSize):575 Estimate for table: "public"."WTT_Asset" : {sync_row_count: 2, sync_bytes: 8192, total_table_row_count: 2, total_table_bytes: 8192} 2023-06-02 08:57:13 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableFullRefresh):111 Queueing query for table: WTT_Asset 2023-06-02 08:57:13 source > INFO i.a.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):67 Queueing query: SELECT "sort","id","ReadingDateTime","AssetId","Value" FROM "public"."WTT_CustomerAssetsReading" 2023-06-02 08:57:13 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 08:57:13 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(accept):40 Set new fetch size: 929589 rows 2023-06-02 08:57:13 source > INFO i.a.d.j.s.TwoStageSizeEstimator(getTargetBufferByteSize):71 Max memory limit: 6174015488, JDBC buffer size: 3704409293 2023-06-02 08:57:13 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(accept):40 Set new fetch size: 12862532 rows 2023-06-02 08:57:13 source > INFO i.a.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):67 Queueing query: SELECT "createdAt","updatedAt","sort","createdById","updatedById","id","name","Description","IsActive","assetId" FROM "public"."WTT_Customer" 2023-06-02 08:57:13 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 08:57:13 source > INFO i.a.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):67 Queueing query: SELECT "createdAt","updatedAt","sort","createdById","updatedById","id","Name","Code" FROM "public"."WTT_Asset" 2023-06-02 08:57:13 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 08:57:13 source > INFO i.a.i.s.r.AbstractDbSource(lambda$read$1):172 Closing database connection pool. 2023-06-02 08:57:13 source > INFO c.z.h.HikariDataSource(close):350 HikariPool-1 - Shutdown initiated... 2023-06-02 08:57:13 source > INFO c.z.h.HikariDataSource(close):352 HikariPool-1 - Shutdown completed. 2023-06-02 08:57:13 source > INFO i.a.i.s.r.AbstractDbSource(lambda$read$1):174 Closed database connection pool. 2023-06-02 08:57:13 source > INFO i.a.i.b.IntegrationRunner(runInternal):186 Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 08:57:13 source > INFO i.a.i.s.p.PostgresSource(main):486 completed source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 08:57:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):448 - Total records read: 298 (28 KB) 2023-06-02 08:57:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):464 - Schema validation was performed to a max of 10 records with errors per stream. 2023-06-02 08:57:13 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):466 - Schema validation errors found for stream public_WTT_CustomerAssetsReading. Error messages: [$.sort: null found, number expected] 2023-06-02 08:57:13 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):466 - Schema validation errors found for stream public_WTT_Customer. Error messages: [$.assetId: null found, number expected] 2023-06-02 08:57:13 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):111 - thread status... heartbeat thread: false , replication thread: true 2023-06-02 08:57:13 INFO i.a.w.g.DefaultReplicationWorker(replicate):267 - Waiting for source and destination threads to complete. 2023-06-02 08:57:13 INFO i.a.w.g.DefaultReplicationWorker(replicate):272 - One of source or destination thread complete. Waiting on the other. 2023-06-02 08:57:13 destination > 2023-06-02 08:57:13 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2023-06-02 08:57:13 destination > 2023-06-02 08:57:13 INFO i.a.i.d.b.BufferedStreamConsumer(close):171 - executing on success close procedure. 2023-06-02 08:57:13 destination > 2023-06-02 08:57:13 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing WTT_CustomerAssetsReading: 286 records (113 KB) 2023-06-02 08:57:14 destination > 2023-06-02 08:57:14 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing WTT_Customer: 7 records (113 KB) 2023-06-02 08:57:14 destination > 2023-06-02 08:57:14 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing WTT_Asset: 2 records (113 KB) 2023-06-02 08:57:14 destination > 2023-06-02 08:57:14 INFO i.a.i.d.j.SqlOperations(onDestinationCloseOperations):138 - No onDestinationCloseOperations required for this destination. 2023-06-02 08:57:14 destination > 2023-06-02 08:57:14 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):163 - Finalizing tables in destination started for 3 streams 2023-06-02 08:57:14 destination > 2023-06-02 08:57:14 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream WTT_CustomerAssetsReading. schema airbytepoc, tmp table _airbyte_tmp_oow_wtt_customerassetsreading, final table _airbyte_raw_wtt_customerassetsreading 2023-06-02 08:57:14 destination > 2023-06-02 08:57:14 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream WTT_Customer. schema airbytepoc, tmp table _airbyte_tmp_ubz_wtt_customer, final table _airbyte_raw_wtt_customer 2023-06-02 08:57:14 destination > 2023-06-02 08:57:14 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream WTT_Asset. schema airbytepoc, tmp table _airbyte_tmp_mcl_wtt_asset, final table _airbyte_raw_wtt_asset 2023-06-02 08:57:14 destination > 2023-06-02 08:57:14 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - Executing finalization of tables. 2023-06-02 08:57:14 destination > 2023-06-02 08:57:14 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):183 - Finalizing tables in destination completed. 2023-06-02 08:57:14 destination > 2023-06-02 08:57:14 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):186 - Cleaning tmp tables in destination started for 3 streams 2023-06-02 08:57:14 destination > 2023-06-02 08:57:14 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream WTT_CustomerAssetsReading. schema airbytepoc, tmp table name: _airbyte_tmp_oow_wtt_customerassetsreading 2023-06-02 08:57:14 destination > 2023-06-02 08:57:14 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream WTT_Customer. schema airbytepoc, tmp table name: _airbyte_tmp_ubz_wtt_customer 2023-06-02 08:57:14 destination > 2023-06-02 08:57:14 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream WTT_Asset. schema airbytepoc, tmp table name: _airbyte_tmp_mcl_wtt_asset 2023-06-02 08:57:14 destination > 2023-06-02 08:57:14 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):195 - Cleaning tmp tables in destination completed. 2023-06-02 08:57:14 destination > 2023-06-02 08:57:14 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 08:57:14 destination > 2023-06-02 08:57:14 INFO i.a.i.d.m.MySQLDestination(main):138 - completed destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 08:57:14 INFO i.a.w.g.DefaultReplicationWorker(replicate):274 - Source and destination threads complete. 2023-06-02 08:57:14 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):569 - sync summary: { "status" : "completed", "recordsSynced" : 295, "bytesSynced" : 29038, "startTime" : 1685696223466, "endTime" : 1685696234884, "totalStats" : { "bytesCommitted" : 29038, "bytesEmitted" : 29038, "destinationStateMessagesEmitted" : 0, "destinationWriteEndTime" : 1685696234881, "destinationWriteStartTime" : 1685696223675, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0, "recordsEmitted" : 295, "recordsCommitted" : 295, "replicationEndTime" : 1685696234883, "replicationStartTime" : 1685696223466, "sourceReadEndTime" : 1685696233602, "sourceReadStartTime" : 1685696223588, "sourceStateMessagesEmitted" : 0 }, "streamStats" : [ { "streamName" : "WTT_CustomerAssetsReading", "stats" : { "bytesCommitted" : 27240, "bytesEmitted" : 27240, "recordsEmitted" : 286, "recordsCommitted" : 286 } }, { "streamName" : "WTT_Customer", "stats" : { "bytesCommitted" : 1436, "bytesEmitted" : 1436, "recordsEmitted" : 7, "recordsCommitted" : 7 } }, { "streamName" : "WTT_Asset", "stats" : { "bytesCommitted" : 362, "bytesEmitted" : 362, "recordsEmitted" : 2, "recordsCommitted" : 2 } }, { "streamName" : "WTT_CustomerAssetsReading", "streamNamespace" : "public", "stats" : { "bytesCommitted" : 0, "bytesEmitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0 } }, { "streamName" : "WTT_Asset", "streamNamespace" : "public", "stats" : { "bytesCommitted" : 0, "bytesEmitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0 } }, { "streamName" : "WTT_Customer", "streamNamespace" : "public", "stats" : { "bytesCommitted" : 0, "bytesEmitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0 } } ] } 2023-06-02 08:57:14 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):570 - failures: [ ] 2023-06-02 08:57:14 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:14 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END REPLICATION ----- 2023-06-02 08:57:14 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:14 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 08:57:14 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):157 - sync summary: io.airbyte.config.StandardSyncOutput@1aa1dc34[standardSyncSummary=io.airbyte.config.StandardSyncSummary@72b509e7[status=completed,recordsSynced=295,bytesSynced=29038,startTime=1685696223466,endTime=1685696234884,totalStats=io.airbyte.config.SyncStats@6cf20a58[bytesCommitted=29038,bytesEmitted=29038,destinationStateMessagesEmitted=0,destinationWriteEndTime=1685696234881,destinationWriteStartTime=1685696223675,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,recordsEmitted=295,recordsCommitted=295,replicationEndTime=1685696234883,replicationStartTime=1685696223466,sourceReadEndTime=1685696233602,sourceReadStartTime=1685696223588,sourceStateMessagesEmitted=0,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@31b892d1[streamName=WTT_CustomerAssetsReading,streamNamespace=,stats=io.airbyte.config.SyncStats@25ecb8ae[bytesCommitted=27240,bytesEmitted=27240,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=286,recordsCommitted=286,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@7f4c67c5[streamName=WTT_Customer,streamNamespace=,stats=io.airbyte.config.SyncStats@39012be[bytesCommitted=1436,bytesEmitted=1436,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=7,recordsCommitted=7,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@76cb3607[streamName=WTT_Asset,streamNamespace=,stats=io.airbyte.config.SyncStats@3622c9b8[bytesCommitted=362,bytesEmitted=362,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=2,recordsCommitted=2,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@2accf2f6[streamName=WTT_CustomerAssetsReading,streamNamespace=public,stats=io.airbyte.config.SyncStats@29ca00f3[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=0,recordsCommitted=0,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@61e60c3[streamName=WTT_Asset,streamNamespace=public,stats=io.airbyte.config.SyncStats@265106b1[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=0,recordsCommitted=0,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@6bc71bcf[streamName=WTT_Customer,streamNamespace=public,stats=io.airbyte.config.SyncStats@12f353dc[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=0,recordsCommitted=0,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}]],additionalProperties={}],normalizationSummary=,webhookOperationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@671e3139[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@49d4c7e5[stream=io.airbyte.protocol.models.AirbyteStream@1a1eb473[name=WTT_CustomerAssetsReading,jsonSchema={"type":"object","properties":{"Value":{"airbyte_type":"integer","type":"number"},"id":{"airbyte_type":"integer","type":"number"},"sort":{"airbyte_type":"integer","type":"number"},"ReadingDateTime":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"AssetId":{"airbyte_type":"integer","type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@12fb795f[stream=io.airbyte.protocol.models.AirbyteStream@47a15c0[name=WTT_Customer,jsonSchema={"type":"object","properties":{"createdAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"Description":{"type":"string"},"assetId":{"airbyte_type":"integer","type":"number"},"IsActive":{"type":"boolean"},"name":{"type":"string"},"id":{"airbyte_type":"integer","type":"number"},"sort":{"airbyte_type":"integer","type":"number"},"updatedById":{"airbyte_type":"integer","type":"number"},"createdById":{"airbyte_type":"integer","type":"number"},"updatedAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@6b7e1145[stream=io.airbyte.protocol.models.AirbyteStream@4ac9d75[name=WTT_Asset,jsonSchema={"type":"object","properties":{"createdAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"id":{"airbyte_type":"integer","type":"number"},"sort":{"airbyte_type":"integer","type":"number"},"updatedById":{"airbyte_type":"integer","type":"number"},"Code":{"type":"string"},"createdById":{"airbyte_type":"integer","type":"number"},"Name":{"type":"string"},"updatedAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[],commitStateAsap=true,additionalProperties={}] 2023-06-02 08:57:14 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):162 - Sync summary length: 8379 2023-06-02 08:57:14 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-06-02 08:57:15 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):134 - Using protocol v1 2023-06-02 08:57:15 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):145 - Using normalization: airbyte/normalization-mysql:0.3.0 2023-06-02 08:57:15 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/10/0/logs.log 2023-06-02 08:57:15 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 08:57:15 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 08:57:15 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:15 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START DEFAULT NORMALIZATION ----- 2023-06-02 08:57:15 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):129 - Running with normalization version: airbyte/normalization-mysql:0.3.0 2023-06-02 08:57:15 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:15 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/normalization-mysql:0.3.0 exists... 2023-06-02 08:57:15 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/normalization-mysql:0.3.0 was found locally. 2023-06-02 08:57:15 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = normalization-mysql-normalize-10-0-lzanf with resources io.airbyte.config.ResourceRequirements@26870dd5[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 08:57:15 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/0/normalize --log-driver none --name normalization-mysql-normalize-10-0-lzanf --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.44.3 airbyte/normalization-mysql:0.3.0 run --integration-type mysql --config destination_config.json --catalog destination_catalog.json 2023-06-02 08:57:16 normalization > Running: transform-config --config destination_config.json --integration-type mysql --out /data/10/0/normalize 2023-06-02 08:57:16 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/10/0/normalize') 2023-06-02 08:57:16 normalization > transform_mysql 2023-06-02 08:57:17 normalization > Running: transform-catalog --integration-type mysql --profile-config-dir /data/10/0/normalize --catalog destination_catalog.json --out /data/10/0/normalize/models/generated/ --json-column _airbyte_data 2023-06-02 08:57:18 normalization > Processing destination_catalog.json... 2023-06-02 08:57:18 normalization > Generating airbyte_ctes/airbytepoc/wtt_customerassetsreading_ab1.sql from WTT_CustomerAssetsReading 2023-06-02 08:57:18 normalization > Generating airbyte_ctes/airbytepoc/wtt_customerassetsreading_ab2.sql from WTT_CustomerAssetsReading 2023-06-02 08:57:18 normalization > Generating airbyte_ctes/airbytepoc/wtt_customerassetsreading_ab3.sql from WTT_CustomerAssetsReading 2023-06-02 08:57:18 normalization > Adding drop table hook for wtt_customerassetsreading_scd to wtt_customerassetsreading 2023-06-02 08:57:18 normalization > Generating airbyte_tables/airbytepoc/wtt_customerassetsreading.sql from WTT_CustomerAssetsReading 2023-06-02 08:57:18 normalization > Generating airbyte_ctes/airbytepoc/wtt_customer_ab1.sql from WTT_Customer 2023-06-02 08:57:18 normalization > Generating airbyte_ctes/airbytepoc/wtt_customer_ab2.sql from WTT_Customer 2023-06-02 08:57:18 normalization > Generating airbyte_ctes/airbytepoc/wtt_customer_ab3.sql from WTT_Customer 2023-06-02 08:57:18 normalization > Adding drop table hook for wtt_customer_scd to wtt_customer 2023-06-02 08:57:18 normalization > Generating airbyte_tables/airbytepoc/wtt_customer.sql from WTT_Customer 2023-06-02 08:57:18 normalization > Generating airbyte_ctes/airbytepoc/wtt_asset_ab1.sql from WTT_Asset 2023-06-02 08:57:18 normalization > Generating airbyte_ctes/airbytepoc/wtt_asset_ab2.sql from WTT_Asset 2023-06-02 08:57:18 normalization > Generating airbyte_ctes/airbytepoc/wtt_asset_ab3.sql from WTT_Asset 2023-06-02 08:57:18 normalization > Adding drop table hook for wtt_asset_scd to wtt_asset 2023-06-02 08:57:18 normalization > Generating airbyte_tables/airbytepoc/wtt_asset.sql from WTT_Asset 2023-06-02 08:57:18 normalization > detected no config file for ssh, assuming ssh is off. 2023-06-02 08:57:23 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2023-06-02 08:57:23 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2023-06-02 08:57:23 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-06-02 08:57:23 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2023-06-02 08:57:23 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-06-02 08:57:27 normalization > Running with dbt=1.0.0 2023-06-02 08:57:27 normalization > Partial parse save file not found. Starting full parse. 2023-06-02 08:57:31 normalization > [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. There are 2 unused configuration paths: - models.airbyte_utils.generated.airbyte_views - models.airbyte_utils.generated.airbyte_incremental 2023-06-02 08:57:31 normalization > Found 12 models, 0 tests, 0 snapshots, 0 analyses, 591 macros, 0 operations, 0 seed files, 3 sources, 0 exposures, 0 metrics 2023-06-02 08:57:31 normalization > Concurrency: 1 threads (target='prod') 2023-06-02 08:57:31 normalization > 1 of 3 START table model airbytepoc.wtt_asset........................................................................... [RUN] 2023-06-02 08:57:31 normalization > 1 of 3 OK created table model airbytepoc.wtt_asset...................................................................... [SUCCESS 2 in 0.23s] 2023-06-02 08:57:31 normalization > 2 of 3 START table model airbytepoc.wtt_customer........................................................................ [RUN] 2023-06-02 08:57:31 normalization > 2 of 3 OK created table model airbytepoc.wtt_customer................................................................... [SUCCESS 7 in 0.14s] 2023-06-02 08:57:31 normalization > 3 of 3 START table model airbytepoc.wtt_customerassetsreading........................................................... [RUN] 2023-06-02 08:57:32 normalization > 3 of 3 OK created table model airbytepoc.wtt_customerassetsreading...................................................... [SUCCESS 286 in 0.27s] 2023-06-02 08:57:32 normalization > Finished running 3 table models in 1.14s. 2023-06-02 08:57:32 normalization > Completed successfully 2023-06-02 08:57:32 normalization > Done. PASS=3 WARN=0 ERROR=0 SKIP=0 TOTAL=3 2023-06-02 08:57:32 INFO i.a.w.n.DefaultNormalizationRunner(close):194 - Terminating normalization process... 2023-06-02 08:57:32 INFO i.a.w.n.DefaultNormalizationRunner(close):207 - Normalization process successfully terminated. 2023-06-02 08:57:32 INFO i.a.w.g.DefaultNormalizationWorker(run):97 - Normalization executed in 17 seconds for job 10. 2023-06-02 08:57:32 INFO i.a.w.g.DefaultNormalizationWorker(run):109 - Normalization summary: io.airbyte.config.NormalizationSummary@39338ad1[startTime=1685696235293,endTime=1685696252650,failures=[],additionalProperties={}] 2023-06-02 08:57:32 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 08:57:32 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-06-02 08:57:32 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:32 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END DEFAULT NORMALIZATION ----- 2023-06-02 08:57:32 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:32 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/10/0/logs.log 2023-06-02 08:57:32 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 08:57:32 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 08:57:32 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:32 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START DBT TRANSFORMATION ----- 2023-06-02 08:57:32 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:32 INFO i.a.w.g.DbtTransformationWorker(run):61 - Running dbt transformation. 2023-06-02 08:57:32 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):129 - Running with normalization version: airbyte/normalization-mysql:0.3.0 2023-06-02 08:57:32 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/normalization-mysql:0.3.0 exists... 2023-06-02 08:57:33 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/normalization-mysql:0.3.0 was found locally. 2023-06-02 08:57:33 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = normalization-mysql-normalize-10-0-oivxw with resources io.airbyte.config.ResourceRequirements@5bef71ba[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 08:57:33 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/0/transform --log-driver none --name normalization-mysql-normalize-10-0-oivxw --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.44.3 airbyte/normalization-mysql:0.3.0 configure-dbt --integration-type mysql --config destination_config.json --git-repo https://github.com/ranjit-battewad/dbtdemo.git 2023-06-02 08:57:33 normalization > Running: git clone --depth 5 --single-branch $GIT_REPO git_repo 2023-06-02 08:57:34 normalization > Last 5 commits in git_repo: 2023-06-02 08:57:34 normalization > a939c94 Create a dbt project 2023-06-02 08:57:34 normalization > /data/10/0/transform 2023-06-02 08:57:34 normalization > Running: transform-config --config destination_config.json --integration-type mysql --out /data/10/0/transform 2023-06-02 08:57:35 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/10/0/transform') 2023-06-02 08:57:35 normalization > transform_mysql 2023-06-02 08:57:35 normalization > Cloning into 'git_repo'... 2023-06-02 08:57:35 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if fishtownanalytics/dbt:1.0.0 exists... 2023-06-02 08:57:36 INFO i.a.c.i.LineGobbler(voidCall):149 - fishtownanalytics/dbt:1.0.0 was found locally. 2023-06-02 08:57:36 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = dbt-custom-10-0-uikrq with resources io.airbyte.config.ResourceRequirements@5bef71ba[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 08:57:36 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/0/transform --log-driver none --name dbt-custom-10-0-uikrq --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.44.3 --entrypoint /bin/bash fishtownanalytics/dbt:1.0.0 entrypoint.sh run 2023-06-02 08:57:36 dbt > Running from /data/10/0/transform/git_repo 2023-06-02 08:57:36 dbt > detected no config file for ssh, assuming ssh is off. 2023-06-02 08:57:36 dbt > Running: dbt run --profiles-dir=/data/10/0/transform --project-dir=/data/10/0/transform/git_repo 2023-06-02 08:57:42 dbt > 08:57:42 Error importing adapter: No module named 'dbt.adapters.mysql' 2023-06-02 08:57:42 dbt > 08:57:42 Encountered an error while reading profiles: 2023-06-02 08:57:42 dbt > 08:57:42 ERROR: Runtime Error 2023-06-02 08:57:42 dbt > Credentials in profile "normalize", target "prod" invalid: Runtime Error 2023-06-02 08:57:42 dbt > Could not find adapter type mysql! 2023-06-02 08:57:42 dbt > 08:57:42 Defined profiles: 2023-06-02 08:57:42 dbt > 08:57:42 - normalize 2023-06-02 08:57:42 dbt > 08:57:42 2023-06-02 08:57:42 dbt > For more information on configuring profiles, please consult the dbt docs: 2023-06-02 08:57:42 dbt > 2023-06-02 08:57:42 dbt > https://docs.getdbt.com/docs/configure-your-profile 2023-06-02 08:57:42 dbt > 2023-06-02 08:57:42 dbt > 08:57:42 Encountered an error: 2023-06-02 08:57:42 dbt > Runtime Error 2023-06-02 08:57:42 dbt > Could not run dbt 2023-06-02 08:57:42 INFO i.a.w.n.DefaultNormalizationRunner(close):194 - Terminating normalization process... 2023-06-02 08:57:42 INFO i.a.w.n.DefaultNormalizationRunner(close):207 - Normalization process successfully terminated. 2023-06-02 08:57:42 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$5):198 - Completing future exceptionally... io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:75) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Caused by: io.airbyte.workers.exception.WorkerException: DBT Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:71) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] ... 3 more Suppressed: io.airbyte.workers.exception.WorkerException: Dbt transformation process wasn't successful at io.airbyte.workers.general.DbtTransformationRunner.close(DbtTransformationRunner.java:156) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:60) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] 2023-06-02 08:57:42 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 08:57:42 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-06-02 08:57:42 WARN i.t.i.a.ActivityTaskExecutors$BaseActivityTaskExecutor(execute):114 - Activity failure. ActivityId=25c14396-053d-3ad4-8509-685029665ff4, activityType=Run, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:305) ~[io.airbyte-airbyte-commons-temporal-0.44.3.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.run(DbtTransformationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?] at io.temporal.internal.activity.RootActivityInboundCallsInterceptor$POJOActivityInboundCallsInterceptor.executeActivity(RootActivityInboundCallsInterceptor.java:64) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.RootActivityInboundCallsInterceptor.execute(RootActivityInboundCallsInterceptor.java:43) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.ActivityTaskExecutors$BaseActivityTaskExecutor.execute(ActivityTaskExecutors.java:95) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.ActivityTaskHandlerImpl.handle(ActivityTaskHandlerImpl.java:92) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handleActivity(ActivityWorker.java:241) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:206) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:179) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.17.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:57) ~[temporal-serviceclient-1.17.0.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:461) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:52) ~[temporal-sdk-1.17.0.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:167) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.lambda$run$3(DbtTransformationActivityImpl.java:134) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:300) ~[io.airbyte-airbyte-commons-temporal-0.44.3.jar:?] ... 14 more Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.lambda$run$3(DbtTransformationActivityImpl.java:134) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:300) ~[io.airbyte-airbyte-commons-temporal-0.44.3.jar:?] ... 14 more Caused by: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:75) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: DBT Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:71) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] ... 1 more Suppressed: io.airbyte.workers.exception.WorkerException: Dbt transformation process wasn't successful at io.airbyte.workers.general.DbtTransformationRunner.close(DbtTransformationRunner.java:156) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:60) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] 2023-06-02 08:57:51 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to Get a connection by connection Id 2023-06-02 08:57:52 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get the most recent source actor catalog 2023-06-02 08:57:52 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to Get a connection by connection Id 2023-06-02 08:57:43 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/10/1/logs.log 2023-06-02 08:57:43 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 08:57:43 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 08:57:43 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:57:43 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:43 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:57:43 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK ----- 2023-06-02 08:57:43 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:43 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:57:43 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:57:43 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 08:57:43 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 08:57:43 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-postgres:2.0.26 exists... 2023-06-02 08:57:43 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-postgres:2.0.26 was found locally. 2023-06-02 08:57:43 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = source-postgres-check-10-1-rbxxp with resources io.airbyte.config.ResourceRequirements@43d96782[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts io.airbyte.config.AllowedHosts@584fbf7a[hosts=[localhost, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}] 2023-06-02 08:57:43 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/1 --log-driver none --name source-postgres-check-10-1-rbxxp --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:2.0.26 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=1 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=10 airbyte/source-postgres:2.0.26 check --config source_config.json 2023-06-02 08:57:43 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 08:57:45 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresSource(main):484 starting source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 08:57:45 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {check=null, config=source_config.json} 2023-06-02 08:57:45 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):108 Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 08:57:45 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):109 Command: CHECK 2023-06-02 08:57:45 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):110 Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2023-06-02 08:57:45 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword groups - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:45 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:45 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword group - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:45 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:45 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:46 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.s.SshTunnel(getInstance):204 Starting connection with method: NO_TUNNEL 2023-06-02 08:57:46 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 08:57:46 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresSource(toSslJdbcParamInternal):521 DISABLED toSslJdbcParam disable 2023-06-02 08:57:46 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource():80 HikariPool-1 - Starting... 2023-06-02 08:57:46 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource():82 HikariPool-1 - Start completed. 2023-06-02 08:57:47 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 08:57:47 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 08:57:47 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):134 Attempting to get metadata from the database to see if we can connect. 2023-06-02 08:57:47 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource(close):350 HikariPool-1 - Shutdown initiated... 2023-06-02 08:57:47 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource(close):352 HikariPool-1 - Shutdown completed. 2023-06-02 08:57:47 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):186 Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 08:57:47 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresSource(main):486 completed source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 08:57:47 INFO i.a.w.g.DefaultCheckConnectionWorker(run):115 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@388ed300[status=succeeded,message=,additionalProperties={}] 2023-06-02 08:57:47 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 08:57:47 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:47 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK ----- 2023-06-02 08:57:47 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:47 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/10/1/logs.log 2023-06-02 08:57:47 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 08:57:47 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 08:57:47 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:57:47 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:57:47 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:57:47 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:57:47 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 08:57:47 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 08:57:47 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:47 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK ----- 2023-06-02 08:57:47 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:47 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-mysql:0.1.20 exists... 2023-06-02 08:57:47 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-mysql:0.1.20 was found locally. 2023-06-02 08:57:47 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = destination-mysql-check-10-1-nhkmx with resources io.airbyte.config.ResourceRequirements@43d96782[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 08:57:47 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/1 --log-driver none --name destination-mysql-check-10-1-nhkmx --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-mysql:0.1.20 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=1 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=10 airbyte/destination-mysql:0.1.20 check --config source_config.json 2023-06-02 08:57:47 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 08:57:48 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Class path contains multiple SLF4J bindings. 2023-06-02 08:57:48 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 08:57:48 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 08:57:48 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 08:57:48 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2023-06-02 08:57:48 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2023-06-02 08:57:49 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:49 INFO i.a.i.d.m.MySQLDestination(main):136 - starting destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 08:57:49 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:49 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2023-06-02 08:57:49 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:49 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 08:57:49 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:49 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK 2023-06-02 08:57:49 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:49 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2023-06-02 08:57:49 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:49 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:49 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:49 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:49 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:49 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:49 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:49 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:50 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:50 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2023-06-02 08:57:50 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:50 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2023-06-02 08:57:50 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:50 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2023-06-02 08:57:51 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:51 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated... 2023-06-02 08:57:51 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:51 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed. 2023-06-02 08:57:51 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:51 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 08:57:51 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:57:51 INFO i.a.i.d.m.MySQLDestination(main):138 - completed destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 08:57:51 INFO i.a.w.g.DefaultCheckConnectionWorker(run):115 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@2836acdc[status=succeeded,message=,additionalProperties={}] 2023-06-02 08:57:51 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 08:57:51 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:51 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK ----- 2023-06-02 08:57:51 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:51 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get state 2023-06-02 08:57:51 INFO i.a.w.h.NormalizationInDestinationHelper(shouldNormalizeInDestination):52 - Requires Normalization: true Normalization Supported: false, Feature Flag Enabled: false 2023-06-02 08:57:51 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to set attempt sync config 2023-06-02 08:57:51 INFO i.a.c.t.s.DefaultTaskQueueMapper(getTaskQueue):31 - Called DefaultTaskQueueMapper getTaskQueue for geography auto 2023-06-02 08:57:52 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/10/1/logs.log 2023-06-02 08:57:52 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 08:57:52 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 08:57:52 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get the source for heartbeat 2023-06-02 08:57:52 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get the source definition 2023-06-02 08:57:52 INFO i.a.w.g.ReplicationWorkerFactory(create):95 - Setting up source... 2023-06-02 08:57:52 INFO i.a.w.g.ReplicationWorkerFactory(create):99 - Setting up destination... 2023-06-02 08:57:52 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable METRIC_CLIENT: '' 2023-06-02 08:57:52 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2023-06-02 08:57:52 INFO i.a.w.g.ReplicationWorkerFactory(create):108 - Setting up replication worker... 2023-06-02 08:57:52 INFO i.a.w.g.DefaultReplicationWorker(run):162 - start sync worker. job id: 10 attempt id: 1 2023-06-02 08:57:52 INFO i.a.w.g.DefaultReplicationWorker(run):164 - Committing states from replication activity 2023-06-02 08:57:52 INFO i.a.w.g.DefaultReplicationWorker(run):167 - Committing stats from replication activity 2023-06-02 08:57:52 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:52 INFO i.a.w.g.DefaultReplicationWorker(run):183 - configured sync modes: {public.WTT_CustomerAssetsReading=full_refresh - overwrite, public.WTT_Customer=full_refresh - overwrite, public.WTT_Asset=full_refresh - overwrite} 2023-06-02 08:57:52 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START REPLICATION ----- 2023-06-02 08:57:52 INFO i.a.w.i.DefaultAirbyteDestination(start):92 - Running destination... 2023-06-02 08:57:52 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:57:52 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:57:52 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:57:52 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:57:52 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:57:52 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 08:57:52 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 08:57:52 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-mysql:0.1.20 exists... 2023-06-02 08:57:52 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-mysql:0.1.20 was found locally. 2023-06-02 08:57:52 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = destination-mysql-write-10-1-yvxae with resources io.airbyte.config.ResourceRequirements@2a1d2116[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 08:57:52 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/1 --log-driver none --name destination-mysql-write-10-1-yvxae --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-mysql:0.1.20 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=1 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=10 airbyte/destination-mysql:0.1.20 write --config destination_config.json --catalog destination_catalog.json 2023-06-02 08:57:52 INFO i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):41 - Writing messages to protocol version 0.2.0 2023-06-02 08:57:52 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 08:57:52 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:57:52 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:57:52 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:57:52 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:57:52 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 08:57:52 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 08:57:52 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-postgres:2.0.26 exists... 2023-06-02 08:57:52 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-postgres:2.0.26 was found locally. 2023-06-02 08:57:52 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = source-postgres-read-10-1-yxqxr with resources io.airbyte.config.ResourceRequirements@5e75bec9[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts io.airbyte.config.AllowedHosts@266fa096[hosts=[localhost, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}] 2023-06-02 08:57:52 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/1 --log-driver none --name source-postgres-read-10-1-yxqxr --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:2.0.26 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=1 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=10 airbyte/source-postgres:2.0.26 read --config source_config.json --catalog source_catalog.json 2023-06-02 08:57:52 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 08:57:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromDstRunnable$4):311 - Destination output thread started. 2023-06-02 08:57:52 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):94 - Starting source heartbeat check. Will check every 1 minutes. 2023-06-02 08:57:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):377 - Replication thread started. 2023-06-02 08:57:53 destination > SLF4J: Class path contains multiple SLF4J bindings. 2023-06-02 08:57:53 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 08:57:53 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 08:57:53 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 08:57:53 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2023-06-02 08:57:54 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2023-06-02 08:57:57 destination > 2023-06-02 08:57:57 INFO i.a.i.d.m.MySQLDestination(main):136 - starting destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 08:57:57 destination > 2023-06-02 08:57:57 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2023-06-02 08:57:57 destination > 2023-06-02 08:57:57 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 08:57:57 destination > 2023-06-02 08:57:57 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE 2023-06-02 08:57:57 destination > 2023-06-02 08:57:57 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2023-06-02 08:57:57 source > INFO i.a.i.s.p.PostgresSource(main):484 starting source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 08:57:57 source > INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {read=null, catalog=source_catalog.json, config=source_config.json} 2023-06-02 08:57:57 source > INFO i.a.i.b.IntegrationRunner(runInternal):108 Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 08:57:57 source > INFO i.a.i.b.IntegrationRunner(runInternal):109 Command: READ 2023-06-02 08:57:57 source > INFO i.a.i.b.IntegrationRunner(runInternal):110 Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='null'} 2023-06-02 08:57:58 destination > 2023-06-02 08:57:58 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:58 destination > 2023-06-02 08:57:58 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:58 destination > 2023-06-02 08:57:58 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:58 destination > 2023-06-02 08:57:58 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:58 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword groups - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:58 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:58 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword group - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:58 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:58 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:57:59 destination > 2023-06-02 08:57:59 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2023-06-02 08:57:59 destination > 2023-06-02 08:57:59 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2023-06-02 08:57:59 destination > 2023-06-02 08:57:59 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2023-06-02 08:57:59 destination > 2023-06-02 08:57:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=WTT_CustomerAssetsReading, namespace=null, outputSchemaName=airbytepoc, tmpTableName=_airbyte_tmp_sdl_wtt_customerassetsreading, outputTableName=_airbyte_raw_wtt_customerassetsreading, syncMode=overwrite} 2023-06-02 08:57:59 destination > 2023-06-02 08:57:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=WTT_Customer, namespace=null, outputSchemaName=airbytepoc, tmpTableName=_airbyte_tmp_nrq_wtt_customer, outputTableName=_airbyte_raw_wtt_customer, syncMode=overwrite} 2023-06-02 08:57:59 destination > 2023-06-02 08:57:59 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=WTT_Asset, namespace=null, outputSchemaName=airbytepoc, tmpTableName=_airbyte_tmp_wvc_wtt_asset, outputTableName=_airbyte_raw_wtt_asset, syncMode=overwrite} 2023-06-02 08:57:59 source > INFO i.a.i.b.s.SshTunnel(getInstance):204 Starting connection with method: NO_TUNNEL 2023-06-02 08:57:59 source > INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 08:57:59 source > INFO i.a.i.s.r.s.StateManagerFactory(createStateManager):55 Stream state manager selected to manage state object with type STREAM. 2023-06-02 08:57:59 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):181 No cursor field set in catalog but not present in state. Stream: public_WTT_CustomerAssetsReading, New Cursor Field: null. Resetting cursor value 2023-06-02 08:57:59 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):181 No cursor field set in catalog but not present in state. Stream: public_WTT_Asset, New Cursor Field: null. Resetting cursor value 2023-06-02 08:57:59 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):181 No cursor field set in catalog but not present in state. Stream: public_WTT_Customer, New Cursor Field: null. Resetting cursor value 2023-06-02 08:57:59 source > INFO i.a.i.s.p.PostgresSource(toSslJdbcParamInternal):521 DISABLED toSslJdbcParam disable 2023-06-02 08:58:00 destination > 2023-06-02 08:58:00 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2023-06-02 08:58:00 destination > 2023-06-02 08:58:00 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):123 - Preparing tmp tables in destination started for 3 streams 2023-06-02 08:58:00 destination > 2023-06-02 08:58:00 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream WTT_CustomerAssetsReading. schema: airbytepoc, tmp table name: _airbyte_tmp_sdl_wtt_customerassetsreading 2023-06-02 08:58:00 source > INFO c.z.h.HikariDataSource():80 HikariPool-1 - Starting... 2023-06-02 08:58:00 source > INFO c.z.h.HikariDataSource():82 HikariPool-1 - Start completed. 2023-06-02 08:58:00 source > INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 08:58:00 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):440 Data source product recognized as PostgreSQL:15.3 (Debian 15.3-1.pgdg110+1) 2023-06-02 08:58:00 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):452 Discovering indexes for schema "public", table "WTT_CustomerAssetsReading" 2023-06-02 08:58:00 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_CustomerAssetsReading_pkey, Column: id, Unique: true 2023-06-02 08:58:00 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):452 Discovering indexes for schema "public", table "WTT_Customer" 2023-06-02 08:58:00 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Customer_pkey, Column: id, Unique: true 2023-06-02 08:58:00 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__customer_asset_id, Column: assetId, Unique: false 2023-06-02 08:58:00 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__customer_created_by_id, Column: createdById, Unique: false 2023-06-02 08:58:00 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__customer_updated_by_id, Column: updatedById, Unique: false 2023-06-02 08:58:00 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):452 Discovering indexes for schema "public", table "WTT_Asset" 2023-06-02 08:58:00 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Asset_Code_uk, Column: Code, Unique: true 2023-06-02 08:58:00 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Asset_Name_uk, Column: Name, Unique: true 2023-06-02 08:58:00 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Asset_pkey, Column: id, Unique: true 2023-06-02 08:58:00 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__asset_created_by_id, Column: createdById, Unique: false 2023-06-02 08:58:00 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__asset_updated_by_id, Column: updatedById, Unique: false 2023-06-02 08:58:00 source > INFO i.a.i.s.p.PostgresQueryUtils(logXminStatus):76 Xmin Status : {Number of wraparounds: 0, Xmin Transaction Value: 1142, Xmin Raw Value: 1142 2023-06-02 08:58:00 source > INFO i.a.i.s.j.AbstractJdbcSource(discoverInternal):162 Internal schemas to exclude: [catalog_history, information_schema, pg_catalog, pg_internal] 2023-06-02 08:58:00 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 08:58:01 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(accept):40 Set new fetch size: 1323960 rows 2023-06-02 08:58:01 source > INFO i.a.d.j.s.TwoStageSizeEstimator(getTargetBufferByteSize):71 Max memory limit: 6174015488, JDBC buffer size: 3704409293 2023-06-02 08:58:01 destination > 2023-06-02 08:58:01 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream WTT_Customer. schema: airbytepoc, tmp table name: _airbyte_tmp_nrq_wtt_customer 2023-06-02 08:58:01 source > INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 08:58:01 destination > 2023-06-02 08:58:01 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream WTT_Asset. schema: airbytepoc, tmp table name: _airbyte_tmp_wvc_wtt_asset 2023-06-02 08:58:01 source > INFO i.a.i.s.p.PostgresSource(estimateFullRefreshSyncSize):575 Estimate for table: "public"."WTT_CustomerAssetsReading" : {sync_row_count: 286, sync_bytes: 24576, total_table_row_count: 286, total_table_bytes: 24576} 2023-06-02 08:58:01 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableFullRefresh):111 Queueing query for table: WTT_CustomerAssetsReading 2023-06-02 08:58:01 destination > 2023-06-02 08:58:01 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):133 - Preparing tables in destination completed. 2023-06-02 08:58:01 source > INFO i.a.i.s.p.PostgresSource(estimateFullRefreshSyncSize):575 Estimate for table: "public"."WTT_Customer" : {sync_row_count: 7, sync_bytes: 8192, total_table_row_count: 7, total_table_bytes: 8192} 2023-06-02 08:58:01 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableFullRefresh):111 Queueing query for table: WTT_Customer 2023-06-02 08:58:01 source > INFO i.a.i.s.p.PostgresSource(estimateFullRefreshSyncSize):575 Estimate for table: "public"."WTT_Asset" : {sync_row_count: 2, sync_bytes: 8192, total_table_row_count: 2, total_table_bytes: 8192} 2023-06-02 08:58:01 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableFullRefresh):111 Queueing query for table: WTT_Asset 2023-06-02 08:58:01 source > INFO i.a.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):67 Queueing query: SELECT "sort","id","ReadingDateTime","AssetId","Value" FROM "public"."WTT_CustomerAssetsReading" 2023-06-02 08:58:01 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 08:58:01 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(accept):40 Set new fetch size: 929589 rows 2023-06-02 08:58:01 source > INFO i.a.d.j.s.TwoStageSizeEstimator(getTargetBufferByteSize):71 Max memory limit: 6174015488, JDBC buffer size: 3704409293 2023-06-02 08:58:01 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(accept):40 Set new fetch size: 12862532 rows 2023-06-02 08:58:01 source > INFO i.a.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):67 Queueing query: SELECT "createdAt","updatedAt","sort","createdById","updatedById","id","name","Description","IsActive","assetId" FROM "public"."WTT_Customer" 2023-06-02 08:58:01 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 08:58:01 source > INFO i.a.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):67 Queueing query: SELECT "createdAt","updatedAt","sort","createdById","updatedById","id","Name","Code" FROM "public"."WTT_Asset" 2023-06-02 08:58:01 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 08:58:01 source > INFO i.a.i.s.r.AbstractDbSource(lambda$read$1):172 Closing database connection pool. 2023-06-02 08:58:01 source > INFO c.z.h.HikariDataSource(close):350 HikariPool-1 - Shutdown initiated... 2023-06-02 08:58:01 source > INFO c.z.h.HikariDataSource(close):352 HikariPool-1 - Shutdown completed. 2023-06-02 08:58:01 source > INFO i.a.i.s.r.AbstractDbSource(lambda$read$1):174 Closed database connection pool. 2023-06-02 08:58:01 source > INFO i.a.i.b.IntegrationRunner(runInternal):186 Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 08:58:01 source > INFO i.a.i.s.p.PostgresSource(main):486 completed source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 08:58:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):439 - Source has no more messages, closing connection. 2023-06-02 08:58:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):448 - Total records read: 298 (28 KB) 2023-06-02 08:58:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):464 - Schema validation was performed to a max of 10 records with errors per stream. 2023-06-02 08:58:01 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):466 - Schema validation errors found for stream public_WTT_CustomerAssetsReading. Error messages: [$.sort: null found, number expected] 2023-06-02 08:58:01 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):466 - Schema validation errors found for stream public_WTT_Customer. Error messages: [$.assetId: null found, number expected] 2023-06-02 08:58:01 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):111 - thread status... heartbeat thread: false , replication thread: true 2023-06-02 08:58:01 INFO i.a.w.g.DefaultReplicationWorker(replicate):267 - Waiting for source and destination threads to complete. 2023-06-02 08:58:01 INFO i.a.w.g.DefaultReplicationWorker(replicate):272 - One of source or destination thread complete. Waiting on the other. 2023-06-02 08:58:01 destination > 2023-06-02 08:58:01 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2023-06-02 08:58:01 destination > 2023-06-02 08:58:01 INFO i.a.i.d.b.BufferedStreamConsumer(close):171 - executing on success close procedure. 2023-06-02 08:58:02 destination > 2023-06-02 08:58:01 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing WTT_CustomerAssetsReading: 286 records (113 KB) 2023-06-02 08:58:02 destination > 2023-06-02 08:58:02 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing WTT_Customer: 7 records (113 KB) 2023-06-02 08:58:02 destination > 2023-06-02 08:58:02 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing WTT_Asset: 2 records (113 KB) 2023-06-02 08:58:02 destination > 2023-06-02 08:58:02 INFO i.a.i.d.j.SqlOperations(onDestinationCloseOperations):138 - No onDestinationCloseOperations required for this destination. 2023-06-02 08:58:02 destination > 2023-06-02 08:58:02 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):163 - Finalizing tables in destination started for 3 streams 2023-06-02 08:58:02 destination > 2023-06-02 08:58:02 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream WTT_CustomerAssetsReading. schema airbytepoc, tmp table _airbyte_tmp_sdl_wtt_customerassetsreading, final table _airbyte_raw_wtt_customerassetsreading 2023-06-02 08:58:02 destination > 2023-06-02 08:58:02 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream WTT_Customer. schema airbytepoc, tmp table _airbyte_tmp_nrq_wtt_customer, final table _airbyte_raw_wtt_customer 2023-06-02 08:58:02 destination > 2023-06-02 08:58:02 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream WTT_Asset. schema airbytepoc, tmp table _airbyte_tmp_wvc_wtt_asset, final table _airbyte_raw_wtt_asset 2023-06-02 08:58:02 destination > 2023-06-02 08:58:02 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - Executing finalization of tables. 2023-06-02 08:58:02 destination > 2023-06-02 08:58:02 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):183 - Finalizing tables in destination completed. 2023-06-02 08:58:02 destination > 2023-06-02 08:58:02 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):186 - Cleaning tmp tables in destination started for 3 streams 2023-06-02 08:58:02 destination > 2023-06-02 08:58:02 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream WTT_CustomerAssetsReading. schema airbytepoc, tmp table name: _airbyte_tmp_sdl_wtt_customerassetsreading 2023-06-02 08:58:02 destination > 2023-06-02 08:58:02 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream WTT_Customer. schema airbytepoc, tmp table name: _airbyte_tmp_nrq_wtt_customer 2023-06-02 08:58:02 destination > 2023-06-02 08:58:02 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream WTT_Asset. schema airbytepoc, tmp table name: _airbyte_tmp_wvc_wtt_asset 2023-06-02 08:58:02 destination > 2023-06-02 08:58:02 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):195 - Cleaning tmp tables in destination completed. 2023-06-02 08:58:02 destination > 2023-06-02 08:58:02 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 08:58:02 destination > 2023-06-02 08:58:02 INFO i.a.i.d.m.MySQLDestination(main):138 - completed destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 08:58:02 INFO i.a.w.g.DefaultReplicationWorker(replicate):274 - Source and destination threads complete. 2023-06-02 08:58:02 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):569 - sync summary: { "status" : "completed", "recordsSynced" : 295, "bytesSynced" : 29038, "startTime" : 1685696272271, "endTime" : 1685696282774, "totalStats" : { "bytesCommitted" : 29038, "bytesEmitted" : 29038, "destinationStateMessagesEmitted" : 0, "destinationWriteEndTime" : 1685696282773, "destinationWriteStartTime" : 1685696272454, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0, "recordsEmitted" : 295, "recordsCommitted" : 295, "replicationEndTime" : 1685696282773, "replicationStartTime" : 1685696272271, "sourceReadEndTime" : 1685696281920, "sourceReadStartTime" : 1685696272344, "sourceStateMessagesEmitted" : 0 }, "streamStats" : [ { "streamName" : "WTT_CustomerAssetsReading", "stats" : { "bytesCommitted" : 27240, "bytesEmitted" : 27240, "recordsEmitted" : 286, "recordsCommitted" : 286 } }, { "streamName" : "WTT_Customer", "stats" : { "bytesCommitted" : 1436, "bytesEmitted" : 1436, "recordsEmitted" : 7, "recordsCommitted" : 7 } }, { "streamName" : "WTT_Asset", "stats" : { "bytesCommitted" : 362, "bytesEmitted" : 362, "recordsEmitted" : 2, "recordsCommitted" : 2 } }, { "streamName" : "WTT_CustomerAssetsReading", "streamNamespace" : "public", "stats" : { "bytesCommitted" : 0, "bytesEmitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0 } }, { "streamName" : "WTT_Asset", "streamNamespace" : "public", "stats" : { "bytesCommitted" : 0, "bytesEmitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0 } }, { "streamName" : "WTT_Customer", "streamNamespace" : "public", "stats" : { "bytesCommitted" : 0, "bytesEmitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0 } } ] } 2023-06-02 08:58:02 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):570 - failures: [ ] 2023-06-02 08:58:02 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 08:58:02 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:58:02 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END REPLICATION ----- 2023-06-02 08:58:02 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:58:02 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):157 - sync summary: io.airbyte.config.StandardSyncOutput@172f9823[standardSyncSummary=io.airbyte.config.StandardSyncSummary@4d31a5d9[status=completed,recordsSynced=295,bytesSynced=29038,startTime=1685696272271,endTime=1685696282774,totalStats=io.airbyte.config.SyncStats@277a4fdb[bytesCommitted=29038,bytesEmitted=29038,destinationStateMessagesEmitted=0,destinationWriteEndTime=1685696282773,destinationWriteStartTime=1685696272454,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,recordsEmitted=295,recordsCommitted=295,replicationEndTime=1685696282773,replicationStartTime=1685696272271,sourceReadEndTime=1685696281920,sourceReadStartTime=1685696272344,sourceStateMessagesEmitted=0,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@45eae829[streamName=WTT_CustomerAssetsReading,streamNamespace=,stats=io.airbyte.config.SyncStats@2eef8e37[bytesCommitted=27240,bytesEmitted=27240,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=286,recordsCommitted=286,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@6eb0e95e[streamName=WTT_Customer,streamNamespace=,stats=io.airbyte.config.SyncStats@1bc167c4[bytesCommitted=1436,bytesEmitted=1436,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=7,recordsCommitted=7,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@9787f35[streamName=WTT_Asset,streamNamespace=,stats=io.airbyte.config.SyncStats@5b34c61b[bytesCommitted=362,bytesEmitted=362,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=2,recordsCommitted=2,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@32a72e3a[streamName=WTT_CustomerAssetsReading,streamNamespace=public,stats=io.airbyte.config.SyncStats@22c890ed[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=0,recordsCommitted=0,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@6803d256[streamName=WTT_Asset,streamNamespace=public,stats=io.airbyte.config.SyncStats@15fad553[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=0,recordsCommitted=0,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@1e27ff28[streamName=WTT_Customer,streamNamespace=public,stats=io.airbyte.config.SyncStats@788e4bf9[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=0,recordsCommitted=0,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}]],additionalProperties={}],normalizationSummary=,webhookOperationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@ee9a7dc[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@4d7abb1f[stream=io.airbyte.protocol.models.AirbyteStream@6c85c327[name=WTT_CustomerAssetsReading,jsonSchema={"type":"object","properties":{"Value":{"airbyte_type":"integer","type":"number"},"id":{"airbyte_type":"integer","type":"number"},"sort":{"airbyte_type":"integer","type":"number"},"ReadingDateTime":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"AssetId":{"airbyte_type":"integer","type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@66de8ccd[stream=io.airbyte.protocol.models.AirbyteStream@254a108d[name=WTT_Customer,jsonSchema={"type":"object","properties":{"createdAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"Description":{"type":"string"},"assetId":{"airbyte_type":"integer","type":"number"},"IsActive":{"type":"boolean"},"name":{"type":"string"},"id":{"airbyte_type":"integer","type":"number"},"sort":{"airbyte_type":"integer","type":"number"},"updatedById":{"airbyte_type":"integer","type":"number"},"createdById":{"airbyte_type":"integer","type":"number"},"updatedAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@3df0f578[stream=io.airbyte.protocol.models.AirbyteStream@7fae951a[name=WTT_Asset,jsonSchema={"type":"object","properties":{"createdAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"id":{"airbyte_type":"integer","type":"number"},"sort":{"airbyte_type":"integer","type":"number"},"updatedById":{"airbyte_type":"integer","type":"number"},"Code":{"type":"string"},"createdById":{"airbyte_type":"integer","type":"number"},"Name":{"type":"string"},"updatedAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[],commitStateAsap=true,additionalProperties={}] 2023-06-02 08:58:02 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):162 - Sync summary length: 8381 2023-06-02 08:58:02 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-06-02 08:58:02 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):134 - Using protocol v1 2023-06-02 08:58:02 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):145 - Using normalization: airbyte/normalization-mysql:0.3.0 2023-06-02 08:58:02 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/10/1/logs.log 2023-06-02 08:58:02 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 08:58:02 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 08:58:02 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:58:02 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):129 - Running with normalization version: airbyte/normalization-mysql:0.3.0 2023-06-02 08:58:02 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START DEFAULT NORMALIZATION ----- 2023-06-02 08:58:02 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:58:02 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/normalization-mysql:0.3.0 exists... 2023-06-02 08:58:02 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/normalization-mysql:0.3.0 was found locally. 2023-06-02 08:58:02 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = normalization-mysql-normalize-10-1-udmia with resources io.airbyte.config.ResourceRequirements@42a069b1[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 08:58:02 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/1/normalize --log-driver none --name normalization-mysql-normalize-10-1-udmia --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.44.3 airbyte/normalization-mysql:0.3.0 run --integration-type mysql --config destination_config.json --catalog destination_catalog.json 2023-06-02 08:58:03 normalization > Running: transform-config --config destination_config.json --integration-type mysql --out /data/10/1/normalize 2023-06-02 08:58:04 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/10/1/normalize') 2023-06-02 08:58:04 normalization > transform_mysql 2023-06-02 08:58:04 normalization > Running: transform-catalog --integration-type mysql --profile-config-dir /data/10/1/normalize --catalog destination_catalog.json --out /data/10/1/normalize/models/generated/ --json-column _airbyte_data 2023-06-02 08:58:05 normalization > Processing destination_catalog.json... 2023-06-02 08:58:05 normalization > Generating airbyte_ctes/airbytepoc/wtt_customerassetsreading_ab1.sql from WTT_CustomerAssetsReading 2023-06-02 08:58:05 normalization > Generating airbyte_ctes/airbytepoc/wtt_customerassetsreading_ab2.sql from WTT_CustomerAssetsReading 2023-06-02 08:58:05 normalization > Generating airbyte_ctes/airbytepoc/wtt_customerassetsreading_ab3.sql from WTT_CustomerAssetsReading 2023-06-02 08:58:05 normalization > Adding drop table hook for wtt_customerassetsreading_scd to wtt_customerassetsreading 2023-06-02 08:58:05 normalization > Generating airbyte_tables/airbytepoc/wtt_customerassetsreading.sql from WTT_CustomerAssetsReading 2023-06-02 08:58:05 normalization > Generating airbyte_ctes/airbytepoc/wtt_customer_ab1.sql from WTT_Customer 2023-06-02 08:58:05 normalization > Generating airbyte_ctes/airbytepoc/wtt_customer_ab2.sql from WTT_Customer 2023-06-02 08:58:05 normalization > Generating airbyte_ctes/airbytepoc/wtt_customer_ab3.sql from WTT_Customer 2023-06-02 08:58:05 normalization > Adding drop table hook for wtt_customer_scd to wtt_customer 2023-06-02 08:58:05 normalization > Generating airbyte_tables/airbytepoc/wtt_customer.sql from WTT_Customer 2023-06-02 08:58:05 normalization > Generating airbyte_ctes/airbytepoc/wtt_asset_ab1.sql from WTT_Asset 2023-06-02 08:58:05 normalization > Generating airbyte_ctes/airbytepoc/wtt_asset_ab2.sql from WTT_Asset 2023-06-02 08:58:05 normalization > Generating airbyte_ctes/airbytepoc/wtt_asset_ab3.sql from WTT_Asset 2023-06-02 08:58:05 normalization > Adding drop table hook for wtt_asset_scd to wtt_asset 2023-06-02 08:58:05 normalization > Generating airbyte_tables/airbytepoc/wtt_asset.sql from WTT_Asset 2023-06-02 08:58:05 normalization > detected no config file for ssh, assuming ssh is off. 2023-06-02 08:58:10 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2023-06-02 08:58:10 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2023-06-02 08:58:10 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-06-02 08:58:10 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2023-06-02 08:58:10 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-06-02 08:58:17 normalization > Running with dbt=1.0.0 2023-06-02 08:58:17 normalization > Partial parse save file not found. Starting full parse. 2023-06-02 08:58:20 normalization > [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. There are 2 unused configuration paths: - models.airbyte_utils.generated.airbyte_incremental - models.airbyte_utils.generated.airbyte_views 2023-06-02 08:58:20 normalization > Found 12 models, 0 tests, 0 snapshots, 0 analyses, 591 macros, 0 operations, 0 seed files, 3 sources, 0 exposures, 0 metrics 2023-06-02 08:58:20 normalization > Concurrency: 1 threads (target='prod') 2023-06-02 08:58:20 normalization > 1 of 3 START table model airbytepoc.wtt_asset........................................................................... [RUN] 2023-06-02 08:58:21 normalization > 1 of 3 OK created table model airbytepoc.wtt_asset...................................................................... [SUCCESS 2 in 0.35s] 2023-06-02 08:58:21 normalization > 2 of 3 START table model airbytepoc.wtt_customer........................................................................ [RUN] 2023-06-02 08:58:21 normalization > 2 of 3 OK created table model airbytepoc.wtt_customer................................................................... [SUCCESS 7 in 0.23s] 2023-06-02 08:58:21 normalization > 3 of 3 START table model airbytepoc.wtt_customerassetsreading........................................................... [RUN] 2023-06-02 08:58:21 normalization > 3 of 3 OK created table model airbytepoc.wtt_customerassetsreading...................................................... [SUCCESS 286 in 0.26s] 2023-06-02 08:58:21 normalization > Finished running 3 table models in 1.43s. 2023-06-02 08:58:21 normalization > Completed successfully 2023-06-02 08:58:21 normalization > Done. PASS=3 WARN=0 ERROR=0 SKIP=0 TOTAL=3 2023-06-02 08:58:22 INFO i.a.w.n.DefaultNormalizationRunner(close):194 - Terminating normalization process... 2023-06-02 08:58:22 INFO i.a.w.n.DefaultNormalizationRunner(close):207 - Normalization process successfully terminated. 2023-06-02 08:58:22 INFO i.a.w.g.DefaultNormalizationWorker(run):97 - Normalization executed in 19 seconds for job 10. 2023-06-02 08:58:22 INFO i.a.w.g.DefaultNormalizationWorker(run):109 - Normalization summary: io.airbyte.config.NormalizationSummary@caf00c5[startTime=1685696282885,endTime=1685696302144,failures=[],additionalProperties={}] 2023-06-02 08:58:22 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 08:58:22 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:58:22 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-06-02 08:58:22 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END DEFAULT NORMALIZATION ----- 2023-06-02 08:58:22 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:58:22 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/10/1/logs.log 2023-06-02 08:58:22 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 08:58:22 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 08:58:22 INFO i.a.w.g.DbtTransformationWorker(run):61 - Running dbt transformation. 2023-06-02 08:58:22 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):129 - Running with normalization version: airbyte/normalization-mysql:0.3.0 2023-06-02 08:58:22 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:58:22 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START DBT TRANSFORMATION ----- 2023-06-02 08:58:22 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:58:22 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/normalization-mysql:0.3.0 exists... 2023-06-02 08:58:22 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/normalization-mysql:0.3.0 was found locally. 2023-06-02 08:58:22 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = normalization-mysql-normalize-10-1-ttxex with resources io.airbyte.config.ResourceRequirements@54ed1f3b[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 08:58:22 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/1/transform --log-driver none --name normalization-mysql-normalize-10-1-ttxex --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.44.3 airbyte/normalization-mysql:0.3.0 configure-dbt --integration-type mysql --config destination_config.json --git-repo https://github.com/ranjit-battewad/dbtdemo.git 2023-06-02 08:58:22 normalization > Running: git clone --depth 5 --single-branch $GIT_REPO git_repo 2023-06-02 08:58:23 normalization > Last 5 commits in git_repo: 2023-06-02 08:58:23 normalization > a939c94 Create a dbt project 2023-06-02 08:58:23 normalization > /data/10/1/transform 2023-06-02 08:58:23 normalization > Running: transform-config --config destination_config.json --integration-type mysql --out /data/10/1/transform 2023-06-02 08:58:25 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/10/1/transform') 2023-06-02 08:58:25 normalization > transform_mysql 2023-06-02 08:58:25 normalization > Cloning into 'git_repo'... 2023-06-02 08:58:25 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if fishtownanalytics/dbt:1.0.0 exists... 2023-06-02 08:58:26 INFO i.a.c.i.LineGobbler(voidCall):149 - fishtownanalytics/dbt:1.0.0 was found locally. 2023-06-02 08:58:26 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = dbt-custom-10-1-abnux with resources io.airbyte.config.ResourceRequirements@54ed1f3b[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 08:58:26 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/1/transform --log-driver none --name dbt-custom-10-1-abnux --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.44.3 --entrypoint /bin/bash fishtownanalytics/dbt:1.0.0 entrypoint.sh run 2023-06-02 08:58:27 dbt > Running from /data/10/1/transform/git_repo 2023-06-02 08:58:27 dbt > detected no config file for ssh, assuming ssh is off. 2023-06-02 08:58:27 dbt > Running: dbt run --profiles-dir=/data/10/1/transform --project-dir=/data/10/1/transform/git_repo 2023-06-02 08:58:38 dbt > 08:58:38 Error importing adapter: No module named 'dbt.adapters.mysql' 2023-06-02 08:58:38 dbt > 08:58:38 Encountered an error while reading profiles: 2023-06-02 08:58:38 dbt > 08:58:38 ERROR: Runtime Error 2023-06-02 08:58:38 dbt > Credentials in profile "normalize", target "prod" invalid: Runtime Error 2023-06-02 08:58:38 dbt > Could not find adapter type mysql! 2023-06-02 08:58:38 dbt > 08:58:38 Defined profiles: 2023-06-02 08:58:38 dbt > 08:58:38 - normalize 2023-06-02 08:58:38 dbt > 08:58:38 2023-06-02 08:58:38 dbt > For more information on configuring profiles, please consult the dbt docs: 2023-06-02 08:58:38 dbt > 2023-06-02 08:58:38 dbt > https://docs.getdbt.com/docs/configure-your-profile 2023-06-02 08:58:38 dbt > 2023-06-02 08:58:38 dbt > 08:58:38 Encountered an error: 2023-06-02 08:58:38 dbt > Runtime Error 2023-06-02 08:58:38 dbt > Could not run dbt 2023-06-02 08:58:39 INFO i.a.w.n.DefaultNormalizationRunner(close):194 - Terminating normalization process... 2023-06-02 08:58:39 INFO i.a.w.n.DefaultNormalizationRunner(close):207 - Normalization process successfully terminated. 2023-06-02 08:58:39 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$5):198 - Completing future exceptionally... io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:75) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Caused by: io.airbyte.workers.exception.WorkerException: DBT Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:71) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] ... 3 more Suppressed: io.airbyte.workers.exception.WorkerException: Dbt transformation process wasn't successful at io.airbyte.workers.general.DbtTransformationRunner.close(DbtTransformationRunner.java:156) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:60) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] 2023-06-02 08:58:39 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 08:58:39 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-06-02 08:58:39 WARN i.t.i.a.ActivityTaskExecutors$BaseActivityTaskExecutor(execute):114 - Activity failure. ActivityId=b3c0e8f9-0642-3c68-91b0-4efff6ae5713, activityType=Run, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:305) ~[io.airbyte-airbyte-commons-temporal-0.44.3.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.run(DbtTransformationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?] at io.temporal.internal.activity.RootActivityInboundCallsInterceptor$POJOActivityInboundCallsInterceptor.executeActivity(RootActivityInboundCallsInterceptor.java:64) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.RootActivityInboundCallsInterceptor.execute(RootActivityInboundCallsInterceptor.java:43) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.ActivityTaskExecutors$BaseActivityTaskExecutor.execute(ActivityTaskExecutors.java:95) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.ActivityTaskHandlerImpl.handle(ActivityTaskHandlerImpl.java:92) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handleActivity(ActivityWorker.java:241) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:206) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:179) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.17.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:57) ~[temporal-serviceclient-1.17.0.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:461) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:52) ~[temporal-sdk-1.17.0.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:167) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.lambda$run$3(DbtTransformationActivityImpl.java:134) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:300) ~[io.airbyte-airbyte-commons-temporal-0.44.3.jar:?] ... 14 more Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.lambda$run$3(DbtTransformationActivityImpl.java:134) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:300) ~[io.airbyte-airbyte-commons-temporal-0.44.3.jar:?] ... 14 more Caused by: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:75) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: DBT Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:71) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] ... 1 more Suppressed: io.airbyte.workers.exception.WorkerException: Dbt transformation process wasn't successful at io.airbyte.workers.general.DbtTransformationRunner.close(DbtTransformationRunner.java:156) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:60) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] 2023-06-02 08:59:04 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to Get a connection by connection Id 2023-06-02 08:59:04 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get the most recent source actor catalog 2023-06-02 08:59:04 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to Get a connection by connection Id 2023-06-02 08:58:41 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/10/2/logs.log 2023-06-02 08:58:41 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 08:58:41 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 08:58:41 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:58:41 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:58:41 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK ----- 2023-06-02 08:58:41 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:58:41 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:58:41 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:58:41 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:58:41 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 08:58:41 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 08:58:41 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-postgres:2.0.26 exists... 2023-06-02 08:58:41 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-postgres:2.0.26 was found locally. 2023-06-02 08:58:41 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = source-postgres-check-10-2-rwfpp with resources io.airbyte.config.ResourceRequirements@43d96782[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts io.airbyte.config.AllowedHosts@332d82bf[hosts=[localhost, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}] 2023-06-02 08:58:41 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/2 --log-driver none --name source-postgres-check-10-2-rwfpp --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:2.0.26 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=2 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=10 airbyte/source-postgres:2.0.26 check --config source_config.json 2023-06-02 08:58:41 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 08:58:48 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresSource(main):484 starting source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 08:58:49 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {check=null, config=source_config.json} 2023-06-02 08:58:49 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):108 Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 08:58:49 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):109 Command: CHECK 2023-06-02 08:58:49 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):110 Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2023-06-02 08:58:49 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword groups - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:58:49 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:58:49 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword group - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:58:49 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:58:49 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):314 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:58:50 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.s.SshTunnel(getInstance):204 Starting connection with method: NO_TUNNEL 2023-06-02 08:58:50 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 08:58:50 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresSource(toSslJdbcParamInternal):521 DISABLED toSslJdbcParam disable 2023-06-02 08:58:51 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource():80 HikariPool-1 - Starting... 2023-06-02 08:58:51 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource():82 HikariPool-1 - Start completed. 2023-06-02 08:58:52 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 08:58:52 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 08:58:52 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):134 Attempting to get metadata from the database to see if we can connect. 2023-06-02 08:58:52 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource(close):350 HikariPool-1 - Shutdown initiated... 2023-06-02 08:58:52 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO c.z.h.HikariDataSource(close):352 HikariPool-1 - Shutdown completed. 2023-06-02 08:58:52 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.b.IntegrationRunner(runInternal):186 Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 08:58:52 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):317 - INFO i.a.i.s.p.PostgresSource(main):486 completed source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 08:58:53 INFO i.a.w.g.DefaultCheckConnectionWorker(run):115 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@4e0df19d[status=succeeded,message=,additionalProperties={}] 2023-06-02 08:58:53 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 08:58:53 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:58:53 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK ----- 2023-06-02 08:58:53 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:58:53 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/10/2/logs.log 2023-06-02 08:58:53 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 08:58:53 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 08:58:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:58:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:58:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:58:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:58:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 08:58:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 08:58:53 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:58:53 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK ----- 2023-06-02 08:58:53 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:58:53 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-mysql:0.1.20 exists... 2023-06-02 08:58:53 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-mysql:0.1.20 was found locally. 2023-06-02 08:58:53 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = destination-mysql-check-10-2-zrbxb with resources io.airbyte.config.ResourceRequirements@43d96782[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 08:58:53 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/2 --log-driver none --name destination-mysql-check-10-2-zrbxb --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-mysql:0.1.20 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=2 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=10 airbyte/destination-mysql:0.1.20 check --config source_config.json 2023-06-02 08:58:53 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 08:58:56 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Class path contains multiple SLF4J bindings. 2023-06-02 08:58:56 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 08:58:56 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 08:58:56 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 08:58:56 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2023-06-02 08:58:57 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2023-06-02 08:59:00 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:59:00 INFO i.a.i.d.m.MySQLDestination(main):136 - starting destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 08:59:00 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:59:00 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2023-06-02 08:59:00 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:59:00 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 08:59:00 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:59:00 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK 2023-06-02 08:59:00 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:59:00 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2023-06-02 08:59:00 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:59:00 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:59:01 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:59:01 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:59:01 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:59:01 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:59:01 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:59:01 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:59:01 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:59:01 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2023-06-02 08:59:01 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:59:01 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2023-06-02 08:59:01 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:59:01 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2023-06-02 08:59:03 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:59:03 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated... 2023-06-02 08:59:03 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:59:03 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed. 2023-06-02 08:59:03 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:59:03 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 08:59:03 INFO i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):369 - 2023-06-02 08:59:03 INFO i.a.i.d.m.MySQLDestination(main):138 - completed destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 08:59:03 INFO i.a.w.g.DefaultCheckConnectionWorker(run):115 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@e91d98d[status=succeeded,message=,additionalProperties={}] 2023-06-02 08:59:03 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 08:59:03 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:59:03 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK ----- 2023-06-02 08:59:03 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:59:04 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get state 2023-06-02 08:59:04 INFO i.a.w.h.NormalizationInDestinationHelper(shouldNormalizeInDestination):52 - Requires Normalization: true Normalization Supported: false, Feature Flag Enabled: false 2023-06-02 08:59:04 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to set attempt sync config 2023-06-02 08:59:04 INFO i.a.c.t.s.DefaultTaskQueueMapper(getTaskQueue):31 - Called DefaultTaskQueueMapper getTaskQueue for geography auto 2023-06-02 08:59:04 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/10/2/logs.log 2023-06-02 08:59:04 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 08:59:04 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 08:59:04 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get the source for heartbeat 2023-06-02 08:59:04 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get the source definition 2023-06-02 08:59:04 INFO i.a.w.g.ReplicationWorkerFactory(create):95 - Setting up source... 2023-06-02 08:59:04 INFO i.a.w.g.ReplicationWorkerFactory(create):99 - Setting up destination... 2023-06-02 08:59:04 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable METRIC_CLIENT: '' 2023-06-02 08:59:04 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2023-06-02 08:59:04 INFO i.a.w.g.ReplicationWorkerFactory(create):108 - Setting up replication worker... 2023-06-02 08:59:04 INFO i.a.w.g.DefaultReplicationWorker(run):162 - start sync worker. job id: 10 attempt id: 2 2023-06-02 08:59:04 INFO i.a.w.g.DefaultReplicationWorker(run):164 - Committing states from replication activity 2023-06-02 08:59:04 INFO i.a.w.g.DefaultReplicationWorker(run):167 - Committing stats from replication activity 2023-06-02 08:59:04 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:59:04 INFO i.a.w.g.DefaultReplicationWorker(run):183 - configured sync modes: {public.WTT_CustomerAssetsReading=full_refresh - overwrite, public.WTT_Customer=full_refresh - overwrite, public.WTT_Asset=full_refresh - overwrite} 2023-06-02 08:59:04 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START REPLICATION ----- 2023-06-02 08:59:04 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:59:04 INFO i.a.w.i.DefaultAirbyteDestination(start):92 - Running destination... 2023-06-02 08:59:04 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:59:04 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:59:04 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:59:04 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:59:04 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 08:59:04 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 08:59:04 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-mysql:0.1.20 exists... 2023-06-02 08:59:05 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-mysql:0.1.20 was found locally. 2023-06-02 08:59:05 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = destination-mysql-write-10-2-xcufa with resources io.airbyte.config.ResourceRequirements@52ec80a4[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 08:59:05 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/2 --log-driver none --name destination-mysql-write-10-2-xcufa --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-mysql:0.1.20 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=2 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=10 airbyte/destination-mysql:0.1.20 write --config destination_config.json --catalog destination_catalog.json 2023-06-02 08:59:05 INFO i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):41 - Writing messages to protocol version 0.2.0 2023-06-02 08:59:05 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 08:59:05 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:59:05 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-06-02 08:59:05 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:59:05 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-06-02 08:59:05 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-06-02 08:59:05 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-06-02 08:59:05 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-postgres:2.0.26 exists... 2023-06-02 08:59:05 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-postgres:2.0.26 was found locally. 2023-06-02 08:59:05 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = source-postgres-read-10-2-nsnqf with resources io.airbyte.config.ResourceRequirements@7a18787d[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts io.airbyte.config.AllowedHosts@1c801c[hosts=[localhost, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}] 2023-06-02 08:59:05 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/2 --log-driver none --name source-postgres-read-10-2-nsnqf --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:2.0.26 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=2 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.3 -e WORKER_JOB_ID=10 airbyte/source-postgres:2.0.26 read --config source_config.json --catalog source_catalog.json 2023-06-02 08:59:05 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-06-02 08:59:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromDstRunnable$4):311 - Destination output thread started. 2023-06-02 08:59:05 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):94 - Starting source heartbeat check. Will check every 1 minutes. 2023-06-02 08:59:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):377 - Replication thread started. 2023-06-02 08:59:06 destination > SLF4J: Class path contains multiple SLF4J bindings. 2023-06-02 08:59:06 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 08:59:06 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 08:59:06 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2023-06-02 08:59:06 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2023-06-02 08:59:06 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2023-06-02 08:59:09 destination > 2023-06-02 08:59:09 INFO i.a.i.d.m.MySQLDestination(main):136 - starting destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 08:59:09 source > INFO i.a.i.s.p.PostgresSource(main):484 starting source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 08:59:09 destination > 2023-06-02 08:59:09 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2023-06-02 08:59:09 destination > 2023-06-02 08:59:09 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 08:59:09 destination > 2023-06-02 08:59:09 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE 2023-06-02 08:59:09 destination > 2023-06-02 08:59:09 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2023-06-02 08:59:10 source > INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {read=null, catalog=source_catalog.json, config=source_config.json} 2023-06-02 08:59:10 source > INFO i.a.i.b.IntegrationRunner(runInternal):108 Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 08:59:10 source > INFO i.a.i.b.IntegrationRunner(runInternal):109 Command: READ 2023-06-02 08:59:10 source > INFO i.a.i.b.IntegrationRunner(runInternal):110 Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='null'} 2023-06-02 08:59:10 destination > 2023-06-02 08:59:10 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:59:10 destination > 2023-06-02 08:59:10 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:59:10 destination > 2023-06-02 08:59:10 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:59:10 destination > 2023-06-02 08:59:10 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:59:10 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword groups - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:59:10 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:59:10 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword group - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:59:10 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:59:10 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-06-02 08:59:11 destination > 2023-06-02 08:59:11 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2023-06-02 08:59:11 destination > 2023-06-02 08:59:11 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2023-06-02 08:59:11 source > INFO i.a.i.b.s.SshTunnel(getInstance):204 Starting connection with method: NO_TUNNEL 2023-06-02 08:59:11 source > INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 08:59:11 source > INFO i.a.i.s.r.s.StateManagerFactory(createStateManager):55 Stream state manager selected to manage state object with type STREAM. 2023-06-02 08:59:11 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):181 No cursor field set in catalog but not present in state. Stream: public_WTT_CustomerAssetsReading, New Cursor Field: null. Resetting cursor value 2023-06-02 08:59:12 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):181 No cursor field set in catalog but not present in state. Stream: public_WTT_Asset, New Cursor Field: null. Resetting cursor value 2023-06-02 08:59:12 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):181 No cursor field set in catalog but not present in state. Stream: public_WTT_Customer, New Cursor Field: null. Resetting cursor value 2023-06-02 08:59:12 destination > 2023-06-02 08:59:12 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2023-06-02 08:59:12 source > INFO i.a.i.s.p.PostgresSource(toSslJdbcParamInternal):521 DISABLED toSslJdbcParam disable 2023-06-02 08:59:12 destination > 2023-06-02 08:59:12 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=WTT_CustomerAssetsReading, namespace=null, outputSchemaName=airbytepoc, tmpTableName=_airbyte_tmp_owe_wtt_customerassetsreading, outputTableName=_airbyte_raw_wtt_customerassetsreading, syncMode=overwrite} 2023-06-02 08:59:12 destination > 2023-06-02 08:59:12 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=WTT_Customer, namespace=null, outputSchemaName=airbytepoc, tmpTableName=_airbyte_tmp_ewm_wtt_customer, outputTableName=_airbyte_raw_wtt_customer, syncMode=overwrite} 2023-06-02 08:59:12 destination > 2023-06-02 08:59:12 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=WTT_Asset, namespace=null, outputSchemaName=airbytepoc, tmpTableName=_airbyte_tmp_byt_wtt_asset, outputTableName=_airbyte_raw_wtt_asset, syncMode=overwrite} 2023-06-02 08:59:12 source > INFO c.z.h.HikariDataSource():80 HikariPool-1 - Starting... 2023-06-02 08:59:12 destination > 2023-06-02 08:59:12 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2023-06-02 08:59:12 destination > 2023-06-02 08:59:12 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):123 - Preparing tmp tables in destination started for 3 streams 2023-06-02 08:59:12 destination > 2023-06-02 08:59:12 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream WTT_CustomerAssetsReading. schema: airbytepoc, tmp table name: _airbyte_tmp_owe_wtt_customerassetsreading 2023-06-02 08:59:12 source > INFO c.z.h.HikariDataSource():82 HikariPool-1 - Start completed. 2023-06-02 08:59:14 source > INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 08:59:14 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):440 Data source product recognized as PostgreSQL:15.3 (Debian 15.3-1.pgdg110+1) 2023-06-02 08:59:14 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):452 Discovering indexes for schema "public", table "WTT_CustomerAssetsReading" 2023-06-02 08:59:14 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_CustomerAssetsReading_pkey, Column: id, Unique: true 2023-06-02 08:59:14 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):452 Discovering indexes for schema "public", table "WTT_Customer" 2023-06-02 08:59:14 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Customer_pkey, Column: id, Unique: true 2023-06-02 08:59:14 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__customer_asset_id, Column: assetId, Unique: false 2023-06-02 08:59:14 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__customer_created_by_id, Column: createdById, Unique: false 2023-06-02 08:59:14 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__customer_updated_by_id, Column: updatedById, Unique: false 2023-06-02 08:59:14 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):452 Discovering indexes for schema "public", table "WTT_Asset" 2023-06-02 08:59:14 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Asset_Code_uk, Column: Code, Unique: true 2023-06-02 08:59:14 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Asset_Name_uk, Column: Name, Unique: true 2023-06-02 08:59:14 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: WTT_Asset_pkey, Column: id, Unique: true 2023-06-02 08:59:14 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__asset_created_by_id, Column: createdById, Unique: false 2023-06-02 08:59:14 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):454 Index name: w_t_t__asset_updated_by_id, Column: updatedById, Unique: false 2023-06-02 08:59:14 source > INFO i.a.i.s.p.PostgresQueryUtils(logXminStatus):76 Xmin Status : {Number of wraparounds: 0, Xmin Transaction Value: 1142, Xmin Raw Value: 1142 2023-06-02 08:59:14 source > INFO i.a.i.s.j.AbstractJdbcSource(discoverInternal):162 Internal schemas to exclude: [catalog_history, information_schema, pg_catalog, pg_internal] 2023-06-02 08:59:14 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 08:59:14 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(accept):40 Set new fetch size: 1323960 rows 2023-06-02 08:59:14 source > INFO i.a.d.j.s.TwoStageSizeEstimator(getTargetBufferByteSize):71 Max memory limit: 6174015488, JDBC buffer size: 3704409293 2023-06-02 08:59:14 source > INFO i.a.i.s.p.PostgresUtils(isCdc):53 using CDC: false 2023-06-02 08:59:14 source > INFO i.a.i.s.p.PostgresSource(estimateFullRefreshSyncSize):575 Estimate for table: "public"."WTT_CustomerAssetsReading" : {sync_row_count: 286, sync_bytes: 24576, total_table_row_count: 286, total_table_bytes: 24576} 2023-06-02 08:59:14 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableFullRefresh):111 Queueing query for table: WTT_CustomerAssetsReading 2023-06-02 08:59:14 source > INFO i.a.i.s.p.PostgresSource(estimateFullRefreshSyncSize):575 Estimate for table: "public"."WTT_Customer" : {sync_row_count: 7, sync_bytes: 8192, total_table_row_count: 7, total_table_bytes: 8192} 2023-06-02 08:59:14 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableFullRefresh):111 Queueing query for table: WTT_Customer 2023-06-02 08:59:14 source > INFO i.a.i.s.p.PostgresSource(estimateFullRefreshSyncSize):575 Estimate for table: "public"."WTT_Asset" : {sync_row_count: 2, sync_bytes: 8192, total_table_row_count: 2, total_table_bytes: 8192} 2023-06-02 08:59:14 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableFullRefresh):111 Queueing query for table: WTT_Asset 2023-06-02 08:59:14 destination > 2023-06-02 08:59:14 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream WTT_Customer. schema: airbytepoc, tmp table name: _airbyte_tmp_ewm_wtt_customer 2023-06-02 08:59:14 source > INFO i.a.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):67 Queueing query: SELECT "sort","id","ReadingDateTime","AssetId","Value" FROM "public"."WTT_CustomerAssetsReading" 2023-06-02 08:59:14 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 08:59:14 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(accept):40 Set new fetch size: 929589 rows 2023-06-02 08:59:14 source > INFO i.a.d.j.s.TwoStageSizeEstimator(getTargetBufferByteSize):71 Max memory limit: 6174015488, JDBC buffer size: 3704409293 2023-06-02 08:59:14 destination > 2023-06-02 08:59:14 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream WTT_Asset. schema: airbytepoc, tmp table name: _airbyte_tmp_byt_wtt_asset 2023-06-02 08:59:15 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(accept):40 Set new fetch size: 12862532 rows 2023-06-02 08:59:15 destination > 2023-06-02 08:59:15 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):133 - Preparing tables in destination completed. 2023-06-02 08:59:15 source > INFO i.a.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):67 Queueing query: SELECT "createdAt","updatedAt","sort","createdById","updatedById","id","name","Description","IsActive","assetId" FROM "public"."WTT_Customer" 2023-06-02 08:59:15 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 08:59:15 source > INFO i.a.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):67 Queueing query: SELECT "createdAt","updatedAt","sort","createdById","updatedById","id","Name","Code" FROM "public"."WTT_Asset" 2023-06-02 08:59:15 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):31 Set initial fetch size: 10 rows 2023-06-02 08:59:15 source > INFO i.a.i.s.r.AbstractDbSource(lambda$read$1):172 Closing database connection pool. 2023-06-02 08:59:15 source > INFO c.z.h.HikariDataSource(close):350 HikariPool-1 - Shutdown initiated... 2023-06-02 08:59:15 source > INFO c.z.h.HikariDataSource(close):352 HikariPool-1 - Shutdown completed. 2023-06-02 08:59:15 source > INFO i.a.i.s.r.AbstractDbSource(lambda$read$1):174 Closed database connection pool. 2023-06-02 08:59:15 source > INFO i.a.i.b.IntegrationRunner(runInternal):186 Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-06-02 08:59:15 source > INFO i.a.i.s.p.PostgresSource(main):486 completed source: class io.airbyte.integrations.source.postgres.PostgresSource 2023-06-02 08:59:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):439 - Source has no more messages, closing connection. 2023-06-02 08:59:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):448 - Total records read: 298 (28 KB) 2023-06-02 08:59:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):464 - Schema validation was performed to a max of 10 records with errors per stream. 2023-06-02 08:59:15 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):466 - Schema validation errors found for stream public_WTT_CustomerAssetsReading. Error messages: [$.sort: null found, number expected] 2023-06-02 08:59:15 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):466 - Schema validation errors found for stream public_WTT_Customer. Error messages: [$.assetId: null found, number expected] 2023-06-02 08:59:15 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):111 - thread status... heartbeat thread: false , replication thread: true 2023-06-02 08:59:15 INFO i.a.w.g.DefaultReplicationWorker(replicate):267 - Waiting for source and destination threads to complete. 2023-06-02 08:59:15 INFO i.a.w.g.DefaultReplicationWorker(replicate):272 - One of source or destination thread complete. Waiting on the other. 2023-06-02 08:59:16 destination > 2023-06-02 08:59:16 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2023-06-02 08:59:16 destination > 2023-06-02 08:59:16 INFO i.a.i.d.b.BufferedStreamConsumer(close):171 - executing on success close procedure. 2023-06-02 08:59:16 destination > 2023-06-02 08:59:16 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing WTT_CustomerAssetsReading: 286 records (113 KB) 2023-06-02 08:59:16 destination > 2023-06-02 08:59:16 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing WTT_Customer: 7 records (113 KB) 2023-06-02 08:59:16 destination > 2023-06-02 08:59:16 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing WTT_Asset: 2 records (113 KB) 2023-06-02 08:59:16 destination > 2023-06-02 08:59:16 INFO i.a.i.d.j.SqlOperations(onDestinationCloseOperations):138 - No onDestinationCloseOperations required for this destination. 2023-06-02 08:59:16 destination > 2023-06-02 08:59:16 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):163 - Finalizing tables in destination started for 3 streams 2023-06-02 08:59:16 destination > 2023-06-02 08:59:16 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream WTT_CustomerAssetsReading. schema airbytepoc, tmp table _airbyte_tmp_owe_wtt_customerassetsreading, final table _airbyte_raw_wtt_customerassetsreading 2023-06-02 08:59:16 destination > 2023-06-02 08:59:16 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream WTT_Customer. schema airbytepoc, tmp table _airbyte_tmp_ewm_wtt_customer, final table _airbyte_raw_wtt_customer 2023-06-02 08:59:16 destination > 2023-06-02 08:59:16 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream WTT_Asset. schema airbytepoc, tmp table _airbyte_tmp_byt_wtt_asset, final table _airbyte_raw_wtt_asset 2023-06-02 08:59:17 destination > 2023-06-02 08:59:16 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - Executing finalization of tables. 2023-06-02 08:59:17 destination > 2023-06-02 08:59:17 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):183 - Finalizing tables in destination completed. 2023-06-02 08:59:17 destination > 2023-06-02 08:59:17 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):186 - Cleaning tmp tables in destination started for 3 streams 2023-06-02 08:59:17 destination > 2023-06-02 08:59:17 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream WTT_CustomerAssetsReading. schema airbytepoc, tmp table name: _airbyte_tmp_owe_wtt_customerassetsreading 2023-06-02 08:59:17 destination > 2023-06-02 08:59:17 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream WTT_Customer. schema airbytepoc, tmp table name: _airbyte_tmp_ewm_wtt_customer 2023-06-02 08:59:17 destination > 2023-06-02 08:59:17 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream WTT_Asset. schema airbytepoc, tmp table name: _airbyte_tmp_byt_wtt_asset 2023-06-02 08:59:17 destination > 2023-06-02 08:59:17 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):195 - Cleaning tmp tables in destination completed. 2023-06-02 08:59:17 destination > 2023-06-02 08:59:17 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2023-06-02 08:59:17 destination > 2023-06-02 08:59:17 INFO i.a.i.d.m.MySQLDestination(main):138 - completed destination: class io.airbyte.integrations.destination.mysql.MySQLDestination 2023-06-02 08:59:18 INFO i.a.w.g.DefaultReplicationWorker(replicate):274 - Source and destination threads complete. 2023-06-02 08:59:18 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):569 - sync summary: { "status" : "completed", "recordsSynced" : 295, "bytesSynced" : 29038, "startTime" : 1685696344937, "endTime" : 1685696358244, "totalStats" : { "bytesCommitted" : 29038, "bytesEmitted" : 29038, "destinationStateMessagesEmitted" : 0, "destinationWriteEndTime" : 1685696358235, "destinationWriteStartTime" : 1685696345113, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0, "recordsEmitted" : 295, "recordsCommitted" : 295, "replicationEndTime" : 1685696358244, "replicationStartTime" : 1685696344937, "sourceReadEndTime" : 1685696355913, "sourceReadStartTime" : 1685696345019, "sourceStateMessagesEmitted" : 0 }, "streamStats" : [ { "streamName" : "WTT_CustomerAssetsReading", "stats" : { "bytesCommitted" : 27240, "bytesEmitted" : 27240, "recordsEmitted" : 286, "recordsCommitted" : 286 } }, { "streamName" : "WTT_Customer", "stats" : { "bytesCommitted" : 1436, "bytesEmitted" : 1436, "recordsEmitted" : 7, "recordsCommitted" : 7 } }, { "streamName" : "WTT_Asset", "stats" : { "bytesCommitted" : 362, "bytesEmitted" : 362, "recordsEmitted" : 2, "recordsCommitted" : 2 } }, { "streamName" : "WTT_CustomerAssetsReading", "streamNamespace" : "public", "stats" : { "bytesCommitted" : 0, "bytesEmitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0 } }, { "streamName" : "WTT_Asset", "streamNamespace" : "public", "stats" : { "bytesCommitted" : 0, "bytesEmitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0 } }, { "streamName" : "WTT_Customer", "streamNamespace" : "public", "stats" : { "bytesCommitted" : 0, "bytesEmitted" : 0, "recordsEmitted" : 0, "recordsCommitted" : 0 } } ] } 2023-06-02 08:59:18 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):570 - failures: [ ] 2023-06-02 08:59:18 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 08:59:18 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:59:18 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END REPLICATION ----- 2023-06-02 08:59:18 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:59:18 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):157 - sync summary: io.airbyte.config.StandardSyncOutput@f75b938[standardSyncSummary=io.airbyte.config.StandardSyncSummary@4638ca52[status=completed,recordsSynced=295,bytesSynced=29038,startTime=1685696344937,endTime=1685696358244,totalStats=io.airbyte.config.SyncStats@6afaf98c[bytesCommitted=29038,bytesEmitted=29038,destinationStateMessagesEmitted=0,destinationWriteEndTime=1685696358235,destinationWriteStartTime=1685696345113,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,recordsEmitted=295,recordsCommitted=295,replicationEndTime=1685696358244,replicationStartTime=1685696344937,sourceReadEndTime=1685696355913,sourceReadStartTime=1685696345019,sourceStateMessagesEmitted=0,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@2b067f89[streamName=WTT_CustomerAssetsReading,streamNamespace=,stats=io.airbyte.config.SyncStats@918afa8[bytesCommitted=27240,bytesEmitted=27240,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=286,recordsCommitted=286,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@9729e83[streamName=WTT_Customer,streamNamespace=,stats=io.airbyte.config.SyncStats@347930b8[bytesCommitted=1436,bytesEmitted=1436,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=7,recordsCommitted=7,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@2c1bfb89[streamName=WTT_Asset,streamNamespace=,stats=io.airbyte.config.SyncStats@60b2644d[bytesCommitted=362,bytesEmitted=362,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=2,recordsCommitted=2,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@7da9685e[streamName=WTT_CustomerAssetsReading,streamNamespace=public,stats=io.airbyte.config.SyncStats@a87ba3[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=0,recordsCommitted=0,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@731c0f8c[streamName=WTT_Asset,streamNamespace=public,stats=io.airbyte.config.SyncStats@7f9dae[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=0,recordsCommitted=0,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}], io.airbyte.config.StreamSyncStats@3622fe67[streamName=WTT_Customer,streamNamespace=public,stats=io.airbyte.config.SyncStats@7514ee63[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=0,recordsCommitted=0,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}]],additionalProperties={}],normalizationSummary=,webhookOperationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@66e7ef22[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@1a098cbd[stream=io.airbyte.protocol.models.AirbyteStream@3bf9885d[name=WTT_CustomerAssetsReading,jsonSchema={"type":"object","properties":{"Value":{"airbyte_type":"integer","type":"number"},"id":{"airbyte_type":"integer","type":"number"},"sort":{"airbyte_type":"integer","type":"number"},"ReadingDateTime":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"AssetId":{"airbyte_type":"integer","type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@694c0eb7[stream=io.airbyte.protocol.models.AirbyteStream@300b6243[name=WTT_Customer,jsonSchema={"type":"object","properties":{"createdAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"Description":{"type":"string"},"assetId":{"airbyte_type":"integer","type":"number"},"IsActive":{"type":"boolean"},"name":{"type":"string"},"id":{"airbyte_type":"integer","type":"number"},"sort":{"airbyte_type":"integer","type":"number"},"updatedById":{"airbyte_type":"integer","type":"number"},"createdById":{"airbyte_type":"integer","type":"number"},"updatedAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@66b17c9b[stream=io.airbyte.protocol.models.AirbyteStream@117dab70[name=WTT_Asset,jsonSchema={"type":"object","properties":{"createdAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"id":{"airbyte_type":"integer","type":"number"},"sort":{"airbyte_type":"integer","type":"number"},"updatedById":{"airbyte_type":"integer","type":"number"},"Code":{"type":"string"},"createdById":{"airbyte_type":"integer","type":"number"},"Name":{"type":"string"},"updatedAt":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[],commitStateAsap=true,additionalProperties={}] 2023-06-02 08:59:18 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):162 - Sync summary length: 8376 2023-06-02 08:59:18 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-06-02 08:59:18 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):134 - Using protocol v1 2023-06-02 08:59:18 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):145 - Using normalization: airbyte/normalization-mysql:0.3.0 2023-06-02 08:59:18 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/10/2/logs.log 2023-06-02 08:59:18 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 08:59:18 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 08:59:18 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:59:18 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START DEFAULT NORMALIZATION ----- 2023-06-02 08:59:18 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):129 - Running with normalization version: airbyte/normalization-mysql:0.3.0 2023-06-02 08:59:18 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:59:18 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/normalization-mysql:0.3.0 exists... 2023-06-02 08:59:18 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/normalization-mysql:0.3.0 was found locally. 2023-06-02 08:59:18 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = normalization-mysql-normalize-10-2-lrgzx with resources io.airbyte.config.ResourceRequirements@18d7b93a[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 08:59:18 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/2/normalize --log-driver none --name normalization-mysql-normalize-10-2-lrgzx --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.44.3 airbyte/normalization-mysql:0.3.0 run --integration-type mysql --config destination_config.json --catalog destination_catalog.json 2023-06-02 08:59:19 normalization > Running: transform-config --config destination_config.json --integration-type mysql --out /data/10/2/normalize 2023-06-02 08:59:20 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/10/2/normalize') 2023-06-02 08:59:20 normalization > transform_mysql 2023-06-02 08:59:20 normalization > Running: transform-catalog --integration-type mysql --profile-config-dir /data/10/2/normalize --catalog destination_catalog.json --out /data/10/2/normalize/models/generated/ --json-column _airbyte_data 2023-06-02 08:59:21 normalization > Processing destination_catalog.json... 2023-06-02 08:59:21 normalization > Generating airbyte_ctes/airbytepoc/wtt_customerassetsreading_ab1.sql from WTT_CustomerAssetsReading 2023-06-02 08:59:21 normalization > Generating airbyte_ctes/airbytepoc/wtt_customerassetsreading_ab2.sql from WTT_CustomerAssetsReading 2023-06-02 08:59:21 normalization > Generating airbyte_ctes/airbytepoc/wtt_customerassetsreading_ab3.sql from WTT_CustomerAssetsReading 2023-06-02 08:59:21 normalization > Adding drop table hook for wtt_customerassetsreading_scd to wtt_customerassetsreading 2023-06-02 08:59:21 normalization > Generating airbyte_tables/airbytepoc/wtt_customerassetsreading.sql from WTT_CustomerAssetsReading 2023-06-02 08:59:21 normalization > Generating airbyte_ctes/airbytepoc/wtt_customer_ab1.sql from WTT_Customer 2023-06-02 08:59:21 normalization > Generating airbyte_ctes/airbytepoc/wtt_customer_ab2.sql from WTT_Customer 2023-06-02 08:59:21 normalization > Generating airbyte_ctes/airbytepoc/wtt_customer_ab3.sql from WTT_Customer 2023-06-02 08:59:21 normalization > Adding drop table hook for wtt_customer_scd to wtt_customer 2023-06-02 08:59:21 normalization > Generating airbyte_tables/airbytepoc/wtt_customer.sql from WTT_Customer 2023-06-02 08:59:21 normalization > Generating airbyte_ctes/airbytepoc/wtt_asset_ab1.sql from WTT_Asset 2023-06-02 08:59:21 normalization > Generating airbyte_ctes/airbytepoc/wtt_asset_ab2.sql from WTT_Asset 2023-06-02 08:59:21 normalization > Generating airbyte_ctes/airbytepoc/wtt_asset_ab3.sql from WTT_Asset 2023-06-02 08:59:21 normalization > Adding drop table hook for wtt_asset_scd to wtt_asset 2023-06-02 08:59:21 normalization > Generating airbyte_tables/airbytepoc/wtt_asset.sql from WTT_Asset 2023-06-02 08:59:21 normalization > detected no config file for ssh, assuming ssh is off. 2023-06-02 08:59:28 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2023-06-02 08:59:28 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2023-06-02 08:59:28 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-06-02 08:59:28 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2023-06-02 08:59:28 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-06-02 08:59:33 normalization > Running with dbt=1.0.0 2023-06-02 08:59:33 normalization > Partial parse save file not found. Starting full parse. 2023-06-02 08:59:36 normalization > [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. There are 2 unused configuration paths: - models.airbyte_utils.generated.airbyte_incremental - models.airbyte_utils.generated.airbyte_views 2023-06-02 08:59:36 normalization > Found 12 models, 0 tests, 0 snapshots, 0 analyses, 591 macros, 0 operations, 0 seed files, 3 sources, 0 exposures, 0 metrics 2023-06-02 08:59:36 normalization > Concurrency: 1 threads (target='prod') 2023-06-02 08:59:37 normalization > 1 of 3 START table model airbytepoc.wtt_asset........................................................................... [RUN] 2023-06-02 08:59:37 normalization > 1 of 3 OK created table model airbytepoc.wtt_asset...................................................................... [SUCCESS 2 in 0.27s] 2023-06-02 08:59:37 normalization > 2 of 3 START table model airbytepoc.wtt_customer........................................................................ [RUN] 2023-06-02 08:59:37 normalization > 2 of 3 OK created table model airbytepoc.wtt_customer................................................................... [SUCCESS 7 in 0.18s] 2023-06-02 08:59:37 normalization > 3 of 3 START table model airbytepoc.wtt_customerassetsreading........................................................... [RUN] 2023-06-02 08:59:37 normalization > 3 of 3 OK created table model airbytepoc.wtt_customerassetsreading...................................................... [SUCCESS 286 in 0.22s] 2023-06-02 08:59:37 normalization > Finished running 3 table models in 1.11s. 2023-06-02 08:59:37 normalization > Completed successfully 2023-06-02 08:59:37 normalization > Done. PASS=3 WARN=0 ERROR=0 SKIP=0 TOTAL=3 2023-06-02 08:59:38 INFO i.a.w.n.DefaultNormalizationRunner(close):194 - Terminating normalization process... 2023-06-02 08:59:38 INFO i.a.w.n.DefaultNormalizationRunner(close):207 - Normalization process successfully terminated. 2023-06-02 08:59:38 INFO i.a.w.g.DefaultNormalizationWorker(run):97 - Normalization executed in 19 seconds for job 10. 2023-06-02 08:59:38 INFO i.a.w.g.DefaultNormalizationWorker(run):109 - Normalization summary: io.airbyte.config.NormalizationSummary@2778e1e6[startTime=1685696358692,endTime=1685696378161,failures=[],additionalProperties={}] 2023-06-02 08:59:38 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:59:38 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 08:59:38 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END DEFAULT NORMALIZATION ----- 2023-06-02 08:59:38 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:59:38 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-06-02 08:59:38 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/10/2/logs.log 2023-06-02 08:59:38 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.3 2023-06-02 08:59:38 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-06-02 08:59:38 INFO i.a.w.g.DbtTransformationWorker(run):61 - Running dbt transformation. 2023-06-02 08:59:38 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:59:38 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):129 - Running with normalization version: airbyte/normalization-mysql:0.3.0 2023-06-02 08:59:38 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START DBT TRANSFORMATION ----- 2023-06-02 08:59:38 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-06-02 08:59:38 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/normalization-mysql:0.3.0 exists... 2023-06-02 08:59:38 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/normalization-mysql:0.3.0 was found locally. 2023-06-02 08:59:38 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = normalization-mysql-normalize-10-2-nxmqf with resources io.airbyte.config.ResourceRequirements@7ac069d6[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 08:59:38 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/2/transform --log-driver none --name normalization-mysql-normalize-10-2-nxmqf --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.44.3 airbyte/normalization-mysql:0.3.0 configure-dbt --integration-type mysql --config destination_config.json --git-repo https://github.com/ranjit-battewad/dbtdemo.git 2023-06-02 08:59:38 normalization > Running: git clone --depth 5 --single-branch $GIT_REPO git_repo 2023-06-02 08:59:39 normalization > Last 5 commits in git_repo: 2023-06-02 08:59:39 normalization > a939c94 Create a dbt project 2023-06-02 08:59:39 normalization > /data/10/2/transform 2023-06-02 08:59:39 normalization > Running: transform-config --config destination_config.json --integration-type mysql --out /data/10/2/transform 2023-06-02 08:59:40 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/10/2/transform') 2023-06-02 08:59:40 normalization > transform_mysql 2023-06-02 08:59:40 normalization > Cloning into 'git_repo'... 2023-06-02 08:59:40 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if fishtownanalytics/dbt:1.0.0 exists... 2023-06-02 08:59:40 INFO i.a.c.i.LineGobbler(voidCall):149 - fishtownanalytics/dbt:1.0.0 was found locally. 2023-06-02 08:59:40 INFO i.a.w.p.DockerProcessFactory(create):136 - Creating docker container = dbt-custom-10-2-wonoe with resources io.airbyte.config.ResourceRequirements@7ac069d6[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-06-02 08:59:40 INFO i.a.w.p.DockerProcessFactory(create):188 - Preparing command: docker run --rm --init -i -w /data/10/2/transform --log-driver none --name dbt-custom-10-2-wonoe --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.44.3 --entrypoint /bin/bash fishtownanalytics/dbt:1.0.0 entrypoint.sh run 2023-06-02 08:59:41 dbt > Running from /data/10/2/transform/git_repo 2023-06-02 08:59:41 dbt > detected no config file for ssh, assuming ssh is off. 2023-06-02 08:59:41 dbt > Running: dbt run --profiles-dir=/data/10/2/transform --project-dir=/data/10/2/transform/git_repo 2023-06-02 08:59:46 dbt > 08:59:46 Error importing adapter: No module named 'dbt.adapters.mysql' 2023-06-02 08:59:46 dbt > 08:59:46 Encountered an error while reading profiles: 2023-06-02 08:59:46 dbt > 08:59:46 ERROR: Runtime Error 2023-06-02 08:59:46 dbt > Credentials in profile "normalize", target "prod" invalid: Runtime Error 2023-06-02 08:59:46 dbt > Could not find adapter type mysql! 2023-06-02 08:59:46 dbt > 08:59:46 Defined profiles: 2023-06-02 08:59:46 dbt > 08:59:46 - normalize 2023-06-02 08:59:46 dbt > 08:59:46 2023-06-02 08:59:46 dbt > For more information on configuring profiles, please consult the dbt docs: 2023-06-02 08:59:46 dbt > 2023-06-02 08:59:46 dbt > https://docs.getdbt.com/docs/configure-your-profile 2023-06-02 08:59:46 dbt > 2023-06-02 08:59:46 dbt > 08:59:46 Encountered an error: 2023-06-02 08:59:46 dbt > Runtime Error 2023-06-02 08:59:46 dbt > Could not run dbt 2023-06-02 08:59:46 INFO i.a.w.n.DefaultNormalizationRunner(close):194 - Terminating normalization process... 2023-06-02 08:59:46 INFO i.a.w.n.DefaultNormalizationRunner(close):207 - Normalization process successfully terminated. 2023-06-02 08:59:46 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$5):198 - Completing future exceptionally... io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:75) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Caused by: io.airbyte.workers.exception.WorkerException: DBT Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:71) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] ... 3 more Suppressed: io.airbyte.workers.exception.WorkerException: Dbt transformation process wasn't successful at io.airbyte.workers.general.DbtTransformationRunner.close(DbtTransformationRunner.java:156) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:60) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] 2023-06-02 08:59:46 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-06-02 08:59:46 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-06-02 08:59:46 WARN i.t.i.a.ActivityTaskExecutors$BaseActivityTaskExecutor(execute):114 - Activity failure. ActivityId=8ba5e682-5b18-3d15-9110-8d4cacd5cc20, activityType=Run, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:305) ~[io.airbyte-airbyte-commons-temporal-0.44.3.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.run(DbtTransformationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?] at io.temporal.internal.activity.RootActivityInboundCallsInterceptor$POJOActivityInboundCallsInterceptor.executeActivity(RootActivityInboundCallsInterceptor.java:64) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.RootActivityInboundCallsInterceptor.execute(RootActivityInboundCallsInterceptor.java:43) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.ActivityTaskExecutors$BaseActivityTaskExecutor.execute(ActivityTaskExecutors.java:95) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.ActivityTaskHandlerImpl.handle(ActivityTaskHandlerImpl.java:92) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handleActivity(ActivityWorker.java:241) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:206) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:179) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.17.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:57) ~[temporal-serviceclient-1.17.0.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:461) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:52) ~[temporal-sdk-1.17.0.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:167) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.lambda$run$3(DbtTransformationActivityImpl.java:134) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:300) ~[io.airbyte-airbyte-commons-temporal-0.44.3.jar:?] ... 14 more Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.lambda$run$3(DbtTransformationActivityImpl.java:134) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:300) ~[io.airbyte-airbyte-commons-temporal-0.44.3.jar:?] ... 14 more Caused by: io.airbyte.workers.exception.WorkerException: Dbt Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:75) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: DBT Transformation Failed. at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:71) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] ... 1 more Suppressed: io.airbyte.workers.exception.WorkerException: Dbt transformation process wasn't successful at io.airbyte.workers.general.DbtTransformationRunner.close(DbtTransformationRunner.java:156) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:60) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.general.DbtTransformationWorker.run(DbtTransformationWorker.java:29) ~[io.airbyte-airbyte-commons-worker-0.44.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.44.3.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] 2023-06-02 08:59:47 INFO i.a.c.f.EnvVariableFeatureFlags(autoDisablesFailingConnections):36 - Auto Disable Failing Connections: false