2022-06-01 05:03:06 INFO i.a.w.w.WorkerRun(call):49 - Executing worker wrapper. Airbyte version: 0.36.0-alpha 2022-06-01 05:03:06 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/45266/0/logs.log 2022-06-01 05:03:06 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.36.0-alpha 2022-06-01 05:03:06 INFO i.a.w.DefaultReplicationWorker(run):104 - start sync worker. job id: 45266 attempt id: 0 2022-06-01 05:03:06 INFO i.a.w.DefaultReplicationWorker(run):116 - configured sync modes: {public.backend_location=full_refresh - overwrite} 2022-06-01 05:03:06 INFO i.a.w.p.a.DefaultAirbyteDestination(start):69 - Running destination... 2022-06-01 05:03:06 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-clickhouse:0.1.6 exists... 2022-06-01 05:03:06 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-clickhouse:0.1.6 was found locally. 2022-06-01 05:03:06 INFO i.a.w.p.DockerProcessFactory(create):106 - Creating docker job ID: 45266 2022-06-01 05:03:06 INFO i.a.w.p.DockerProcessFactory(create):158 - Preparing command: docker run --rm --init -i -w /data/45266/0 --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-clickhouse:0.1.6 -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.36.0-alpha -e WORKER_JOB_ID=45266 airbyte/destination-clickhouse:0.1.6 write --config destination_config.json --catalog destination_catalog.json 2022-06-01 05:03:07 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-postgres:0.4.18 exists... 2022-06-01 05:03:07 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-postgres:0.4.18 was found locally. 2022-06-01 05:03:07 INFO i.a.w.p.DockerProcessFactory(create):106 - Creating docker job ID: 45266 2022-06-01 05:03:07 INFO i.a.w.p.DockerProcessFactory(create):158 - Preparing command: docker run --rm --init -i -w /data/45266/0 --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:0.4.18 -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.36.0-alpha -e WORKER_JOB_ID=45266 airbyte/source-postgres:0.4.18 read --config source_config.json --catalog source_catalog.json --state input_state.json 2022-06-01 05:03:07 INFO i.a.w.DefaultReplicationWorker(run):158 - Waiting for source and destination threads to complete. 2022-06-01 05:03:07 INFO i.a.w.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$6):339 - Destination output thread started. 2022-06-01 05:03:07 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):279 - Replication thread started. 2022-06-01 05:03:07 source > SLF4J: Class path contains multiple SLF4J bindings. 2022-06-01 05:03:07 source > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-01 05:03:07 source > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-01 05:03:07 source > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-06-01 05:03:07 source > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-06-01 05:03:08 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-06-01 05:03:08 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-01 05:03:08 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-01 05:03:08 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-06-01 05:03:08 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-06-01 05:03:08 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-06-01 05:03:08 source > 2022-06-01 05:03:08 INFO i.a.i.s.p.PostgresSource(main):409 - starting source: class io.airbyte.integrations.source.postgres.PostgresSource 2022-06-01 05:03:09 source > 2022-06-01 05:03:09 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {read=null, catalog=source_catalog.json, state=input_state.json, config=source_config.json} 2022-06-01 05:03:09 source > 2022-06-01 05:03:09 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2022-06-01 05:03:09 source > 2022-06-01 05:03:09 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: READ 2022-06-01 05:03:09 source > 2022-06-01 05:03:09 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='input_state.json'} 2022-06-01 05:03:09 source > 2022-06-01 05:03:09 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-01 05:03:09 source > 2022-06-01 05:03:09 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-01 05:03:09 source > 2022-06-01 05:03:09 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-01 05:03:09 source > 2022-06-01 05:03:09 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-01 05:03:09 source > 2022-06-01 05:03:09 ERROR i.a.i.b.AirbyteExceptionHandler(uncaughtException):26 - Something went wrong in the connector. See the logs for more details. 2022-06-01 05:03:09 source > java.lang.Exception: Verification error(s) occurred for READ. Errors: [$.password: object found, string expected] 2022-06-01 05:03:09 source > at io.airbyte.integrations.base.IntegrationRunner.validateConfig(IntegrationRunner.java:282) ~[io.airbyte.airbyte-integrations.bases-base-java-0.39.5-alpha.jar:?] 2022-06-01 05:03:09 source > at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:152) ~[io.airbyte.airbyte-integrations.bases-base-java-0.39.5-alpha.jar:?] 2022-06-01 05:03:09 source > at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:107) ~[io.airbyte.airbyte-integrations.bases-base-java-0.39.5-alpha.jar:?] 2022-06-01 05:03:09 destination > 2022-06-01 05:03:09 INFO i.a.i.d.c.ClickhouseDestination(main):107 - starting destination: class io.airbyte.integrations.destination.clickhouse.ClickhouseDestination 2022-06-01 05:03:09 source > at io.airbyte.integrations.source.postgres.PostgresSource.main(PostgresSource.java:410) ~[io.airbyte.airbyte-integrations.connectors-source-postgres-0.39.5-alpha.jar:?] 2022-06-01 05:03:09 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. errors: $.type: does not have a value in the enumeration [RECORD, STATE, LOG, SPEC, CONNECTION_STATUS, CATALOG] 2022-06-01 05:03:09 ERROR i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: {"type":"TRACE","trace":{"type":"ERROR","emitted_at":1.65405978939E12,"error":{"message":"Something went wrong in the connector. See the logs for more details.","internal_message":"java.lang.Exception: Verification error(s) occurred for READ. Errors: [$.password: object found, string expected] ","stack_trace":"[io.airbyte.integrations.base.IntegrationRunner.validateConfig(IntegrationRunner.java:282), io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:152), io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:107), io.airbyte.integrations.source.postgres.PostgresSource.main(PostgresSource.java:410)]","failure_type":"system_error"}}} 2022-06-01 05:03:09 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):305 - Total records read: 0 (0 bytes) 2022-06-01 05:03:09 destination > 2022-06-01 05:03:09 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-06-01 05:03:09 destination > 2022-06-01 05:03:09 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2022-06-01 05:03:09 destination > 2022-06-01 05:03:09 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE 2022-06-01 05:03:09 destination > 2022-06-01 05:03:09 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-06-01 05:03:09 destination > 2022-06-01 05:03:09 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-01 05:03:09 destination > 2022-06-01 05:03:09 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-01 05:03:09 destination > 2022-06-01 05:03:09 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-01 05:03:09 destination > 2022-06-01 05:03:09 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-06-01 05:03:09 destination > 2022-06-01 05:03:09 ERROR i.a.i.b.AirbyteExceptionHandler(uncaughtException):26 - Something went wrong in the connector. See the logs for more details. 2022-06-01 05:03:09 destination > java.lang.Exception: Verification error(s) occurred for WRITE. Errors: [$.password: object found, string expected] 2022-06-01 05:03:09 destination > at io.airbyte.integrations.base.IntegrationRunner.validateConfig(IntegrationRunner.java:282) ~[io.airbyte.airbyte-integrations.bases-base-java-0.38.4-alpha.jar:?] 2022-06-01 05:03:09 destination > at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:162) ~[io.airbyte.airbyte-integrations.bases-base-java-0.38.4-alpha.jar:?] 2022-06-01 05:03:09 destination > at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:107) ~[io.airbyte.airbyte-integrations.bases-base-java-0.38.4-alpha.jar:?] 2022-06-01 05:03:09 destination > at io.airbyte.integrations.destination.clickhouse.ClickhouseDestination.main(ClickhouseDestination.java:108) ~[io.airbyte.airbyte-integrations.connectors-destination-clickhouse-0.38.4-alpha.jar:?] 2022-06-01 05:03:09 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. errors: $.type: does not have a value in the enumeration [RECORD, STATE, LOG, SPEC, CONNECTION_STATUS, CATALOG] 2022-06-01 05:03:09 ERROR i.a.w.p.a.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: {"type":"TRACE","trace":{"type":"ERROR","emitted_at":1.654059789776E12,"error":{"message":"Something went wrong in the connector. See the logs for more details.","internal_message":"java.lang.Exception: Verification error(s) occurred for WRITE. Errors: [$.password: object found, string expected] ","stack_trace":"[io.airbyte.integrations.base.IntegrationRunner.validateConfig(IntegrationRunner.java:282), io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:162), io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:107), io.airbyte.integrations.destination.clickhouse.ClickhouseDestination.main(ClickhouseDestination.java:108)]","failure_type":"system_error"}}} 2022-06-01 05:03:09 ERROR i.a.w.DefaultReplicationWorker(run):169 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1 at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:162) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:57) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Suppressed: io.airbyte.workers.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.protocols.airbyte.DefaultAirbyteSource.close(DefaultAirbyteSource.java:136) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:126) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:57) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Suppressed: io.airbyte.workers.WorkerException: Destination process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.protocols.airbyte.DefaultAirbyteDestination.close(DefaultAirbyteDestination.java:119) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:126) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:57) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1 at io.airbyte.workers.DefaultReplicationWorker.lambda$getReplicationRunnable$5(DefaultReplicationWorker.java:312) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] ... 1 more 2022-06-01 05:03:09 INFO i.a.w.DefaultReplicationWorker(run):228 - sync summary: io.airbyte.config.ReplicationAttemptSummary@25bbe83f[status=failed,recordsSynced=0,bytesSynced=0,startTime=1654059786941,endTime=1654059789900,totalStats=io.airbyte.config.SyncStats@12e512ac[recordsEmitted=0,bytesEmitted=0,stateMessagesEmitted=0,recordsCommitted=0],streamStats=[]] 2022-06-01 05:03:09 INFO i.a.w.DefaultReplicationWorker(run):250 - Source did not output any state messages 2022-06-01 05:03:09 WARN i.a.w.DefaultReplicationWorker(run):258 - State capture: No new state, falling back on input state: io.airbyte.config.State@3f88e663[state={}] 2022-06-01 05:03:09 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-06-01 05:03:09 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$1):147 - sync summary: io.airbyte.config.StandardSyncOutput@2ef11fe0[standardSyncSummary=io.airbyte.config.StandardSyncSummary@468e73f5[status=failed,recordsSynced=0,bytesSynced=0,startTime=1654059786941,endTime=1654059789900,totalStats=io.airbyte.config.SyncStats@12e512ac[recordsEmitted=0,bytesEmitted=0,stateMessagesEmitted=0,recordsCommitted=0],streamStats=[]],normalizationSummary=,state=io.airbyte.config.State@3f88e663[state={}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@7f0b3c5a[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@4e86f6e3[stream=io.airbyte.protocol.models.AirbyteStream@682efecc[name=click_house_test_table_deepakbackend_location,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"city":{"type":"string"},"state":{"type":"string"},"country":{"type":"string"},"continent":{"type":"string"},"sub_continent":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=public,additionalProperties={}],syncMode=full_refresh,cursorField=[id],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@5d8a39e7[failureOrigin=source,failureType=,internalMessage=io.airbyte.workers.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@7b4527e0[additionalProperties={attemptNumber=0, jobId=45266}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1 at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:833) Caused by: io.airbyte.workers.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1 at io.airbyte.workers.DefaultReplicationWorker.lambda$getReplicationRunnable$5(DefaultReplicationWorker.java:312) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more ,retryable=,timestamp=1654059789516], io.airbyte.config.FailureReason@28de785[failureOrigin=destination,failureType=,internalMessage=io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1,externalMessage=Something went wrong within the destination connector,metadata=io.airbyte.config.Metadata@1d4aa186[additionalProperties={attemptNumber=0, jobId=45266}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1 at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:833) Caused by: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1 at io.airbyte.workers.DefaultReplicationWorker.lambda$getDestinationOutputRunnable$6(DefaultReplicationWorker.java:354) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more ,retryable=,timestamp=1654059789898]]] 2022-06-01 05:03:09 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):235 - Stopping temporal heartbeating... 2022-06-01 05:03:09 INFO i.a.c.p.ConfigRepository(updateConnectionState):775 - Updating connection e1e39db9-31d0-4a08-a6eb-7b5c0362da24 state: io.airbyte.config.State@2ef7df11[state={}] 2022-06-01 05:03:10 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/45266/0/logs.log 2022-06-01 05:03:10 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.36.0-alpha 2022-06-01 05:03:10 INFO i.a.w.DefaultNormalizationWorker(run):47 - Running normalization. 2022-06-01 05:03:10 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):122 - Running with normalization version: airbyte/normalization-clickhouse:0.1.75 2022-06-01 05:03:10 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/normalization-clickhouse:0.1.75 exists... 2022-06-01 05:03:10 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/normalization-clickhouse:0.1.75 was found locally. 2022-06-01 05:03:10 INFO i.a.w.p.DockerProcessFactory(create):106 - Creating docker job ID: 45266 2022-06-01 05:03:10 INFO i.a.w.p.DockerProcessFactory(create):158 - Preparing command: docker run --rm --init -i -w /data/45266/0/normalize --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.36.0-alpha airbyte/normalization-clickhouse:0.1.75 run --integration-type clickhouse --config destination_config.json --catalog destination_catalog.json 2022-06-01 05:03:10 normalization > Running: transform-config --config destination_config.json --integration-type clickhouse --out /data/45266/0/normalize 2022-06-01 05:03:10 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/45266/0/normalize') 2022-06-01 05:03:10 normalization > transform_clickhouse 2022-06-01 05:03:10 normalization > Running: transform-catalog --integration-type clickhouse --profile-config-dir /data/45266/0/normalize --catalog destination_catalog.json --out /data/45266/0/normalize/models/generated/ --json-column _airbyte_data 2022-06-01 05:03:10 normalization > Processing destination_catalog.json... 2022-06-01 05:03:10 normalization > Truncating click_house_test_table_deepakbackend_location (#45) to click_house_test_tab_eepakbackend_location (#43) 2022-06-01 05:03:10 normalization > Truncating click_house_test_table_deepakbackend_location (#45) to click_house_test_tab_eepakbackend_location (#43) 2022-06-01 05:03:10 normalization > Generating airbyte_ctes/public/click_house_test_tab__eepakbackend_location_ab1.sql from click_house_test_table_deepakbackend_location 2022-06-01 05:03:10 normalization > Truncating click_house_test_table_deepakbackend_location (#45) to click_house_test_tab_eepakbackend_location (#43) 2022-06-01 05:03:10 normalization > Generating airbyte_ctes/public/click_house_test_tab__eepakbackend_location_ab2.sql from click_house_test_table_deepakbackend_location 2022-06-01 05:03:10 normalization > Truncating click_house_test_table_deepakbackend_location (#45) to click_house_test_tab_eepakbackend_location (#43) 2022-06-01 05:03:10 normalization > Truncating _airbyte_click_house_test_tab__eepakbackend_location_hashid (#59) to _airbyte_click_house_ckend_location_hashid (#43) 2022-06-01 05:03:10 normalization > Truncating click_house_test_table_deepakbackend_location (#45) to click_house_test_tab_eepakbackend_location (#43) 2022-06-01 05:03:10 normalization > Generating airbyte_ctes/public/click_house_test_tab__eepakbackend_location_ab3.sql from click_house_test_table_deepakbackend_location 2022-06-01 05:03:10 normalization > Truncating click_house_test_table_deepakbackend_location (#45) to click_house_test_tab_eepakbackend_location (#43) 2022-06-01 05:03:10 normalization > Truncating _airbyte_click_house_test_tab__eepakbackend_location_hashid (#59) to _airbyte_click_house_ckend_location_hashid (#43) 2022-06-01 05:03:10 normalization > Truncating click_house_test_table_deepakbackend_location (#45) to click_house_test_tab_eepakbackend_location (#43) 2022-06-01 05:03:10 normalization > Generating airbyte_tables/public/click_house_test_tab__eepakbackend_location.sql from click_house_test_table_deepakbackend_location 2022-06-01 05:03:10 normalization > detected no config file for ssh, assuming ssh is off. 2022-06-01 05:03:13 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2022-06-01 05:03:13 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2022-06-01 05:03:13 normalization > 2022-06-01 05:03:13 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2022-06-01 05:03:13 normalization > 2022-06-01 05:03:16 normalization > 05:03:16 Encountered an error while reading profiles: 2022-06-01 05:03:16 normalization > 05:03:16 ERROR: Runtime Error 2022-06-01 05:03:16 normalization > Credentials in profile "normalize", target "prod" invalid: {'_secret': 'airbyte_workspace_83dd7449-5276-44f2-9039-3f8163e61e56_secret_58add163-f35e-4d66-ad48-656201ba7ff5_v1'} is not of type 'string' 2022-06-01 05:03:16 normalization > 05:03:16 Defined profiles: 2022-06-01 05:03:16 normalization > 05:03:16 - normalize 2022-06-01 05:03:16 normalization > 05:03:16 2022-06-01 05:03:16 normalization > For more information on configuring profiles, please consult the dbt docs: 2022-06-01 05:03:16 normalization > 2022-06-01 05:03:16 normalization > https://docs.getdbt.com/docs/configure-your-profile 2022-06-01 05:03:16 normalization > 2022-06-01 05:03:16 normalization > 05:03:16 Encountered an error: 2022-06-01 05:03:16 normalization > Runtime Error 2022-06-01 05:03:16 normalization > Could not run dbt 2022-06-01 05:03:17 normalization > 2022-06-01 05:03:17 normalization > Diagnosing dbt debug to check if destination is available for dbt and well configured (2): 2022-06-01 05:03:17 normalization > 2022-06-01 05:03:19 normalization > 05:03:19 Running with dbt=1.0.0 2022-06-01 05:03:19 normalization > dbt version: 1.0.0 2022-06-01 05:03:19 normalization > python version: 3.9.9 2022-06-01 05:03:19 normalization > python path: /usr/local/bin/python 2022-06-01 05:03:19 normalization > os info: Linux-5.4.0-113-generic-x86_64-with-glibc2.31 2022-06-01 05:03:19 normalization > Using profiles.yml file at /data/45266/0/normalize/profiles.yml 2022-06-01 05:03:19 normalization > Using dbt_project.yml file at /data/45266/0/normalize/dbt_project.yml 2022-06-01 05:03:19 normalization > 2022-06-01 05:03:20 normalization > Configuration: 2022-06-01 05:03:20 normalization > profiles.yml file [ERROR invalid] 2022-06-01 05:03:20 normalization > dbt_project.yml file [OK found and valid] 2022-06-01 05:03:20 normalization > 2022-06-01 05:03:20 normalization > Required dependencies: 2022-06-01 05:03:20 normalization > - git [OK found] 2022-06-01 05:03:20 normalization > 2022-06-01 05:03:20 normalization > 1 check failed: 2022-06-01 05:03:20 normalization > Profile loading failed for the following reason: 2022-06-01 05:03:20 normalization > Runtime Error 2022-06-01 05:03:20 normalization > Credentials in profile "normalize", target "prod" invalid: {'_secret': 'airbyte_workspace_83dd7449-5276-44f2-9039-3f8163e61e56_secret_58add163-f35e-4d66-ad48-656201ba7ff5_v1'} is not of type 'string' 2022-06-01 05:03:20 normalization > 2022-06-01 05:03:20 normalization > 2022-06-01 05:03:20 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):158 - Completing future exceptionally... io.airbyte.workers.WorkerException: Normalization Failed. at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:61) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:19) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.WorkerException: Normalization Failed. at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:58) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] ... 3 more Suppressed: io.airbyte.workers.WorkerException: Normalization process wasn't successful at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:160) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:46) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:19) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] 2022-06-01 05:03:20 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-06-01 05:03:20 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):235 - Stopping temporal heartbeating... 2022-06-01 05:03:20 WARN i.t.i.a.POJOActivityTaskHandler(activityFailureToResult):307 - Activity failure. ActivityId=2312c3a2-4bbb-31aa-980b-91f30a3f81d0, activityType=Normalize, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.WorkerException: Normalization Failed. at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:233) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.normalize(NormalizationActivityImpl.java:72) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.WorkerException: Normalization Failed. at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:56) ~[temporal-serviceclient-1.8.1.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:448) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:51) ~[temporal-sdk-1.8.1.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:135) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$1(NormalizationActivityImpl.java:98) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:228) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] ... 14 more Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.WorkerException: Normalization Failed. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:129) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$1(NormalizationActivityImpl.java:98) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:228) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] ... 14 more Caused by: io.airbyte.workers.WorkerException: Normalization Failed. at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:61) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:19) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] ... 1 more Caused by: io.airbyte.workers.WorkerException: Normalization Failed. at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:58) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:19) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] ... 1 more Suppressed: io.airbyte.workers.WorkerException: Normalization process wasn't successful at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:160) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:46) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:19) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.36.0-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?]