2022-08-25 09:44:54 INFO i.a.w.t.TemporalAttemptExecution(get):107 - Cloud storage job log path: /workspace/751/0/logs.log 2022-08-25 09:44:54 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.41-alpha 2022-08-25 09:45:13 replication-orchestrator > Writing async status INITIALIZING for KubePodInfo[namespace=default, name=orchestrator-repl-job-751-attempt-0]... 2022-08-25 09:44:54 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = source-s3-check-751-0-kbldx for airbyte/source-s3:0.1.17 2022-08-25 09:44:54 INFO i.a.w.p.KubeProcessFactory(create):103 - source-s3-check-751-0-kbldx stdoutLocalPort = 9034 2022-08-25 09:44:54 INFO i.a.w.p.KubeProcessFactory(create):106 - source-s3-check-751-0-kbldx stderrLocalPort = 9035 2022-08-25 09:44:54 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):587 - Creating stdout socket server... 2022-08-25 09:44:54 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):605 - Creating stderr socket server... 2022-08-25 09:44:54 INFO i.a.w.p.KubePodProcess():518 - Creating pod source-s3-check-751-0-kbldx... 2022-08-25 09:44:54 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):308 - Waiting for init container to be ready before copying files... 2022-08-25 09:44:54 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):312 - Init container present.. 2022-08-25 09:44:55 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):315 - Init container ready.. 2022-08-25 09:44:55 INFO i.a.w.p.KubePodProcess():549 - Copying files... 2022-08-25 09:44:55 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):257 - Uploading file: source_config.json 2022-08-25 09:44:55 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp /tmp/68a0a3c3-51fe-4fc7-b6f6-7028658572a3/source_config.json default/source-s3-check-751-0-kbldx:/config/source_config.json -c init 2022-08-25 09:44:55 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):268 - Waiting for kubectl cp to complete 2022-08-25 09:44:56 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):282 - kubectl cp complete, closing process 2022-08-25 09:44:56 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):257 - Uploading file: FINISHED_UPLOADING 2022-08-25 09:44:56 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp /tmp/20500233-17c7-402f-b928-2cd5e75d8ed5/FINISHED_UPLOADING default/source-s3-check-751-0-kbldx:/config/FINISHED_UPLOADING -c init 2022-08-25 09:44:56 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):268 - Waiting for kubectl cp to complete 2022-08-25 09:44:56 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):282 - kubectl cp complete, closing process 2022-08-25 09:44:56 INFO i.a.w.p.KubePodProcess():552 - Waiting until pod is ready... 2022-08-25 09:44:57 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):596 - Setting stdout... 2022-08-25 09:44:57 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):608 - Setting stderr... 2022-08-25 09:44:58 INFO i.a.w.p.KubePodProcess():568 - Reading pod IP... 2022-08-25 09:44:58 INFO i.a.w.p.KubePodProcess():570 - Pod IP: 192.168.82.211 2022-08-25 09:44:58 INFO i.a.w.p.KubePodProcess():577 - Using null stdin output stream... 2022-08-25 09:44:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):99 - initialised stream with format: 2022-08-25 09:44:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):99 - initialised stream with format: {'encoding': 'utf8', 'filetype': 'csv', 'delimiter': ',', 'block_size': 10000, 'quote_char': '"', 'escape_char': '\\', 'double_quote': True, 'infer_datatypes': True, 'advanced_options': '{}', 'newlines_in_values': True, 'additional_reader_options': '{}'} 2022-08-25 09:44:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):99 - Iterating S3 bucket 'kintaro-activepipe' 2022-08-25 09:44:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):99 - Check succeeded 2022-08-25 09:45:00 INFO i.a.w.p.KubePodProcess(close):717 - (pod: default / source-s3-check-751-0-kbldx) - Closed all resources for pod 2022-08-25 09:45:00 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-08-25 09:45:00 INFO i.a.w.t.TemporalAttemptExecution(get):107 - Cloud storage job log path: /workspace/751/0/logs.log 2022-08-25 09:45:00 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.41-alpha 2022-08-25 09:45:00 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = destination-postgres-check-751-0-fjmkv for airbyte/destination-postgres:0.3.21 2022-08-25 09:45:00 INFO i.a.w.p.KubeProcessFactory(create):103 - destination-postgres-check-751-0-fjmkv stdoutLocalPort = 9028 2022-08-25 09:45:00 INFO i.a.w.p.KubeProcessFactory(create):106 - destination-postgres-check-751-0-fjmkv stderrLocalPort = 9029 2022-08-25 09:45:00 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):587 - Creating stdout socket server... 2022-08-25 09:45:00 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):605 - Creating stderr socket server... 2022-08-25 09:45:00 INFO i.a.w.p.KubePodProcess():518 - Creating pod destination-postgres-check-751-0-fjmkv... 2022-08-25 09:45:00 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):308 - Waiting for init container to be ready before copying files... 2022-08-25 09:45:00 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):312 - Init container present.. 2022-08-25 09:45:01 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):315 - Init container ready.. 2022-08-25 09:45:01 INFO i.a.w.p.KubePodProcess():549 - Copying files... 2022-08-25 09:45:01 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):257 - Uploading file: source_config.json 2022-08-25 09:45:01 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp /tmp/a181d890-1e2e-4c21-b73b-cfbfcf547020/source_config.json default/destination-postgres-check-751-0-fjmkv:/config/source_config.json -c init 2022-08-25 09:45:01 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):268 - Waiting for kubectl cp to complete 2022-08-25 09:45:01 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):282 - kubectl cp complete, closing process 2022-08-25 09:45:01 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):257 - Uploading file: FINISHED_UPLOADING 2022-08-25 09:45:01 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp /tmp/ee3a2f77-12df-4963-b7a9-0e24a5dc4fe8/FINISHED_UPLOADING default/destination-postgres-check-751-0-fjmkv:/config/FINISHED_UPLOADING -c init 2022-08-25 09:45:01 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):268 - Waiting for kubectl cp to complete 2022-08-25 09:45:02 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):282 - kubectl cp complete, closing process 2022-08-25 09:45:02 INFO i.a.w.p.KubePodProcess():552 - Waiting until pod is ready... 2022-08-25 09:45:03 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):596 - Setting stdout... 2022-08-25 09:45:03 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):608 - Setting stderr... 2022-08-25 09:45:04 INFO i.a.w.p.KubePodProcess():568 - Reading pod IP... 2022-08-25 09:45:04 INFO i.a.w.p.KubePodProcess():570 - Pod IP: 192.168.66.166 2022-08-25 09:45:04 INFO i.a.w.p.KubePodProcess():577 - Using null stdin output stream... 2022-08-25 09:45:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:45:04 INFO i.a.i.d.p.PostgresDestination(main):90 - starting destination: class io.airbyte.integrations.destination.postgres.PostgresDestination 2022-08-25 09:45:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:45:04 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-08-25 09:45:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:45:04 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2022-08-25 09:45:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:45:04 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK 2022-08-25 09:45:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:45:04 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-08-25 09:45:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:45:04 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:45:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:45:04 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:45:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:45:04 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:45:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:45:04 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:45:04 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings. 2022-08-25 09:45:04 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:45:04 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:45:04 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:45:04 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:45:04 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-08-25 09:45:04 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-08-25 09:45:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:45:04 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2022-08-25 09:45:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:45:04 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2022-08-25 09:45:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:45:04 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2022-08-25 09:45:05 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:45:05 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated... 2022-08-25 09:45:05 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:45:05 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed. 2022-08-25 09:45:05 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:45:05 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2022-08-25 09:45:05 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:45:05 INFO i.a.i.d.p.PostgresDestination(main):92 - completed destination: class io.airbyte.integrations.destination.postgres.PostgresDestination 2022-08-25 09:45:05 INFO i.a.w.p.KubePodProcess(close):717 - (pod: default / destination-postgres-check-751-0-fjmkv) - Closed all resources for pod 2022-08-25 09:45:05 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-08-25 09:45:05 INFO i.a.w.t.TemporalAttemptExecution(get):107 - Cloud storage job log path: /workspace/751/0/logs.log 2022-08-25 09:45:05 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.41-alpha 2022-08-25 09:45:06 INFO i.a.w.t.s.LauncherWorker(lambda$run$3):142 - Creating orchestrator-repl-job-751-attempt-0 for attempt number: 0 2022-08-25 09:45:06 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):214 - Successfully deleted all running pods for the connection! 2022-08-25 09:45:06 INFO i.a.w.p.AsyncOrchestratorPodProcess(create):318 - Waiting for pod to be running... 2022-08-25 09:45:08 INFO i.a.w.p.AsyncOrchestratorPodProcess(create):341 - Pod default/orchestrator-repl-job-751-attempt-0 is running on 192.168.74.205 2022-08-25 09:45:08 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: envMap.json 2022-08-25 09:45:08 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/bab94a81-7ca7-4de1-9076-c1e7ddafae1c/envMap.json default/orchestrator-repl-job-751-attempt-0:/config/envMap.json -c main 2022-08-25 09:45:08 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:45:09 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:45:09 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: application.txt 2022-08-25 09:45:09 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/101a8f1a-91c5-4e2a-bbaa-7b8451c09005/application.txt default/orchestrator-repl-job-751-attempt-0:/config/application.txt -c main 2022-08-25 09:45:09 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:45:09 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:45:09 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: jobRunConfig.json 2022-08-25 09:45:09 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/61519073-8da2-4949-b2a7-efd142a4ea24/jobRunConfig.json default/orchestrator-repl-job-751-attempt-0:/config/jobRunConfig.json -c main 2022-08-25 09:45:09 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:45:09 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:45:09 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: destinationLauncherConfig.json 2022-08-25 09:45:09 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/0eef1c0b-4551-4605-aebb-5d899f05a050/destinationLauncherConfig.json default/orchestrator-repl-job-751-attempt-0:/config/destinationLauncherConfig.json -c main 2022-08-25 09:45:09 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:45:10 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:45:10 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: sourceLauncherConfig.json 2022-08-25 09:45:10 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/bc68f269-9db1-4f47-a4a9-3e0eac92908d/sourceLauncherConfig.json default/orchestrator-repl-job-751-attempt-0:/config/sourceLauncherConfig.json -c main 2022-08-25 09:45:10 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:45:10 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:45:10 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: input.json 2022-08-25 09:45:10 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/37dc2e19-cd64-4778-a043-f006bcadcf40/input.json default/orchestrator-repl-job-751-attempt-0:/config/input.json -c main 2022-08-25 09:45:10 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:45:10 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:45:10 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: KUBE_POD_INFO 2022-08-25 09:45:10 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/a4f0e7f6-05e9-4aaf-8836-a585ca1809d4/KUBE_POD_INFO default/orchestrator-repl-job-751-attempt-0:/config/KUBE_POD_INFO -c main 2022-08-25 09:45:10 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:45:11 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:45:11 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: FINISHED_UPLOADING 2022-08-25 09:45:11 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/4eb01c84-ecef-495d-8a05-5a2d35adf32f/FINISHED_UPLOADING default/orchestrator-repl-job-751-attempt-0:/config/FINISHED_UPLOADING -c main 2022-08-25 09:45:11 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:45:11 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:45:13 replication-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_CPU_REQUEST: 'null' 2022-08-25 09:45:13 replication-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_CPU_LIMIT: 'null' 2022-08-25 09:45:13 replication-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_REQUEST: 'null' 2022-08-25 09:45:13 replication-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_LIMIT: 'null' 2022-08-25 09:45:13 replication-orchestrator > Using default value for environment variable JOB_KUBE_TOLERATIONS: '' 2022-08-25 09:45:13 replication-orchestrator > Using default value for environment variable JOB_KUBE_NODE_SELECTORS: '' 2022-08-25 09:45:13 replication-orchestrator > Using default value for environment variable JOB_KUBE_ANNOTATIONS: '' 2022-08-25 09:45:13 replication-orchestrator > Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_SECRET: '' 2022-08-25 09:45:13 replication-orchestrator > Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-08-25 09:45:13 replication-orchestrator > Using default value for environment variable JOB_KUBE_SIDECAR_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-08-25 09:45:13 replication-orchestrator > Using default value for environment variable JOB_KUBE_SOCAT_IMAGE: 'alpine/socat:1.7.4.3-r0' 2022-08-25 09:45:13 replication-orchestrator > Using default value for environment variable JOB_KUBE_BUSYBOX_IMAGE: 'busybox:1.28' 2022-08-25 09:45:13 replication-orchestrator > Using default value for environment variable JOB_KUBE_CURL_IMAGE: 'curlimages/curl:7.83.1' 2022-08-25 09:45:13 replication-orchestrator > Using default value for environment variable DEPLOYMENT_MODE: 'OSS' 2022-08-25 09:45:14 replication-orchestrator > Using Kubernetes namespace: default 2022-08-25 09:45:14 replication-orchestrator > Logging initialized @6517ms to org.eclipse.jetty.util.log.Slf4jLog 2022-08-25 09:45:14 replication-orchestrator > jetty-9.4.31.v20200723; built: 2020-07-23T17:57:36.812Z; git: 450ba27947e13e66baa8cd1ce7e85a4461cacc1d; jvm 19-ea+32-2220 2022-08-25 09:45:14 replication-orchestrator > Started o.e.j.s.ServletContextHandler@6003ad65{/,null,AVAILABLE} 2022-08-25 09:45:14 replication-orchestrator > Started ServerConnector@2c829dbc{HTTP/1.1, (http/1.1)}{0.0.0.0:9000} 2022-08-25 09:45:14 replication-orchestrator > Started @6691ms 2022-08-25 09:45:14 replication-orchestrator > Writing async status RUNNING for KubePodInfo[namespace=default, name=orchestrator-repl-job-751-attempt-0]... 2022-08-25 09:45:14 replication-orchestrator > Setting up source launcher... 2022-08-25 09:45:14 replication-orchestrator > Setting up destination launcher... 2022-08-25 09:45:14 replication-orchestrator > Setting up source... 2022-08-25 09:45:14 replication-orchestrator > Setting up replication worker... 2022-08-25 09:45:14 replication-orchestrator > Running replication worker... 2022-08-25 09:45:14 replication-orchestrator > start sync worker. job id: 751 attempt id: 0 2022-08-25 09:45:14 replication-orchestrator > configured sync modes: {null.s3_user_reports=incremental - append} 2022-08-25 09:45:14 replication-orchestrator > Running destination... 2022-08-25 09:45:14 replication-orchestrator > Attempting to start pod = destination-postgres-write-751-0-tqzfy for airbyte/destination-postgres:0.3.21 2022-08-25 09:45:14 replication-orchestrator > destination-postgres-write-751-0-tqzfy stdoutLocalPort = 9879 2022-08-25 09:45:14 replication-orchestrator > destination-postgres-write-751-0-tqzfy stderrLocalPort = 9878 2022-08-25 09:45:14 replication-orchestrator > Creating stdout socket server... 2022-08-25 09:45:14 replication-orchestrator > Creating stderr socket server... 2022-08-25 09:45:14 replication-orchestrator > Creating pod destination-postgres-write-751-0-tqzfy... 2022-08-25 09:45:15 replication-orchestrator > Waiting for init container to be ready before copying files... 2022-08-25 09:45:15 replication-orchestrator > Init container present.. 2022-08-25 09:45:17 replication-orchestrator > Init container ready.. 2022-08-25 09:45:17 replication-orchestrator > Copying files... 2022-08-25 09:45:17 replication-orchestrator > Uploading file: destination_config.json 2022-08-25 09:45:17 replication-orchestrator > kubectl cp /tmp/21dac39d-b60f-4388-85b5-d4486105c339/destination_config.json default/destination-postgres-write-751-0-tqzfy:/config/destination_config.json -c init 2022-08-25 09:45:17 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:45:17 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:45:17 replication-orchestrator > Uploading file: destination_catalog.json 2022-08-25 09:45:17 replication-orchestrator > kubectl cp /tmp/a9505a32-6e45-43fd-a40b-028c849a6e00/destination_catalog.json default/destination-postgres-write-751-0-tqzfy:/config/destination_catalog.json -c init 2022-08-25 09:45:17 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:45:18 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:45:18 replication-orchestrator > Uploading file: FINISHED_UPLOADING 2022-08-25 09:45:18 replication-orchestrator > kubectl cp /tmp/f224de8a-3d3f-4e32-bb8c-3399970a9cc5/FINISHED_UPLOADING default/destination-postgres-write-751-0-tqzfy:/config/FINISHED_UPLOADING -c init 2022-08-25 09:45:18 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:45:18 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:45:18 replication-orchestrator > Waiting until pod is ready... 2022-08-25 09:45:20 replication-orchestrator > Setting stdout... 2022-08-25 09:45:20 replication-orchestrator > Setting stderr... 2022-08-25 09:45:21 replication-orchestrator > MetricClient has not been initialized. Must call MetricClientFactory.CreateMetricClient before using MetricClient. Using a dummy client for now. Ignore this if Airbyte is configured to not publish any metrics. 2022-08-25 09:45:21 replication-orchestrator > Reading pod IP... 2022-08-25 09:45:21 replication-orchestrator > Pod IP: 192.168.75.131 2022-08-25 09:45:21 replication-orchestrator > Creating stdin socket... 2022-08-25 09:45:21 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-08-25 09:45:21 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:45:21 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:45:21 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:45:21 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:45:21 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-08-25 09:45:21 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-08-25 09:45:21 replication-orchestrator > Attempting to start pod = source-s3-read-751-0-lefdz for airbyte/source-s3:0.1.17 2022-08-25 09:45:21 replication-orchestrator > source-s3-read-751-0-lefdz stdoutLocalPort = 9877 2022-08-25 09:45:21 replication-orchestrator > source-s3-read-751-0-lefdz stderrLocalPort = 9880 2022-08-25 09:45:21 replication-orchestrator > Creating stdout socket server... 2022-08-25 09:45:21 replication-orchestrator > Creating pod source-s3-read-751-0-lefdz... 2022-08-25 09:45:21 replication-orchestrator > Creating stderr socket server... 2022-08-25 09:45:22 replication-orchestrator > Waiting for init container to be ready before copying files... 2022-08-25 09:45:22 replication-orchestrator > Init container present.. 2022-08-25 09:45:23 replication-orchestrator > Init container ready.. 2022-08-25 09:45:23 replication-orchestrator > Copying files... 2022-08-25 09:45:23 replication-orchestrator > Uploading file: input_state.json 2022-08-25 09:45:23 replication-orchestrator > kubectl cp /tmp/901d45a6-548c-4955-8e57-da28dcfdc2e5/input_state.json default/source-s3-read-751-0-lefdz:/config/input_state.json -c init 2022-08-25 09:45:23 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:45:23 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:45:23 replication-orchestrator > Uploading file: source_config.json 2022-08-25 09:45:23 replication-orchestrator > kubectl cp /tmp/5c41486f-85d7-4e65-9164-01f7e9bf3ecd/source_config.json default/source-s3-read-751-0-lefdz:/config/source_config.json -c init 2022-08-25 09:45:23 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:45:23 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:45:23 replication-orchestrator > Uploading file: source_catalog.json 2022-08-25 09:45:23 replication-orchestrator > kubectl cp /tmp/f6fd8d00-8b0b-40ac-a835-231415e7b0c7/source_catalog.json default/source-s3-read-751-0-lefdz:/config/source_catalog.json -c init 2022-08-25 09:45:23 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:45:24 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:45:24 replication-orchestrator > Uploading file: FINISHED_UPLOADING 2022-08-25 09:45:24 replication-orchestrator > kubectl cp /tmp/19a4cb13-8cd9-4efe-82fb-2aec86f3c37f/FINISHED_UPLOADING default/source-s3-read-751-0-lefdz:/config/FINISHED_UPLOADING -c init 2022-08-25 09:45:24 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:45:24 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:45:24 replication-orchestrator > Waiting until pod is ready... 2022-08-25 09:45:25 replication-orchestrator > Setting stdout... 2022-08-25 09:45:25 replication-orchestrator > Setting stderr... 2022-08-25 09:45:26 replication-orchestrator > MetricClient has not been initialized. Must call MetricClientFactory.CreateMetricClient before using MetricClient. Using a dummy client for now. Ignore this if Airbyte is configured to not publish any metrics. 2022-08-25 09:45:26 replication-orchestrator > Reading pod IP... 2022-08-25 09:45:26 replication-orchestrator > Pod IP: 192.168.42.99 2022-08-25 09:45:26 replication-orchestrator > Using null stdin output stream... 2022-08-25 09:45:26 replication-orchestrator > Destination output thread started. 2022-08-25 09:45:26 replication-orchestrator > Replication thread started. 2022-08-25 09:45:26 replication-orchestrator > Waiting for source and destination threads to complete. 2022-08-25 09:45:26 destination > 2022-08-25 09:45:21 INFO i.a.i.d.p.PostgresDestination(main):90 - starting destination: class io.airbyte.integrations.destination.postgres.PostgresDestination 2022-08-25 09:45:26 destination > 2022-08-25 09:45:21 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-08-25 09:45:26 destination > 2022-08-25 09:45:21 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2022-08-25 09:45:26 destination > 2022-08-25 09:45:21 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE 2022-08-25 09:45:26 destination > 2022-08-25 09:45:21 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-08-25 09:45:26 destination > 2022-08-25 09:45:22 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:45:26 destination > 2022-08-25 09:45:22 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:45:26 destination > 2022-08-25 09:45:22 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:45:26 destination > 2022-08-25 09:45:22 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:45:26 destination > 2022-08-25 09:45:22 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2022-08-25 09:45:26 destination > 2022-08-25 09:45:22 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2022-08-25 09:45:26 destination > 2022-08-25 09:45:22 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2022-08-25 09:45:26 destination > 2022-08-25 09:45:22 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):97 - Write config: WriteConfig{streamName=s3_user_reports, namespace=null, outputSchemaName=airbyte, tmpTableName=_airbyte_tmp_wih_s3_user_reports, outputTableName=_airbyte_raw_s3_user_reports, syncMode=append} 2022-08-25 09:45:26 destination > 2022-08-25 09:45:22 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2022-08-25 09:45:26 destination > 2022-08-25 09:45:22 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):122 - Preparing tmp tables in destination started for 1 streams 2022-08-25 09:45:26 destination > 2022-08-25 09:45:22 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):126 - Preparing tmp table in destination started for stream s3_user_reports. schema: airbyte, tmp table name: _airbyte_tmp_wih_s3_user_reports 2022-08-25 09:45:26 destination > 2022-08-25 09:45:23 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):132 - Preparing tables in destination completed. 2022-08-25 09:45:27 replication-orchestrator > Unknown keyword existingJavaType - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:45:27 source > initialised stream with format: 2022-08-25 09:45:27 source > Starting syncing SourceS3 2022-08-25 09:45:27 source > initialised stream with format: {'encoding': 'utf8', 'filetype': 'csv', 'delimiter': ',', 'block_size': 10000, 'quote_char': '"', 'escape_char': '\\', 'double_quote': True, 'infer_datatypes': True, 'advanced_options': '{}', 'newlines_in_values': True, 'additional_reader_options': '{}'} 2022-08-25 09:45:27 source > Syncing stream: s3_user_reports 2022-08-25 09:45:27 source > Iterating S3 bucket 'kintaro-activepipe' 2022-08-25 09:45:47 source > timed out while running infer_schema_process after 4 seconds, retrying... 2022-08-25 09:45:55 source > determined master schema: {'User ID': 'integer', 'Office': 'string', 'Agent Name': 'string', 'Status': 'string', 'Email': 'string', 'Title': 'string', 'Contacts': 'integer', 'Shared Contacts': 'integer', 'Sents': 'integer', 'Opens': 'integer', 'Clicks': 'integer', 'Total Sends': 'integer', 'Sends Last 30 days': 'integer', 'Last Sent': 'string', 'Last Login': 'string'} 2022-08-25 09:45:55 source > finished reading a stream slice 2022-08-25 09:45:56 replication-orchestrator > Records read: 1000 (480 KB) 2022-08-25 09:45:56 source > finished reading a stream slice 2022-08-25 09:45:56 source > finished reading a stream slice 2022-08-25 09:45:57 replication-orchestrator > Records read: 2000 (959 KB) 2022-08-25 09:45:57 source > finished reading a stream slice 2022-08-25 09:45:57 source > finished reading a stream slice 2022-08-25 09:45:57 replication-orchestrator > Records read: 3000 (1 MB) 2022-08-25 09:45:57 source > finished reading a stream slice 2022-08-25 09:45:58 source > finished reading a stream slice 2022-08-25 09:45:58 replication-orchestrator > Records read: 4000 (1 MB) 2022-08-25 09:45:58 source > finished reading a stream slice 2022-08-25 09:45:58 source > finished reading a stream slice 2022-08-25 09:45:59 replication-orchestrator > Records read: 5000 (2 MB) 2022-08-25 09:45:59 source > finished reading a stream slice 2022-08-25 09:45:59 source > finished reading a stream slice 2022-08-25 09:45:59 replication-orchestrator > Records read: 6000 (2 MB) 2022-08-25 09:45:59 source > finished reading a stream slice 2022-08-25 09:46:00 source > finished reading a stream slice 2022-08-25 09:46:00 replication-orchestrator > Records read: 7000 (3 MB) 2022-08-25 09:46:00 source > finished reading a stream slice 2022-08-25 09:46:01 source > finished reading a stream slice 2022-08-25 09:46:01 replication-orchestrator > Records read: 8000 (3 MB) 2022-08-25 09:46:01 source > finished reading a stream slice 2022-08-25 09:46:01 source > finished reading a stream slice 2022-08-25 09:46:01 replication-orchestrator > Records read: 9000 (4 MB) 2022-08-25 09:46:02 source > finished reading a stream slice 2022-08-25 09:46:02 source > finished reading a stream slice 2022-08-25 09:46:02 replication-orchestrator > Records read: 10000 (4 MB) 2022-08-25 09:46:02 source > finished reading a stream slice 2022-08-25 09:46:03 source > finished reading a stream slice 2022-08-25 09:46:03 replication-orchestrator > Records read: 11000 (5 MB) 2022-08-25 09:46:03 source > finished reading a stream slice 2022-08-25 09:46:04 source > finished reading a stream slice 2022-08-25 09:46:04 replication-orchestrator > Records read: 12000 (5 MB) 2022-08-25 09:46:04 source > finished reading a stream slice 2022-08-25 09:46:05 source > finished reading a stream slice 2022-08-25 09:46:05 replication-orchestrator > Records read: 13000 (6 MB) 2022-08-25 09:46:05 destination > 2022-08-25 09:46:05 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing s3_user_reports: 13337 records (24 MB) 2022-08-25 09:46:05 source > finished reading a stream slice 2022-08-25 09:46:06 replication-orchestrator > Records read: 14000 (6 MB) 2022-08-25 09:46:06 source > finished reading a stream slice 2022-08-25 09:46:07 source > finished reading a stream slice 2022-08-25 09:46:08 replication-orchestrator > Records read: 15000 (7 MB) 2022-08-25 09:46:08 source > finished reading a stream slice 2022-08-25 09:46:08 source > finished reading a stream slice 2022-08-25 09:46:08 replication-orchestrator > Records read: 16000 (7 MB) 2022-08-25 09:46:09 source > finished reading a stream slice 2022-08-25 09:46:09 source > finished reading a stream slice 2022-08-25 09:46:09 replication-orchestrator > Records read: 17000 (7 MB) 2022-08-25 09:46:09 source > finished reading a stream slice 2022-08-25 09:46:10 source > finished reading a stream slice 2022-08-25 09:46:10 replication-orchestrator > Records read: 18000 (8 MB) 2022-08-25 09:46:10 source > finished reading a stream slice 2022-08-25 09:46:10 source > finished reading a stream slice 2022-08-25 09:46:11 replication-orchestrator > Records read: 19000 (8 MB) 2022-08-25 09:46:11 source > finished reading a stream slice 2022-08-25 09:46:11 source > finished reading a stream slice 2022-08-25 09:46:11 replication-orchestrator > Records read: 20000 (9 MB) 2022-08-25 09:46:12 source > finished reading a stream slice 2022-08-25 09:46:12 source > finished reading a stream slice 2022-08-25 09:46:12 replication-orchestrator > Records read: 21000 (9 MB) 2022-08-25 09:46:12 source > finished reading a stream slice 2022-08-25 09:46:13 source > finished reading a stream slice 2022-08-25 09:46:13 replication-orchestrator > Records read: 22000 (10 MB) 2022-08-25 09:46:13 source > finished reading a stream slice 2022-08-25 09:46:14 source > finished reading a stream slice 2022-08-25 09:46:14 replication-orchestrator > Records read: 23000 (10 MB) 2022-08-25 09:46:14 source > finished reading a stream slice 2022-08-25 09:46:14 source > finished reading a stream slice 2022-08-25 09:46:14 replication-orchestrator > Records read: 24000 (11 MB) 2022-08-25 09:46:15 source > finished reading a stream slice 2022-08-25 09:46:15 source > finished reading a stream slice 2022-08-25 09:46:15 replication-orchestrator > Records read: 25000 (11 MB) 2022-08-25 09:46:16 source > finished reading a stream slice 2022-08-25 09:46:16 replication-orchestrator > Records read: 26000 (12 MB) 2022-08-25 09:46:16 source > finished reading a stream slice 2022-08-25 09:46:16 source > finished reading a stream slice 2022-08-25 09:46:16 destination > 2022-08-25 09:46:16 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing s3_user_reports: 13291 records (24 MB) 2022-08-25 09:46:16 replication-orchestrator > Records read: 27000 (12 MB) 2022-08-25 09:46:17 source > finished reading a stream slice 2022-08-25 09:46:17 source > finished reading a stream slice 2022-08-25 09:46:17 replication-orchestrator > Records read: 28000 (13 MB) 2022-08-25 09:46:17 source > finished reading a stream slice 2022-08-25 09:46:18 source > finished reading a stream slice 2022-08-25 09:46:18 replication-orchestrator > Records read: 29000 (13 MB) 2022-08-25 09:46:18 source > finished reading a stream slice 2022-08-25 09:46:19 source > finished reading a stream slice 2022-08-25 09:46:19 replication-orchestrator > Records read: 30000 (14 MB) 2022-08-25 09:46:19 source > finished reading a stream slice 2022-08-25 09:46:19 source > finished reading a stream slice 2022-08-25 09:46:19 replication-orchestrator > Records read: 31000 (14 MB) 2022-08-25 09:46:20 source > finished reading a stream slice 2022-08-25 09:46:20 source > finished reading a stream slice 2022-08-25 09:46:20 replication-orchestrator > Records read: 32000 (14 MB) 2022-08-25 09:46:21 source > finished reading a stream slice 2022-08-25 09:46:21 source > finished reading a stream slice 2022-08-25 09:46:21 replication-orchestrator > Records read: 33000 (15 MB) 2022-08-25 09:46:21 source > finished reading a stream slice 2022-08-25 09:46:22 source > finished reading a stream slice 2022-08-25 09:46:22 replication-orchestrator > Records read: 34000 (15 MB) 2022-08-25 09:46:22 source > finished reading a stream slice 2022-08-25 09:46:22 source > finished reading a stream slice 2022-08-25 09:46:22 replication-orchestrator > Records read: 35000 (16 MB) 2022-08-25 09:46:23 source > finished reading a stream slice 2022-08-25 09:46:23 source > finished reading a stream slice 2022-08-25 09:46:23 replication-orchestrator > Records read: 36000 (16 MB) 2022-08-25 09:46:23 source > finished reading a stream slice 2022-08-25 09:46:24 replication-orchestrator > Records read: 37000 (17 MB) 2022-08-25 09:46:24 source > finished reading a stream slice 2022-08-25 09:46:24 source > finished reading a stream slice 2022-08-25 09:46:24 replication-orchestrator > Records read: 38000 (17 MB) 2022-08-25 09:46:25 source > finished reading a stream slice 2022-08-25 09:46:25 source > finished reading a stream slice 2022-08-25 09:46:25 replication-orchestrator > Records read: 39000 (18 MB) 2022-08-25 09:46:25 source > finished reading a stream slice 2022-08-25 09:46:26 source > finished reading a stream slice 2022-08-25 09:46:26 replication-orchestrator > Records read: 40000 (18 MB) 2022-08-25 09:46:26 destination > 2022-08-25 09:46:26 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing s3_user_reports: 13321 records (24 MB) 2022-08-25 09:46:26 source > finished reading a stream slice 2022-08-25 09:46:26 source > finished reading a stream slice 2022-08-25 09:46:27 replication-orchestrator > Records read: 41000 (19 MB) 2022-08-25 09:46:27 source > finished reading a stream slice 2022-08-25 09:46:27 source > finished reading a stream slice 2022-08-25 09:46:27 replication-orchestrator > Records read: 42000 (19 MB) 2022-08-25 09:46:28 source > finished reading a stream slice 2022-08-25 09:46:28 source > finished reading a stream slice 2022-08-25 09:46:28 replication-orchestrator > Records read: 43000 (20 MB) 2022-08-25 09:46:28 source > finished reading a stream slice 2022-08-25 09:46:29 source > finished reading a stream slice 2022-08-25 09:46:29 replication-orchestrator > Records read: 44000 (20 MB) 2022-08-25 09:46:29 source > finished reading a stream slice 2022-08-25 09:46:30 source > finished reading a stream slice 2022-08-25 09:46:30 replication-orchestrator > Records read: 45000 (21 MB) 2022-08-25 09:46:30 source > finished reading a stream slice 2022-08-25 09:46:30 source > finished reading a stream slice 2022-08-25 09:46:30 replication-orchestrator > Records read: 46000 (21 MB) 2022-08-25 09:46:31 source > finished reading a stream slice 2022-08-25 09:46:31 replication-orchestrator > Records read: 47000 (21 MB) 2022-08-25 09:46:31 source > finished reading a stream slice 2022-08-25 09:46:31 source > finished reading a stream slice 2022-08-25 09:46:31 replication-orchestrator > Records read: 48000 (22 MB) 2022-08-25 09:46:32 source > finished reading a stream slice 2022-08-25 09:46:32 source > finished reading a stream slice 2022-08-25 09:46:32 replication-orchestrator > Records read: 49000 (22 MB) 2022-08-25 09:46:32 source > finished reading a stream slice 2022-08-25 09:46:32 source > Read 49074 records from s3_user_reports stream 2022-08-25 09:46:32 source > Finished syncing s3_user_reports 2022-08-25 09:46:32 source > SourceS3 runtimes: Syncing stream s3_user_reports 0:01:05.705956 2022-08-25 09:46:32 source > Finished syncing SourceS3 2022-08-25 09:46:32 replication-orchestrator > Source has no more messages, closing connection. 2022-08-25 09:46:34 replication-orchestrator > (pod: default / source-s3-read-751-0-lefdz) - Closed all resources for pod 2022-08-25 09:46:34 replication-orchestrator > Total records read: 49168 (23 MB) 2022-08-25 09:46:34 replication-orchestrator > One of source or destination thread complete. Waiting on the other. 2022-08-25 09:46:34 destination > 2022-08-25 09:46:34 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2022-08-25 09:46:34 destination > 2022-08-25 09:46:34 INFO i.a.i.d.b.BufferedStreamConsumer(close):171 - executing on success close procedure. 2022-08-25 09:46:34 destination > 2022-08-25 09:46:34 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing s3_user_reports: 9125 records (17 MB) 2022-08-25 09:46:34 destination > 2022-08-25 09:46:34 INFO i.a.i.d.j.SqlOperations(onDestinationCloseOperations):137 - No onDestinationCloseOperations required for this destination. 2022-08-25 09:46:34 destination > 2022-08-25 09:46:34 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):162 - Finalizing tables in destination started for 1 streams 2022-08-25 09:46:34 destination > 2022-08-25 09:46:34 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):167 - Finalizing stream s3_user_reports. schema airbyte, tmp table _airbyte_tmp_wih_s3_user_reports, final table _airbyte_raw_s3_user_reports 2022-08-25 09:46:34 destination > 2022-08-25 09:46:34 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):180 - Executing finalization of tables. 2022-08-25 09:46:35 destination > 2022-08-25 09:46:35 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):182 - Finalizing tables in destination completed. 2022-08-25 09:46:35 destination > 2022-08-25 09:46:35 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):185 - Cleaning tmp tables in destination started for 1 streams 2022-08-25 09:46:35 destination > 2022-08-25 09:46:35 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):189 - Cleaning tmp table in destination started for stream s3_user_reports. schema airbyte, tmp table name: _airbyte_tmp_wih_s3_user_reports 2022-08-25 09:46:35 destination > 2022-08-25 09:46:35 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):194 - Cleaning tmp tables in destination completed. 2022-08-25 09:46:35 replication-orchestrator > State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@43b04ff3[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@7f158ebc[type=,stream=,global=,data={"s3_user_reports":{"_ab_source_file_last_modified":"2022-08-25T09:00:46+0000","schema":{"User ID":"integer","Office":"string","Agent Name":"string","Status":"string","Email":"string","Title":"string","Contacts":"integer","Shared Contacts":"integer","Sents":"integer","Opens":"integer","Clicks":"integer","Total Sends":"integer","Sends Last 30 days":"integer","Last Sent":"string","Last Login":"string","_ab_additional_properties":"object","_ab_source_file_last_modified":"string","_ab_source_file_url":"string"},"history":{"2022-08-22":["20220822_williampitt_activepipe_user_reports.csv"],"2022-08-23":["20220823_williampitt_activepipe_user_reports.csv"],"2022-08-24":["20220824_williampitt_activepipe_user_reports.csv"],"2022-08-25":["20220825_williampitt_activepipe_user_reports.csv"]}}},additionalProperties={}],trace=,additionalProperties={}] 2022-08-25 09:46:35 destination > 2022-08-25 09:46:35 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2022-08-25 09:46:35 destination > 2022-08-25 09:46:35 INFO i.a.i.d.p.PostgresDestination(main):92 - completed destination: class io.airbyte.integrations.destination.postgres.PostgresDestination 2022-08-25 09:46:36 replication-orchestrator > (pod: default / destination-postgres-write-751-0-tqzfy) - Closed all resources for pod 2022-08-25 09:46:36 replication-orchestrator > Source and destination threads complete. 2022-08-25 09:46:36 replication-orchestrator > sync summary: io.airbyte.config.ReplicationAttemptSummary@586843bc[status=completed,recordsSynced=49074,bytesSynced=24123540,startTime=1661420714800,endTime=1661420796129,totalStats=io.airbyte.config.SyncStats@17134190[recordsEmitted=49074,bytesEmitted=24123540,stateMessagesEmitted=94,recordsCommitted=49074],streamStats=[io.airbyte.config.StreamSyncStats@7d8b66d9[streamName=s3_user_reports,stats=io.airbyte.config.SyncStats@5599b5bb[recordsEmitted=49074,bytesEmitted=24123540,stateMessagesEmitted=,recordsCommitted=49074]]]] 2022-08-25 09:46:36 replication-orchestrator > Source output at least one state message 2022-08-25 09:46:36 replication-orchestrator > State capture: Updated state to: Optional[io.airbyte.config.State@1d1bf7bf[state={"s3_user_reports":{"_ab_source_file_last_modified":"2022-08-25T09:00:46+0000","schema":{"User ID":"integer","Office":"string","Agent Name":"string","Status":"string","Email":"string","Title":"string","Contacts":"integer","Shared Contacts":"integer","Sents":"integer","Opens":"integer","Clicks":"integer","Total Sends":"integer","Sends Last 30 days":"integer","Last Sent":"string","Last Login":"string","_ab_additional_properties":"object","_ab_source_file_last_modified":"string","_ab_source_file_url":"string"},"history":{"2022-08-22":["20220822_williampitt_activepipe_user_reports.csv"],"2022-08-23":["20220823_williampitt_activepipe_user_reports.csv"],"2022-08-24":["20220824_williampitt_activepipe_user_reports.csv"],"2022-08-25":["20220825_williampitt_activepipe_user_reports.csv"]}}}]] 2022-08-25 09:46:36 replication-orchestrator > Returning output... 2022-08-25 09:46:36 replication-orchestrator > Writing async status SUCCEEDED for KubePodInfo[namespace=default, name=orchestrator-repl-job-751-attempt-0]... 2022-08-25 09:46:43 normalization-orchestrator > Writing async status INITIALIZING for KubePodInfo[namespace=default, name=orchestrator-norm-job-751-attempt-0]... 2022-08-25 09:46:36 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):322 - Stopping temporal heartbeating... 2022-08-25 09:46:36 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-08-25 09:46:36 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):161 - sync summary: io.airbyte.config.StandardSyncOutput@156ebd89[standardSyncSummary=io.airbyte.config.StandardSyncSummary@4883caa8[status=completed,recordsSynced=49074,bytesSynced=24123540,startTime=1661420714800,endTime=1661420796129,totalStats=io.airbyte.config.SyncStats@7cab1904[recordsEmitted=49074,bytesEmitted=24123540,stateMessagesEmitted=94,recordsCommitted=49074],streamStats=[io.airbyte.config.StreamSyncStats@5e8c0457[streamName=s3_user_reports,stats=io.airbyte.config.SyncStats@3e6e78fa[recordsEmitted=49074,bytesEmitted=24123540,stateMessagesEmitted=,recordsCommitted=49074]]]],normalizationSummary=,state=io.airbyte.config.State@68ee2315[state={"s3_user_reports":{"_ab_source_file_last_modified":"2022-08-25T09:00:46+0000","schema":{"User ID":"integer","Office":"string","Agent Name":"string","Status":"string","Email":"string","Title":"string","Contacts":"integer","Shared Contacts":"integer","Sents":"integer","Opens":"integer","Clicks":"integer","Total Sends":"integer","Sends Last 30 days":"integer","Last Sent":"string","Last Login":"string","_ab_additional_properties":"object","_ab_source_file_last_modified":"string","_ab_source_file_url":"string"},"history":{"2022-08-22":["20220822_williampitt_activepipe_user_reports.csv"],"2022-08-23":["20220823_williampitt_activepipe_user_reports.csv"],"2022-08-24":["20220824_williampitt_activepipe_user_reports.csv"],"2022-08-25":["20220825_williampitt_activepipe_user_reports.csv"]}}}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@4ca97435[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@72396f4b[stream=io.airbyte.protocol.models.AirbyteStream@3fdd605e[name=s3_user_reports,jsonSchema={"type":"object","properties":{"Email":{"type":["null","string"]},"Opens":{"type":["null","number"]},"Sents":{"type":["null","number"]},"Title":{"type":["null","string"]},"Clicks":{"type":["null","number"]},"Office":{"type":["null","string"]},"Status":{"type":["null","string"]},"User ID":{"type":["null","integer"]},"Contacts":{"type":["null","number"]},"Last Sent":{"type":["null","string"]},"Agent Name":{"type":["null","string"]},"Last Login":{"type":["null","string"]},"Total Sends":{"type":["null","number"]},"Shared Contacts":{"type":["null","number"]},"Sends Last 30 days":{"type":["null","number"]},"_ab_source_file_url":{"type":"string"},"_ab_additional_properties":{"type":"object"},"_ab_source_file_last_modified":{"type":"string","format":"date-time"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[_ab_source_file_last_modified],sourceDefinedPrimaryKey=[],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[_ab_source_file_last_modified],destinationSyncMode=append,primaryKey=[],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-08-25 09:46:36 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-08-25 09:46:36 INFO i.a.w.t.TemporalAttemptExecution(get):107 - Cloud storage job log path: /workspace/751/0/logs.log 2022-08-25 09:46:36 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.41-alpha 2022-08-25 09:46:36 INFO i.a.w.t.s.LauncherWorker(lambda$run$3):142 - Creating orchestrator-norm-job-751-attempt-0 for attempt number: 0 2022-08-25 09:46:36 WARN i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):200 - There are currently running pods for the connection: [orchestrator-repl-job-751-attempt-0] 2022-08-25 09:46:36 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):202 - Attempting to delete pods: [orchestrator-repl-job-751-attempt-0] 2022-08-25 09:46:36 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):207 - Waiting for deletion... 2022-08-25 09:46:37 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):214 - Successfully deleted all running pods for the connection! 2022-08-25 09:46:37 INFO i.a.w.p.AsyncOrchestratorPodProcess(create):318 - Waiting for pod to be running... 2022-08-25 09:46:39 INFO i.a.w.p.AsyncOrchestratorPodProcess(create):341 - Pod default/orchestrator-norm-job-751-attempt-0 is running on 192.168.72.216 2022-08-25 09:46:39 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: destinationLauncherConfig.json 2022-08-25 09:46:39 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/1b9dfa0d-be68-4f74-a454-5de173da6a3b/destinationLauncherConfig.json default/orchestrator-norm-job-751-attempt-0:/config/destinationLauncherConfig.json -c main 2022-08-25 09:46:39 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:46:39 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:46:39 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: envMap.json 2022-08-25 09:46:39 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/93965285-96a8-4646-9db8-ab68464b1d3b/envMap.json default/orchestrator-norm-job-751-attempt-0:/config/envMap.json -c main 2022-08-25 09:46:39 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:46:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:46:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: input.json 2022-08-25 09:46:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/999fcd8b-87ad-4547-9bb3-06afa8f9187c/input.json default/orchestrator-norm-job-751-attempt-0:/config/input.json -c main 2022-08-25 09:46:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:46:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:46:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: KUBE_POD_INFO 2022-08-25 09:46:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/70dac600-65da-40bc-be24-73240f05e175/KUBE_POD_INFO default/orchestrator-norm-job-751-attempt-0:/config/KUBE_POD_INFO -c main 2022-08-25 09:46:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:46:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:46:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: application.txt 2022-08-25 09:46:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/8a95cd98-ac97-4fa1-8751-6c0faf5aef48/application.txt default/orchestrator-norm-job-751-attempt-0:/config/application.txt -c main 2022-08-25 09:46:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:46:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:46:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: jobRunConfig.json 2022-08-25 09:46:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/99240896-a42c-440f-8432-84fbb648d729/jobRunConfig.json default/orchestrator-norm-job-751-attempt-0:/config/jobRunConfig.json -c main 2022-08-25 09:46:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:46:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:46:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: FINISHED_UPLOADING 2022-08-25 09:46:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/fdac971c-db4a-40a6-bcca-989bb26e2407/FINISHED_UPLOADING default/orchestrator-norm-job-751-attempt-0:/config/FINISHED_UPLOADING -c main 2022-08-25 09:46:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:46:42 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:46:44 normalization-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_CPU_REQUEST: 'null' 2022-08-25 09:46:44 normalization-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_CPU_LIMIT: 'null' 2022-08-25 09:46:44 normalization-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_REQUEST: 'null' 2022-08-25 09:46:44 normalization-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_LIMIT: 'null' 2022-08-25 09:46:44 normalization-orchestrator > Using default value for environment variable JOB_KUBE_TOLERATIONS: '' 2022-08-25 09:46:44 normalization-orchestrator > Using default value for environment variable JOB_KUBE_NODE_SELECTORS: '' 2022-08-25 09:46:44 normalization-orchestrator > Using default value for environment variable JOB_KUBE_ANNOTATIONS: '' 2022-08-25 09:46:44 normalization-orchestrator > Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_SECRET: '' 2022-08-25 09:46:44 normalization-orchestrator > Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-08-25 09:46:44 normalization-orchestrator > Using default value for environment variable JOB_KUBE_SIDECAR_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-08-25 09:46:44 normalization-orchestrator > Using default value for environment variable JOB_KUBE_SOCAT_IMAGE: 'alpine/socat:1.7.4.3-r0' 2022-08-25 09:46:44 normalization-orchestrator > Using default value for environment variable JOB_KUBE_BUSYBOX_IMAGE: 'busybox:1.28' 2022-08-25 09:46:44 normalization-orchestrator > Using default value for environment variable JOB_KUBE_CURL_IMAGE: 'curlimages/curl:7.83.1' 2022-08-25 09:46:44 normalization-orchestrator > Using default value for environment variable DEPLOYMENT_MODE: 'OSS' 2022-08-25 09:46:44 normalization-orchestrator > Using Kubernetes namespace: default 2022-08-25 09:46:44 normalization-orchestrator > Logging initialized @5789ms to org.eclipse.jetty.util.log.Slf4jLog 2022-08-25 09:46:44 normalization-orchestrator > jetty-9.4.31.v20200723; built: 2020-07-23T17:57:36.812Z; git: 450ba27947e13e66baa8cd1ce7e85a4461cacc1d; jvm 19-ea+32-2220 2022-08-25 09:46:44 normalization-orchestrator > Started o.e.j.s.ServletContextHandler@236eccd1{/,null,AVAILABLE} 2022-08-25 09:46:44 normalization-orchestrator > Started ServerConnector@479ac2cb{HTTP/1.1, (http/1.1)}{0.0.0.0:9000} 2022-08-25 09:46:44 normalization-orchestrator > Started @5914ms 2022-08-25 09:46:44 normalization-orchestrator > Writing async status RUNNING for KubePodInfo[namespace=default, name=orchestrator-norm-job-751-attempt-0]... 2022-08-25 09:46:44 normalization-orchestrator > Setting up normalization worker... 2022-08-25 09:46:44 normalization-orchestrator > Running normalization worker... 2022-08-25 09:46:44 normalization-orchestrator > Running normalization. 2022-08-25 09:46:44 normalization-orchestrator > Running with normalization version: airbyte/normalization:0.2.12 2022-08-25 09:46:44 normalization-orchestrator > Attempting to start pod = normalization-normalize-751-0-lvwil for airbyte/normalization:0.2.12 2022-08-25 09:46:44 normalization-orchestrator > normalization-normalize-751-0-lvwil stdoutLocalPort = 9880 2022-08-25 09:46:44 normalization-orchestrator > normalization-normalize-751-0-lvwil stderrLocalPort = 9879 2022-08-25 09:46:44 normalization-orchestrator > Creating stdout socket server... 2022-08-25 09:46:44 normalization-orchestrator > Creating stderr socket server... 2022-08-25 09:46:44 normalization-orchestrator > Creating pod normalization-normalize-751-0-lvwil... 2022-08-25 09:46:45 normalization-orchestrator > Waiting for init container to be ready before copying files... 2022-08-25 09:46:45 normalization-orchestrator > Init container present.. 2022-08-25 09:46:46 normalization-orchestrator > Init container ready.. 2022-08-25 09:46:46 normalization-orchestrator > Copying files... 2022-08-25 09:46:46 normalization-orchestrator > Uploading file: destination_config.json 2022-08-25 09:46:46 normalization-orchestrator > kubectl cp /tmp/0e06c41d-e04b-4cb8-9816-03d72e67c63f/destination_config.json default/normalization-normalize-751-0-lvwil:/config/destination_config.json -c init 2022-08-25 09:46:46 normalization-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:46:46 normalization-orchestrator > kubectl cp complete, closing process 2022-08-25 09:46:46 normalization-orchestrator > Uploading file: destination_catalog.json 2022-08-25 09:46:46 normalization-orchestrator > kubectl cp /tmp/384e09e1-7b4b-4cd5-8b3e-c8ac4ba49114/destination_catalog.json default/normalization-normalize-751-0-lvwil:/config/destination_catalog.json -c init 2022-08-25 09:46:46 normalization-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:46:47 normalization-orchestrator > kubectl cp complete, closing process 2022-08-25 09:46:47 normalization-orchestrator > Uploading file: FINISHED_UPLOADING 2022-08-25 09:46:47 normalization-orchestrator > kubectl cp /tmp/aec6adf2-8f16-4b55-8407-c9084dd0df7e/FINISHED_UPLOADING default/normalization-normalize-751-0-lvwil:/config/FINISHED_UPLOADING -c init 2022-08-25 09:46:47 normalization-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:46:47 normalization-orchestrator > kubectl cp complete, closing process 2022-08-25 09:46:47 normalization-orchestrator > Waiting until pod is ready... 2022-08-25 09:46:49 normalization-orchestrator > Setting stdout... 2022-08-25 09:46:49 normalization-orchestrator > Setting stderr... 2022-08-25 09:46:50 normalization-orchestrator > MetricClient has not been initialized. Must call MetricClientFactory.CreateMetricClient before using MetricClient. Using a dummy client for now. Ignore this if Airbyte is configured to not publish any metrics. 2022-08-25 09:46:50 normalization-orchestrator > Reading pod IP... 2022-08-25 09:46:50 normalization-orchestrator > Pod IP: 192.168.82.211 2022-08-25 09:46:50 normalization-orchestrator > Using null stdin output stream... 2022-08-25 09:46:50 normalization > Running: transform-config --config destination_config.json --integration-type postgres --out /config 2022-08-25 09:46:50 normalization > Namespace(config='destination_config.json', integration_type=, out='/config') 2022-08-25 09:46:50 normalization > transform_postgres 2022-08-25 09:46:50 normalization > Running: transform-catalog --integration-type postgres --profile-config-dir /config --catalog destination_catalog.json --out /config/models/generated/ --json-column _airbyte_data 2022-08-25 09:46:50 normalization > Processing destination_catalog.json... 2022-08-25 09:46:50 normalization > Generating airbyte_ctes/airbyte/s3_user_reports_ab1.sql from s3_user_reports 2022-08-25 09:46:50 normalization > Generating airbyte_ctes/airbyte/s3_user_reports_ab2.sql from s3_user_reports 2022-08-25 09:46:50 normalization > Generating airbyte_ctes/airbyte/s3_user_reports_ab3.sql from s3_user_reports 2022-08-25 09:46:50 normalization > Generating airbyte_incremental/airbyte/s3_user_reports.sql from s3_user_reports 2022-08-25 09:46:50 normalization > detected no config file for ssh, assuming ssh is off. 2022-08-25 09:46:52 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2022-08-25 09:46:52 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2022-08-25 09:46:52 normalization > 2022-08-25 09:46:52 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2022-08-25 09:46:52 normalization > 2022-08-25 09:46:55 normalization > 09:46:55 Running with dbt=1.0.0 2022-08-25 09:46:55 normalization > 09:46:55 Partial parse save file not found. Starting full parse. 2022-08-25 09:46:56 normalization > 09:46:56 [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2022-08-25 09:46:56 normalization > There are 2 unused configuration paths: 2022-08-25 09:46:56 normalization > - models.airbyte_utils.generated.airbyte_views 2022-08-25 09:46:56 normalization > - models.airbyte_utils.generated.airbyte_tables 2022-08-25 09:46:56 normalization > 2022-08-25 09:46:56 normalization > 09:46:56 Found 4 models, 0 tests, 0 snapshots, 0 analyses, 558 macros, 0 operations, 0 seed files, 1 source, 0 exposures, 0 metrics 2022-08-25 09:46:56 normalization > 09:46:56 2022-08-25 09:46:56 normalization > 09:46:56 Concurrency: 8 threads (target='prod') 2022-08-25 09:46:56 normalization > 09:46:56 2022-08-25 09:46:57 normalization > 09:46:57 1 of 1 START incremental model airbyte.s3_user_reports.................................................................. [RUN] 2022-08-25 09:46:58 normalization > 09:46:58 1 of 1 OK created incremental model airbyte.s3_user_reports............................................................. [INSERT 0 49074 in 1.06s] 2022-08-25 09:46:58 normalization > 09:46:58 2022-08-25 09:46:58 normalization > 09:46:58 Finished running 1 incremental model in 1.43s. 2022-08-25 09:46:58 normalization > 09:46:58 2022-08-25 09:46:58 normalization > 09:46:58 Completed successfully 2022-08-25 09:46:58 normalization > 09:46:58 2022-08-25 09:46:58 normalization > 09:46:58 Done. PASS=1 WARN=0 ERROR=0 SKIP=0 TOTAL=1 2022-08-25 09:46:58 normalization-orchestrator > (pod: default / normalization-normalize-751-0-lvwil) - Closed all resources for pod 2022-08-25 09:46:58 normalization-orchestrator > Normalization executed in 14 seconds. 2022-08-25 09:46:58 normalization-orchestrator > Normalization summary: io.airbyte.config.NormalizationSummary@c14e5a5[startTime=1661420804523,endTime=1661420818705] 2022-08-25 09:46:58 normalization-orchestrator > Writing async status SUCCEEDED for KubePodInfo[namespace=default, name=orchestrator-norm-job-751-attempt-0]... 2022-08-25 09:47:06 dbt-orchestrator > Writing async status INITIALIZING for KubePodInfo[namespace=default, name=orchestrator-dbt-job-751-attempt-0]... 2022-08-25 09:47:06 dbt-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_CPU_REQUEST: 'null' 2022-08-25 09:47:06 dbt-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_CPU_LIMIT: 'null' 2022-08-25 09:47:06 dbt-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_REQUEST: 'null' 2022-08-25 09:47:06 dbt-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_LIMIT: 'null' 2022-08-25 09:47:06 dbt-orchestrator > Using default value for environment variable JOB_KUBE_TOLERATIONS: '' 2022-08-25 09:47:06 dbt-orchestrator > Using default value for environment variable JOB_KUBE_NODE_SELECTORS: '' 2022-08-25 09:47:06 dbt-orchestrator > Using default value for environment variable JOB_KUBE_ANNOTATIONS: '' 2022-08-25 09:47:06 dbt-orchestrator > Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_SECRET: '' 2022-08-25 09:47:06 dbt-orchestrator > Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-08-25 09:47:06 dbt-orchestrator > Using default value for environment variable JOB_KUBE_SIDECAR_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-08-25 09:47:06 dbt-orchestrator > Using default value for environment variable JOB_KUBE_SOCAT_IMAGE: 'alpine/socat:1.7.4.3-r0' 2022-08-25 09:47:06 dbt-orchestrator > Using default value for environment variable JOB_KUBE_BUSYBOX_IMAGE: 'busybox:1.28' 2022-08-25 09:47:06 dbt-orchestrator > Using default value for environment variable JOB_KUBE_CURL_IMAGE: 'curlimages/curl:7.83.1' 2022-08-25 09:47:06 dbt-orchestrator > Using default value for environment variable DEPLOYMENT_MODE: 'OSS' 2022-08-25 09:47:06 dbt-orchestrator > Using Kubernetes namespace: default 2022-08-25 09:47:06 dbt-orchestrator > Logging initialized @5741ms to org.eclipse.jetty.util.log.Slf4jLog 2022-08-25 09:47:06 dbt-orchestrator > jetty-9.4.31.v20200723; built: 2020-07-23T17:57:36.812Z; git: 450ba27947e13e66baa8cd1ce7e85a4461cacc1d; jvm 19-ea+32-2220 2022-08-25 09:47:06 dbt-orchestrator > Started o.e.j.s.ServletContextHandler@733c464f{/,null,AVAILABLE} 2022-08-25 09:47:06 dbt-orchestrator > Started ServerConnector@20999517{HTTP/1.1, (http/1.1)}{0.0.0.0:9000} 2022-08-25 09:47:06 dbt-orchestrator > Started @5880ms 2022-08-25 09:47:06 dbt-orchestrator > Writing async status RUNNING for KubePodInfo[namespace=default, name=orchestrator-dbt-job-751-attempt-0]... 2022-08-25 09:47:07 dbt-orchestrator > Setting up dbt worker... 2022-08-25 09:47:07 dbt-orchestrator > Running dbt worker... 2022-08-25 09:47:07 dbt-orchestrator > Running dbt transformation. 2022-08-25 09:47:07 dbt-orchestrator > Running with normalization version: airbyte/normalization:0.2.12 2022-08-25 09:47:07 dbt-orchestrator > Attempting to start pod = normalization-normalize-751-0-zaaen for airbyte/normalization:0.2.12 2022-08-25 09:47:07 dbt-orchestrator > normalization-normalize-751-0-zaaen stdoutLocalPort = 9877 2022-08-25 09:47:07 dbt-orchestrator > normalization-normalize-751-0-zaaen stderrLocalPort = 9878 2022-08-25 09:47:07 dbt-orchestrator > Creating stdout socket server... 2022-08-25 09:47:07 dbt-orchestrator > Creating stderr socket server... 2022-08-25 09:47:07 dbt-orchestrator > Creating pod normalization-normalize-751-0-zaaen... 2022-08-25 09:47:07 dbt-orchestrator > Waiting for init container to be ready before copying files... 2022-08-25 09:47:07 dbt-orchestrator > Init container present.. 2022-08-25 09:47:08 dbt-orchestrator > Init container ready.. 2022-08-25 09:47:08 dbt-orchestrator > Copying files... 2022-08-25 09:47:08 dbt-orchestrator > Uploading file: destination_config.json 2022-08-25 09:47:08 dbt-orchestrator > kubectl cp /tmp/21dfc968-7bf6-41fb-985f-ce4dddb3daf6/destination_config.json default/normalization-normalize-751-0-zaaen:/config/destination_config.json -c init 2022-08-25 09:47:08 dbt-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:47:09 dbt-orchestrator > kubectl cp complete, closing process 2022-08-25 09:47:09 dbt-orchestrator > Uploading file: FINISHED_UPLOADING 2022-08-25 09:47:09 dbt-orchestrator > kubectl cp /tmp/5d0880c9-9434-4b4e-9b1e-98b177b4b165/FINISHED_UPLOADING default/normalization-normalize-751-0-zaaen:/config/FINISHED_UPLOADING -c init 2022-08-25 09:47:09 dbt-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:47:09 dbt-orchestrator > kubectl cp complete, closing process 2022-08-25 09:47:09 dbt-orchestrator > Waiting until pod is ready... 2022-08-25 09:47:10 dbt-orchestrator > Setting stdout... 2022-08-25 09:47:10 dbt-orchestrator > Setting stderr... 2022-08-25 09:47:11 dbt-orchestrator > MetricClient has not been initialized. Must call MetricClientFactory.CreateMetricClient before using MetricClient. Using a dummy client for now. Ignore this if Airbyte is configured to not publish any metrics. 2022-08-25 09:47:11 dbt-orchestrator > Reading pod IP... 2022-08-25 09:47:11 dbt-orchestrator > Pod IP: 192.168.75.131 2022-08-25 09:47:11 dbt-orchestrator > Using null stdin output stream... 2022-08-25 09:47:11 normalization > Running: git clone --depth 5 --single-branch $GIT_REPO git_repo 2022-08-25 09:47:11 normalization > Last 5 commits in git_repo: 2022-08-25 09:47:11 normalization > 6325314 Merge pull request #21 from Kintaro-io/mvp 2022-08-25 09:47:11 normalization > f8b58a4 Merge branch 'main' of https://github.com/Kintaro-io/kintaro-data-transform into mvp 2022-08-25 09:47:11 normalization > 105530f Updated models 2022-08-25 09:47:11 normalization > 6ac6e13 Updated models 2022-08-25 09:47:11 normalization > cb8869d Merge pull request #20 from Kintaro-io/mvp 2022-08-25 09:47:11 normalization > /config 2022-08-25 09:47:11 normalization > Running: transform-config --config destination_config.json --integration-type postgres --out /config 2022-08-25 09:47:11 normalization > Namespace(config='destination_config.json', integration_type=, out='/config') 2022-08-25 09:47:11 normalization > transform_postgres 2022-08-25 09:47:11 normalization > Cloning into 'git_repo'... 2022-08-25 09:47:13 dbt-orchestrator > (pod: default / normalization-normalize-751-0-zaaen) - Closed all resources for pod 2022-08-25 09:47:13 dbt-orchestrator > Attempting to start pod = dbt-custom-751-0-bjezc for fishtownanalytics/dbt:1.0.0 2022-08-25 09:47:13 dbt-orchestrator > dbt-custom-751-0-bjezc stdoutLocalPort = 9879 2022-08-25 09:47:13 dbt-orchestrator > dbt-custom-751-0-bjezc stderrLocalPort = 9880 2022-08-25 09:47:13 dbt-orchestrator > Creating stdout socket server... 2022-08-25 09:47:13 dbt-orchestrator > Found entrypoint override: /bin/bash 2022-08-25 09:47:13 dbt-orchestrator > Creating stderr socket server... 2022-08-25 09:47:13 dbt-orchestrator > Creating pod dbt-custom-751-0-bjezc... 2022-08-25 09:47:13 dbt-orchestrator > Waiting for init container to be ready before copying files... 2022-08-25 09:47:13 dbt-orchestrator > Init container present.. 2022-08-25 09:47:14 dbt-orchestrator > Init container ready.. 2022-08-25 09:47:14 dbt-orchestrator > Copying files... 2022-08-25 09:47:14 dbt-orchestrator > Uploading file: entrypoint.sh 2022-08-25 09:47:14 dbt-orchestrator > kubectl cp /tmp/040d7751-f488-4005-9068-5a224cef31fa/entrypoint.sh default/dbt-custom-751-0-bjezc:/config/entrypoint.sh -c init 2022-08-25 09:47:14 dbt-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:47:14 dbt-orchestrator > kubectl cp complete, closing process 2022-08-25 09:47:14 dbt-orchestrator > Uploading file: sshtunneling.sh 2022-08-25 09:47:14 dbt-orchestrator > kubectl cp /tmp/28bfa937-b0a4-448d-a1f1-bbf4d0a1c566/sshtunneling.sh default/dbt-custom-751-0-bjezc:/config/sshtunneling.sh -c init 2022-08-25 09:47:14 dbt-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:47:15 dbt-orchestrator > kubectl cp complete, closing process 2022-08-25 09:47:15 dbt-orchestrator > Uploading file: FINISHED_UPLOADING 2022-08-25 09:47:15 dbt-orchestrator > kubectl cp /tmp/3766602f-bc8b-4c45-9bca-c0d96e0829df/FINISHED_UPLOADING default/dbt-custom-751-0-bjezc:/config/FINISHED_UPLOADING -c init 2022-08-25 09:47:15 dbt-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:47:15 dbt-orchestrator > kubectl cp complete, closing process 2022-08-25 09:47:15 dbt-orchestrator > Waiting until pod is ready... 2022-08-25 09:47:15 dbt-orchestrator > Setting stdout... 2022-08-25 09:47:15 dbt-orchestrator > Setting stderr... 2022-08-25 09:47:16 dbt-orchestrator > MetricClient has not been initialized. Must call MetricClientFactory.CreateMetricClient before using MetricClient. Using a dummy client for now. Ignore this if Airbyte is configured to not publish any metrics. 2022-08-25 09:47:16 dbt-orchestrator > Reading pod IP... 2022-08-25 09:47:16 dbt-orchestrator > Pod IP: 192.168.42.99 2022-08-25 09:47:16 dbt-orchestrator > Using null stdin output stream... 2022-08-25 09:47:16 dbt-orchestrator > generic gobbler IOException: Socket closed. Typically happens when cancelling a job. 2022-08-25 09:47:16 dbt-orchestrator > (pod: default / dbt-custom-751-0-bjezc) - Closed all resources for pod 2022-08-25 09:47:16 dbt-orchestrator > Writing async status FAILED for KubePodInfo[namespace=default, name=orchestrator-dbt-job-751-attempt-0]... 2022-08-25 09:46:58 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):322 - Stopping temporal heartbeating... 2022-08-25 09:46:58 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-08-25 09:46:58 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-08-25 09:46:58 INFO i.a.w.t.TemporalAttemptExecution(get):107 - Cloud storage job log path: /workspace/751/0/logs.log 2022-08-25 09:46:58 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.41-alpha 2022-08-25 09:46:58 INFO i.a.w.t.s.LauncherWorker(lambda$run$3):142 - Creating orchestrator-dbt-job-751-attempt-0 for attempt number: 0 2022-08-25 09:46:59 WARN i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):200 - There are currently running pods for the connection: [orchestrator-norm-job-751-attempt-0] 2022-08-25 09:46:59 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):202 - Attempting to delete pods: [orchestrator-norm-job-751-attempt-0] 2022-08-25 09:46:59 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):207 - Waiting for deletion... 2022-08-25 09:47:00 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):214 - Successfully deleted all running pods for the connection! 2022-08-25 09:47:00 INFO i.a.w.p.AsyncOrchestratorPodProcess(create):318 - Waiting for pod to be running... 2022-08-25 09:47:01 INFO i.a.w.p.AsyncOrchestratorPodProcess(create):341 - Pod default/orchestrator-dbt-job-751-attempt-0 is running on 192.168.68.201 2022-08-25 09:47:01 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: destinationLauncherConfig.json 2022-08-25 09:47:01 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/d7e39093-a555-4457-b49f-46b5b5de7dd9/destinationLauncherConfig.json default/orchestrator-dbt-job-751-attempt-0:/config/destinationLauncherConfig.json -c main 2022-08-25 09:47:01 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:47:02 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:47:02 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: envMap.json 2022-08-25 09:47:02 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/28937a4c-9d8d-42d7-a073-2d8139dd3af0/envMap.json default/orchestrator-dbt-job-751-attempt-0:/config/envMap.json -c main 2022-08-25 09:47:02 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:47:02 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:47:02 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: input.json 2022-08-25 09:47:02 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/92458cce-1eab-44b4-9970-b10f68d4699e/input.json default/orchestrator-dbt-job-751-attempt-0:/config/input.json -c main 2022-08-25 09:47:02 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:47:03 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:47:03 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: KUBE_POD_INFO 2022-08-25 09:47:03 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/83ddf15d-e5be-48bf-9b27-0087eb1c6c65/KUBE_POD_INFO default/orchestrator-dbt-job-751-attempt-0:/config/KUBE_POD_INFO -c main 2022-08-25 09:47:03 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:47:03 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:47:03 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: application.txt 2022-08-25 09:47:03 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/4c0877a9-352c-479c-ad6f-da04816dbcb2/application.txt default/orchestrator-dbt-job-751-attempt-0:/config/application.txt -c main 2022-08-25 09:47:03 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:47:03 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:47:03 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: jobRunConfig.json 2022-08-25 09:47:03 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/d317429b-6eb5-4028-b7a3-c60676ccac81/jobRunConfig.json default/orchestrator-dbt-job-751-attempt-0:/config/jobRunConfig.json -c main 2022-08-25 09:47:03 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:47:04 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:47:04 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: FINISHED_UPLOADING 2022-08-25 09:47:04 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/78f960c2-60c9-48bd-87cc-92b43b7545dd/FINISHED_UPLOADING default/orchestrator-dbt-job-751-attempt-0:/config/FINISHED_UPLOADING -c main 2022-08-25 09:47:04 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:47:04 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:47:16 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):322 - Stopping temporal heartbeating... 2022-08-25 09:47:16 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):158 - Completing future exceptionally... java.lang.RuntimeException: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:320) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.LauncherWorker.run(LauncherWorker.java:90) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at java.lang.Thread.run(Thread.java:1589) [?:?] Caused by: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at io.airbyte.workers.temporal.sync.LauncherWorker.lambda$run$3(LauncherWorker.java:181) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:315) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 3 more Caused by: io.airbyte.workers.exception.WorkerException: Non-zero exit code! at io.airbyte.workers.temporal.sync.LauncherWorker.lambda$run$3(LauncherWorker.java:165) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:315) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 3 more 2022-08-25 09:47:16 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-08-25 09:47:16 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-08-25 09:47:16 WARN i.t.i.a.POJOActivityTaskHandler(activityFailureToResult):307 - Activity failure. ActivityId=4dea35b2-8cb1-3cca-8155-633f4b292b13, activityType=Run, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: java.lang.RuntimeException: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:289) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.run(DbtTransformationActivityImpl.java:77) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) [?:?] at java.lang.Thread.run(Thread.java:1589) [?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: java.lang.RuntimeException: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:56) ~[temporal-serviceclient-1.8.1.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:448) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:51) ~[temporal-sdk-1.8.1.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:135) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.lambda$run$3(DbtTransformationActivityImpl.java:108) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:284) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 12 more Caused by: java.util.concurrent.ExecutionException: java.lang.RuntimeException: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:129) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.lambda$run$3(DbtTransformationActivityImpl.java:108) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:284) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 12 more Caused by: java.lang.RuntimeException: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:320) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.LauncherWorker.run(LauncherWorker.java:90) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at io.airbyte.workers.temporal.sync.LauncherWorker.lambda$run$3(LauncherWorker.java:181) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:315) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.LauncherWorker.run(LauncherWorker.java:90) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Non-zero exit code! at io.airbyte.workers.temporal.sync.LauncherWorker.lambda$run$3(LauncherWorker.java:165) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:315) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.LauncherWorker.run(LauncherWorker.java:90) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 1 more 2022-08-25 09:47:17 INFO i.a.w.t.TemporalAttemptExecution(get):107 - Cloud storage job log path: /workspace/751/1/logs.log 2022-08-25 09:47:35 replication-orchestrator > Writing async status INITIALIZING for KubePodInfo[namespace=default, name=orchestrator-repl-job-751-attempt-1]... 2022-08-25 09:47:17 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.41-alpha 2022-08-25 09:47:17 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = source-s3-check-751-1-yjicd for airbyte/source-s3:0.1.17 2022-08-25 09:47:17 INFO i.a.w.p.KubeProcessFactory(create):103 - source-s3-check-751-1-yjicd stdoutLocalPort = 9038 2022-08-25 09:47:17 INFO i.a.w.p.KubeProcessFactory(create):106 - source-s3-check-751-1-yjicd stderrLocalPort = 9039 2022-08-25 09:47:17 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):587 - Creating stdout socket server... 2022-08-25 09:47:17 INFO i.a.w.p.KubePodProcess():518 - Creating pod source-s3-check-751-1-yjicd... 2022-08-25 09:47:17 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):605 - Creating stderr socket server... 2022-08-25 09:47:17 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):308 - Waiting for init container to be ready before copying files... 2022-08-25 09:47:17 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):312 - Init container present.. 2022-08-25 09:47:18 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):315 - Init container ready.. 2022-08-25 09:47:18 INFO i.a.w.p.KubePodProcess():549 - Copying files... 2022-08-25 09:47:18 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):257 - Uploading file: source_config.json 2022-08-25 09:47:18 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp /tmp/a6e95e30-b24c-4137-8b90-b7c949f0c456/source_config.json default/source-s3-check-751-1-yjicd:/config/source_config.json -c init 2022-08-25 09:47:18 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):268 - Waiting for kubectl cp to complete 2022-08-25 09:47:19 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):282 - kubectl cp complete, closing process 2022-08-25 09:47:19 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):257 - Uploading file: FINISHED_UPLOADING 2022-08-25 09:47:19 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp /tmp/63acd67b-ddbb-4bb9-a75e-c2db934ea2f7/FINISHED_UPLOADING default/source-s3-check-751-1-yjicd:/config/FINISHED_UPLOADING -c init 2022-08-25 09:47:19 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):268 - Waiting for kubectl cp to complete 2022-08-25 09:47:19 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):282 - kubectl cp complete, closing process 2022-08-25 09:47:19 INFO i.a.w.p.KubePodProcess():552 - Waiting until pod is ready... 2022-08-25 09:47:20 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):596 - Setting stdout... 2022-08-25 09:47:20 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):608 - Setting stderr... 2022-08-25 09:47:21 INFO i.a.w.p.KubePodProcess():568 - Reading pod IP... 2022-08-25 09:47:21 INFO i.a.w.p.KubePodProcess():570 - Pod IP: 192.168.66.166 2022-08-25 09:47:21 INFO i.a.w.p.KubePodProcess():577 - Using null stdin output stream... 2022-08-25 09:47:21 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):99 - initialised stream with format: 2022-08-25 09:47:21 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):99 - initialised stream with format: {'encoding': 'utf8', 'filetype': 'csv', 'delimiter': ',', 'block_size': 10000, 'quote_char': '"', 'escape_char': '\\', 'double_quote': True, 'infer_datatypes': True, 'advanced_options': '{}', 'newlines_in_values': True, 'additional_reader_options': '{}'} 2022-08-25 09:47:21 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):99 - Iterating S3 bucket 'kintaro-activepipe' 2022-08-25 09:47:21 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):99 - Check succeeded 2022-08-25 09:47:23 INFO i.a.w.p.KubePodProcess(close):717 - (pod: default / source-s3-check-751-1-yjicd) - Closed all resources for pod 2022-08-25 09:47:23 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-08-25 09:47:23 INFO i.a.w.t.TemporalAttemptExecution(get):107 - Cloud storage job log path: /workspace/751/1/logs.log 2022-08-25 09:47:23 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.41-alpha 2022-08-25 09:47:23 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = destination-postgres-check-751-1-nnvqy for airbyte/destination-postgres:0.3.21 2022-08-25 09:47:23 INFO i.a.w.p.KubeProcessFactory(create):103 - destination-postgres-check-751-1-nnvqy stdoutLocalPort = 9004 2022-08-25 09:47:23 INFO i.a.w.p.KubeProcessFactory(create):106 - destination-postgres-check-751-1-nnvqy stderrLocalPort = 9005 2022-08-25 09:47:23 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):587 - Creating stdout socket server... 2022-08-25 09:47:23 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):605 - Creating stderr socket server... 2022-08-25 09:47:23 INFO i.a.w.p.KubePodProcess():518 - Creating pod destination-postgres-check-751-1-nnvqy... 2022-08-25 09:47:23 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):308 - Waiting for init container to be ready before copying files... 2022-08-25 09:47:23 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):312 - Init container present.. 2022-08-25 09:47:24 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):315 - Init container ready.. 2022-08-25 09:47:24 INFO i.a.w.p.KubePodProcess():549 - Copying files... 2022-08-25 09:47:24 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):257 - Uploading file: source_config.json 2022-08-25 09:47:24 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp /tmp/040c1f7e-1672-4e5d-a879-8212c1127764/source_config.json default/destination-postgres-check-751-1-nnvqy:/config/source_config.json -c init 2022-08-25 09:47:24 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):268 - Waiting for kubectl cp to complete 2022-08-25 09:47:24 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):282 - kubectl cp complete, closing process 2022-08-25 09:47:24 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):257 - Uploading file: FINISHED_UPLOADING 2022-08-25 09:47:24 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp /tmp/d5a5f180-d258-4bcb-b361-12e27d9ef82a/FINISHED_UPLOADING default/destination-postgres-check-751-1-nnvqy:/config/FINISHED_UPLOADING -c init 2022-08-25 09:47:24 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):268 - Waiting for kubectl cp to complete 2022-08-25 09:47:25 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):282 - kubectl cp complete, closing process 2022-08-25 09:47:25 INFO i.a.w.p.KubePodProcess():552 - Waiting until pod is ready... 2022-08-25 09:47:26 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):596 - Setting stdout... 2022-08-25 09:47:26 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):608 - Setting stderr... 2022-08-25 09:47:27 INFO i.a.w.p.KubePodProcess():568 - Reading pod IP... 2022-08-25 09:47:27 INFO i.a.w.p.KubePodProcess():570 - Pod IP: 192.168.73.211 2022-08-25 09:47:27 INFO i.a.w.p.KubePodProcess():577 - Using null stdin output stream... 2022-08-25 09:47:27 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:47:27 INFO i.a.i.d.p.PostgresDestination(main):90 - starting destination: class io.airbyte.integrations.destination.postgres.PostgresDestination 2022-08-25 09:47:27 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:47:27 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-08-25 09:47:27 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:47:27 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2022-08-25 09:47:27 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:47:27 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK 2022-08-25 09:47:27 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:47:27 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-08-25 09:47:27 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:47:27 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:47:27 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:47:27 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:47:27 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:47:27 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:47:27 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:47:27 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:47:27 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings. 2022-08-25 09:47:27 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:47:27 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:47:27 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:47:27 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:47:27 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-08-25 09:47:27 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-08-25 09:47:27 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:47:27 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2022-08-25 09:47:27 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:47:27 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2022-08-25 09:47:27 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:47:27 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2022-08-25 09:47:28 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:47:28 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated... 2022-08-25 09:47:28 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:47:28 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed. 2022-08-25 09:47:28 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:47:28 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2022-08-25 09:47:28 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:47:28 INFO i.a.i.d.p.PostgresDestination(main):92 - completed destination: class io.airbyte.integrations.destination.postgres.PostgresDestination 2022-08-25 09:47:29 INFO i.a.w.p.KubePodProcess(close):717 - (pod: default / destination-postgres-check-751-1-nnvqy) - Closed all resources for pod 2022-08-25 09:47:29 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-08-25 09:47:29 INFO i.a.w.t.TemporalAttemptExecution(get):107 - Cloud storage job log path: /workspace/751/1/logs.log 2022-08-25 09:47:29 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.41-alpha 2022-08-25 09:47:29 INFO i.a.w.t.s.LauncherWorker(lambda$run$3):142 - Creating orchestrator-repl-job-751-attempt-1 for attempt number: 1 2022-08-25 09:47:29 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):214 - Successfully deleted all running pods for the connection! 2022-08-25 09:47:29 INFO i.a.w.p.AsyncOrchestratorPodProcess(create):318 - Waiting for pod to be running... 2022-08-25 09:47:30 INFO i.a.w.p.AsyncOrchestratorPodProcess(create):341 - Pod default/orchestrator-repl-job-751-attempt-1 is running on 192.168.88.10 2022-08-25 09:47:30 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: envMap.json 2022-08-25 09:47:30 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/2d591730-7363-4430-a3e4-0f155e237ed7/envMap.json default/orchestrator-repl-job-751-attempt-1:/config/envMap.json -c main 2022-08-25 09:47:30 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:47:31 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:47:31 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: application.txt 2022-08-25 09:47:31 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/c0b3f1f6-46a5-47fe-8c67-9052b4eb15be/application.txt default/orchestrator-repl-job-751-attempt-1:/config/application.txt -c main 2022-08-25 09:47:31 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:47:31 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:47:31 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: jobRunConfig.json 2022-08-25 09:47:31 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/57119919-f093-43c2-9993-7f8f95148c0e/jobRunConfig.json default/orchestrator-repl-job-751-attempt-1:/config/jobRunConfig.json -c main 2022-08-25 09:47:31 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:47:32 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:47:32 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: destinationLauncherConfig.json 2022-08-25 09:47:32 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/f5339053-c733-41a1-a234-107fd042d3dd/destinationLauncherConfig.json default/orchestrator-repl-job-751-attempt-1:/config/destinationLauncherConfig.json -c main 2022-08-25 09:47:32 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:47:32 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:47:32 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: sourceLauncherConfig.json 2022-08-25 09:47:32 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/fc4ae174-d5c9-4cb8-9de8-0dbdea75c1b5/sourceLauncherConfig.json default/orchestrator-repl-job-751-attempt-1:/config/sourceLauncherConfig.json -c main 2022-08-25 09:47:32 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:47:32 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:47:32 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: input.json 2022-08-25 09:47:32 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/e336b37d-af09-4fcb-984b-0da6715fc34f/input.json default/orchestrator-repl-job-751-attempt-1:/config/input.json -c main 2022-08-25 09:47:32 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:47:33 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:47:33 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: KUBE_POD_INFO 2022-08-25 09:47:33 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/67b7376d-9706-4c45-bbab-01ab9b8ab768/KUBE_POD_INFO default/orchestrator-repl-job-751-attempt-1:/config/KUBE_POD_INFO -c main 2022-08-25 09:47:33 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:47:33 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:47:33 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: FINISHED_UPLOADING 2022-08-25 09:47:33 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/61112f40-869c-48f6-8df3-c7b0aee0cbb4/FINISHED_UPLOADING default/orchestrator-repl-job-751-attempt-1:/config/FINISHED_UPLOADING -c main 2022-08-25 09:47:33 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:47:34 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:47:36 replication-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_CPU_REQUEST: 'null' 2022-08-25 09:47:36 replication-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_CPU_LIMIT: 'null' 2022-08-25 09:47:36 replication-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_REQUEST: 'null' 2022-08-25 09:47:36 replication-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_LIMIT: 'null' 2022-08-25 09:47:36 replication-orchestrator > Using default value for environment variable JOB_KUBE_TOLERATIONS: '' 2022-08-25 09:47:36 replication-orchestrator > Using default value for environment variable JOB_KUBE_NODE_SELECTORS: '' 2022-08-25 09:47:36 replication-orchestrator > Using default value for environment variable JOB_KUBE_ANNOTATIONS: '' 2022-08-25 09:47:36 replication-orchestrator > Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_SECRET: '' 2022-08-25 09:47:36 replication-orchestrator > Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-08-25 09:47:36 replication-orchestrator > Using default value for environment variable JOB_KUBE_SIDECAR_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-08-25 09:47:36 replication-orchestrator > Using default value for environment variable JOB_KUBE_SOCAT_IMAGE: 'alpine/socat:1.7.4.3-r0' 2022-08-25 09:47:36 replication-orchestrator > Using default value for environment variable JOB_KUBE_BUSYBOX_IMAGE: 'busybox:1.28' 2022-08-25 09:47:36 replication-orchestrator > Using default value for environment variable JOB_KUBE_CURL_IMAGE: 'curlimages/curl:7.83.1' 2022-08-25 09:47:36 replication-orchestrator > Using default value for environment variable DEPLOYMENT_MODE: 'OSS' 2022-08-25 09:47:36 replication-orchestrator > Using Kubernetes namespace: default 2022-08-25 09:47:36 replication-orchestrator > Logging initialized @6215ms to org.eclipse.jetty.util.log.Slf4jLog 2022-08-25 09:47:36 replication-orchestrator > jetty-9.4.31.v20200723; built: 2020-07-23T17:57:36.812Z; git: 450ba27947e13e66baa8cd1ce7e85a4461cacc1d; jvm 19-ea+32-2220 2022-08-25 09:47:36 replication-orchestrator > Started o.e.j.s.ServletContextHandler@39666e42{/,null,AVAILABLE} 2022-08-25 09:47:36 replication-orchestrator > Started ServerConnector@daf22f0{HTTP/1.1, (http/1.1)}{0.0.0.0:9000} 2022-08-25 09:47:36 replication-orchestrator > Started @6416ms 2022-08-25 09:47:36 replication-orchestrator > Writing async status RUNNING for KubePodInfo[namespace=default, name=orchestrator-repl-job-751-attempt-1]... 2022-08-25 09:47:36 replication-orchestrator > Setting up source launcher... 2022-08-25 09:47:36 replication-orchestrator > Setting up destination launcher... 2022-08-25 09:47:36 replication-orchestrator > Setting up source... 2022-08-25 09:47:37 replication-orchestrator > Setting up replication worker... 2022-08-25 09:47:37 replication-orchestrator > Running replication worker... 2022-08-25 09:47:37 replication-orchestrator > start sync worker. job id: 751 attempt id: 1 2022-08-25 09:47:37 replication-orchestrator > configured sync modes: {null.s3_user_reports=incremental - append} 2022-08-25 09:47:37 replication-orchestrator > Running destination... 2022-08-25 09:47:37 replication-orchestrator > Attempting to start pod = destination-postgres-write-751-1-mnfkr for airbyte/destination-postgres:0.3.21 2022-08-25 09:47:37 replication-orchestrator > destination-postgres-write-751-1-mnfkr stdoutLocalPort = 9880 2022-08-25 09:47:37 replication-orchestrator > destination-postgres-write-751-1-mnfkr stderrLocalPort = 9879 2022-08-25 09:47:37 replication-orchestrator > Creating stdout socket server... 2022-08-25 09:47:37 replication-orchestrator > Creating stderr socket server... 2022-08-25 09:47:37 replication-orchestrator > Creating pod destination-postgres-write-751-1-mnfkr... 2022-08-25 09:47:38 replication-orchestrator > Waiting for init container to be ready before copying files... 2022-08-25 09:47:38 replication-orchestrator > Init container present.. 2022-08-25 09:47:39 replication-orchestrator > Init container ready.. 2022-08-25 09:47:39 replication-orchestrator > Copying files... 2022-08-25 09:47:39 replication-orchestrator > Uploading file: destination_config.json 2022-08-25 09:47:39 replication-orchestrator > kubectl cp /tmp/f7f2190a-ba31-4a7f-88be-a611dde0d7b8/destination_config.json default/destination-postgres-write-751-1-mnfkr:/config/destination_config.json -c init 2022-08-25 09:47:39 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:47:40 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:47:40 replication-orchestrator > Uploading file: destination_catalog.json 2022-08-25 09:47:40 replication-orchestrator > kubectl cp /tmp/331699b6-2c39-4dda-ba75-18c78099db66/destination_catalog.json default/destination-postgres-write-751-1-mnfkr:/config/destination_catalog.json -c init 2022-08-25 09:47:40 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:47:40 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:47:40 replication-orchestrator > Uploading file: FINISHED_UPLOADING 2022-08-25 09:47:40 replication-orchestrator > kubectl cp /tmp/538dabe0-e6d8-4f68-86ad-b2b40ed1e732/FINISHED_UPLOADING default/destination-postgres-write-751-1-mnfkr:/config/FINISHED_UPLOADING -c init 2022-08-25 09:47:40 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:47:40 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:47:40 replication-orchestrator > Waiting until pod is ready... 2022-08-25 09:47:42 replication-orchestrator > Setting stdout... 2022-08-25 09:47:42 replication-orchestrator > Setting stderr... 2022-08-25 09:47:44 replication-orchestrator > MetricClient has not been initialized. Must call MetricClientFactory.CreateMetricClient before using MetricClient. Using a dummy client for now. Ignore this if Airbyte is configured to not publish any metrics. 2022-08-25 09:47:44 replication-orchestrator > Reading pod IP... 2022-08-25 09:47:44 replication-orchestrator > Pod IP: 192.168.82.211 2022-08-25 09:47:44 replication-orchestrator > Creating stdin socket... 2022-08-25 09:47:44 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-08-25 09:47:44 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:47:44 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:47:44 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:47:44 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:47:44 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-08-25 09:47:44 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-08-25 09:47:44 replication-orchestrator > Attempting to start pod = source-s3-read-751-1-hutdw for airbyte/source-s3:0.1.17 2022-08-25 09:47:44 replication-orchestrator > source-s3-read-751-1-hutdw stdoutLocalPort = 9878 2022-08-25 09:47:44 replication-orchestrator > source-s3-read-751-1-hutdw stderrLocalPort = 9877 2022-08-25 09:47:44 replication-orchestrator > Creating stderr socket server... 2022-08-25 09:47:44 replication-orchestrator > Creating pod source-s3-read-751-1-hutdw... 2022-08-25 09:47:44 replication-orchestrator > Creating stdout socket server... 2022-08-25 09:47:44 replication-orchestrator > Waiting for init container to be ready before copying files... 2022-08-25 09:47:44 replication-orchestrator > Init container present.. 2022-08-25 09:47:45 replication-orchestrator > Init container ready.. 2022-08-25 09:47:45 replication-orchestrator > Copying files... 2022-08-25 09:47:45 replication-orchestrator > Uploading file: input_state.json 2022-08-25 09:47:45 replication-orchestrator > kubectl cp /tmp/d263b573-e425-4694-b9e0-0f6e8546e9d2/input_state.json default/source-s3-read-751-1-hutdw:/config/input_state.json -c init 2022-08-25 09:47:45 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:47:46 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:47:46 replication-orchestrator > Uploading file: source_config.json 2022-08-25 09:47:46 replication-orchestrator > kubectl cp /tmp/c4f54976-8ac1-413f-a147-723bfff68ba2/source_config.json default/source-s3-read-751-1-hutdw:/config/source_config.json -c init 2022-08-25 09:47:46 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:47:46 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:47:46 replication-orchestrator > Uploading file: source_catalog.json 2022-08-25 09:47:46 replication-orchestrator > kubectl cp /tmp/cb76a786-800f-4867-ab81-14ddc12acb90/source_catalog.json default/source-s3-read-751-1-hutdw:/config/source_catalog.json -c init 2022-08-25 09:47:46 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:47:46 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:47:46 replication-orchestrator > Uploading file: FINISHED_UPLOADING 2022-08-25 09:47:46 replication-orchestrator > kubectl cp /tmp/6fc2fe15-2f34-4638-aab1-23058cec3e4e/FINISHED_UPLOADING default/source-s3-read-751-1-hutdw:/config/FINISHED_UPLOADING -c init 2022-08-25 09:47:46 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:47:46 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:47:46 replication-orchestrator > Waiting until pod is ready... 2022-08-25 09:47:48 replication-orchestrator > Setting stdout... 2022-08-25 09:47:48 replication-orchestrator > Setting stderr... 2022-08-25 09:47:49 replication-orchestrator > MetricClient has not been initialized. Must call MetricClientFactory.CreateMetricClient before using MetricClient. Using a dummy client for now. Ignore this if Airbyte is configured to not publish any metrics. 2022-08-25 09:47:49 replication-orchestrator > Reading pod IP... 2022-08-25 09:47:49 replication-orchestrator > Pod IP: 192.168.63.118 2022-08-25 09:47:49 replication-orchestrator > Using null stdin output stream... 2022-08-25 09:47:49 replication-orchestrator > Destination output thread started. 2022-08-25 09:47:49 destination > 2022-08-25 09:47:44 INFO i.a.i.d.p.PostgresDestination(main):90 - starting destination: class io.airbyte.integrations.destination.postgres.PostgresDestination 2022-08-25 09:47:49 destination > 2022-08-25 09:47:44 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-08-25 09:47:49 destination > 2022-08-25 09:47:44 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2022-08-25 09:47:49 destination > 2022-08-25 09:47:44 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE 2022-08-25 09:47:49 destination > 2022-08-25 09:47:44 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-08-25 09:47:49 replication-orchestrator > Waiting for source and destination threads to complete. 2022-08-25 09:47:49 destination > 2022-08-25 09:47:44 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:47:49 destination > 2022-08-25 09:47:44 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:47:49 replication-orchestrator > Replication thread started. 2022-08-25 09:47:49 destination > 2022-08-25 09:47:44 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:47:49 destination > 2022-08-25 09:47:44 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:47:49 destination > 2022-08-25 09:47:44 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2022-08-25 09:47:49 destination > 2022-08-25 09:47:44 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2022-08-25 09:47:49 destination > 2022-08-25 09:47:44 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2022-08-25 09:47:49 destination > 2022-08-25 09:47:44 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):97 - Write config: WriteConfig{streamName=s3_user_reports, namespace=null, outputSchemaName=airbyte, tmpTableName=_airbyte_tmp_zfl_s3_user_reports, outputTableName=_airbyte_raw_s3_user_reports, syncMode=append} 2022-08-25 09:47:49 destination > 2022-08-25 09:47:44 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2022-08-25 09:47:49 destination > 2022-08-25 09:47:44 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):122 - Preparing tmp tables in destination started for 1 streams 2022-08-25 09:47:49 destination > 2022-08-25 09:47:44 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):126 - Preparing tmp table in destination started for stream s3_user_reports. schema: airbyte, tmp table name: _airbyte_tmp_zfl_s3_user_reports 2022-08-25 09:47:49 destination > 2022-08-25 09:47:45 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):132 - Preparing tables in destination completed. 2022-08-25 09:47:49 replication-orchestrator > Unknown keyword existingJavaType - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:47:49 source > initialised stream with format: 2022-08-25 09:47:49 source > Starting syncing SourceS3 2022-08-25 09:47:49 source > initialised stream with format: {'encoding': 'utf8', 'filetype': 'csv', 'delimiter': ',', 'block_size': 10000, 'quote_char': '"', 'escape_char': '\\', 'double_quote': True, 'infer_datatypes': True, 'advanced_options': '{}', 'newlines_in_values': True, 'additional_reader_options': '{}'} 2022-08-25 09:47:49 source > Syncing stream: s3_user_reports 2022-08-25 09:47:49 source > Iterating S3 bucket 'kintaro-activepipe' 2022-08-25 09:48:11 source > determined master schema: {'User ID': 'integer', 'Office': 'string', 'Agent Name': 'string', 'Status': 'string', 'Email': 'string', 'Title': 'string', 'Contacts': 'integer', 'Shared Contacts': 'integer', 'Sents': 'integer', 'Opens': 'integer', 'Clicks': 'integer', 'Total Sends': 'integer', 'Sends Last 30 days': 'integer', 'Last Sent': 'string', 'Last Login': 'string'} 2022-08-25 09:48:11 source > finished reading a stream slice 2022-08-25 09:48:12 replication-orchestrator > Records read: 1000 (480 KB) 2022-08-25 09:48:12 source > finished reading a stream slice 2022-08-25 09:48:12 source > finished reading a stream slice 2022-08-25 09:48:13 replication-orchestrator > Records read: 2000 (959 KB) 2022-08-25 09:48:13 source > finished reading a stream slice 2022-08-25 09:48:13 source > finished reading a stream slice 2022-08-25 09:48:13 replication-orchestrator > Records read: 3000 (1 MB) 2022-08-25 09:48:13 source > finished reading a stream slice 2022-08-25 09:48:14 source > finished reading a stream slice 2022-08-25 09:48:14 replication-orchestrator > Records read: 4000 (1 MB) 2022-08-25 09:48:14 source > finished reading a stream slice 2022-08-25 09:48:14 source > finished reading a stream slice 2022-08-25 09:48:15 replication-orchestrator > Records read: 5000 (2 MB) 2022-08-25 09:48:15 source > finished reading a stream slice 2022-08-25 09:48:15 source > finished reading a stream slice 2022-08-25 09:48:15 replication-orchestrator > Records read: 6000 (2 MB) 2022-08-25 09:48:15 source > finished reading a stream slice 2022-08-25 09:48:16 source > finished reading a stream slice 2022-08-25 09:48:16 replication-orchestrator > Records read: 7000 (3 MB) 2022-08-25 09:48:16 source > finished reading a stream slice 2022-08-25 09:48:17 source > finished reading a stream slice 2022-08-25 09:48:17 replication-orchestrator > Records read: 8000 (3 MB) 2022-08-25 09:48:17 source > finished reading a stream slice 2022-08-25 09:48:17 source > finished reading a stream slice 2022-08-25 09:48:17 replication-orchestrator > Records read: 9000 (4 MB) 2022-08-25 09:48:18 source > finished reading a stream slice 2022-08-25 09:48:18 source > finished reading a stream slice 2022-08-25 09:48:18 replication-orchestrator > Records read: 10000 (4 MB) 2022-08-25 09:48:18 source > finished reading a stream slice 2022-08-25 09:48:19 source > finished reading a stream slice 2022-08-25 09:48:19 replication-orchestrator > Records read: 11000 (5 MB) 2022-08-25 09:48:19 source > finished reading a stream slice 2022-08-25 09:48:19 source > finished reading a stream slice 2022-08-25 09:48:19 replication-orchestrator > Records read: 12000 (5 MB) 2022-08-25 09:48:20 source > finished reading a stream slice 2022-08-25 09:48:20 source > finished reading a stream slice 2022-08-25 09:48:20 replication-orchestrator > Records read: 13000 (6 MB) 2022-08-25 09:48:20 destination > 2022-08-25 09:48:20 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing s3_user_reports: 13337 records (24 MB) 2022-08-25 09:48:21 source > finished reading a stream slice 2022-08-25 09:48:21 replication-orchestrator > Records read: 14000 (6 MB) 2022-08-25 09:48:21 source > finished reading a stream slice 2022-08-25 09:48:21 source > finished reading a stream slice 2022-08-25 09:48:22 replication-orchestrator > Records read: 15000 (7 MB) 2022-08-25 09:48:22 source > finished reading a stream slice 2022-08-25 09:48:22 source > finished reading a stream slice 2022-08-25 09:48:22 replication-orchestrator > Records read: 16000 (7 MB) 2022-08-25 09:48:22 source > finished reading a stream slice 2022-08-25 09:48:23 source > finished reading a stream slice 2022-08-25 09:48:23 replication-orchestrator > Records read: 17000 (7 MB) 2022-08-25 09:48:23 source > finished reading a stream slice 2022-08-25 09:48:24 source > finished reading a stream slice 2022-08-25 09:48:24 replication-orchestrator > Records read: 18000 (8 MB) 2022-08-25 09:48:24 source > finished reading a stream slice 2022-08-25 09:48:24 source > finished reading a stream slice 2022-08-25 09:48:24 replication-orchestrator > Records read: 19000 (8 MB) 2022-08-25 09:48:25 source > finished reading a stream slice 2022-08-25 09:48:25 source > finished reading a stream slice 2022-08-25 09:48:25 replication-orchestrator > Records read: 20000 (9 MB) 2022-08-25 09:48:25 source > finished reading a stream slice 2022-08-25 09:48:26 source > finished reading a stream slice 2022-08-25 09:48:26 replication-orchestrator > Records read: 21000 (9 MB) 2022-08-25 09:48:26 source > finished reading a stream slice 2022-08-25 09:48:27 source > finished reading a stream slice 2022-08-25 09:48:27 replication-orchestrator > Records read: 22000 (10 MB) 2022-08-25 09:48:27 source > finished reading a stream slice 2022-08-25 09:48:27 source > finished reading a stream slice 2022-08-25 09:48:27 replication-orchestrator > Records read: 23000 (10 MB) 2022-08-25 09:48:28 source > finished reading a stream slice 2022-08-25 09:48:28 source > finished reading a stream slice 2022-08-25 09:48:28 replication-orchestrator > Records read: 24000 (11 MB) 2022-08-25 09:48:29 source > finished reading a stream slice 2022-08-25 09:48:29 source > finished reading a stream slice 2022-08-25 09:48:29 replication-orchestrator > Records read: 25000 (11 MB) 2022-08-25 09:48:29 source > finished reading a stream slice 2022-08-25 09:48:29 replication-orchestrator > Records read: 26000 (12 MB) 2022-08-25 09:48:30 source > finished reading a stream slice 2022-08-25 09:48:30 source > finished reading a stream slice 2022-08-25 09:48:30 destination > 2022-08-25 09:48:30 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing s3_user_reports: 13291 records (24 MB) 2022-08-25 09:48:30 replication-orchestrator > Records read: 27000 (12 MB) 2022-08-25 09:48:30 source > finished reading a stream slice 2022-08-25 09:48:31 source > finished reading a stream slice 2022-08-25 09:48:31 replication-orchestrator > Records read: 28000 (13 MB) 2022-08-25 09:48:31 source > finished reading a stream slice 2022-08-25 09:48:31 source > finished reading a stream slice 2022-08-25 09:48:32 replication-orchestrator > Records read: 29000 (13 MB) 2022-08-25 09:48:32 source > finished reading a stream slice 2022-08-25 09:48:32 source > finished reading a stream slice 2022-08-25 09:48:32 replication-orchestrator > Records read: 30000 (14 MB) 2022-08-25 09:48:32 source > finished reading a stream slice 2022-08-25 09:48:33 source > finished reading a stream slice 2022-08-25 09:48:33 replication-orchestrator > Records read: 31000 (14 MB) 2022-08-25 09:48:33 source > finished reading a stream slice 2022-08-25 09:48:34 source > finished reading a stream slice 2022-08-25 09:48:34 replication-orchestrator > Records read: 32000 (14 MB) 2022-08-25 09:48:34 source > finished reading a stream slice 2022-08-25 09:48:34 source > finished reading a stream slice 2022-08-25 09:48:34 replication-orchestrator > Records read: 33000 (15 MB) 2022-08-25 09:48:35 source > finished reading a stream slice 2022-08-25 09:48:35 source > finished reading a stream slice 2022-08-25 09:48:35 replication-orchestrator > Records read: 34000 (15 MB) 2022-08-25 09:48:36 source > finished reading a stream slice 2022-08-25 09:48:36 source > finished reading a stream slice 2022-08-25 09:48:36 replication-orchestrator > Records read: 35000 (16 MB) 2022-08-25 09:48:36 source > finished reading a stream slice 2022-08-25 09:48:37 source > finished reading a stream slice 2022-08-25 09:48:37 replication-orchestrator > Records read: 36000 (16 MB) 2022-08-25 09:48:37 source > finished reading a stream slice 2022-08-25 09:48:37 replication-orchestrator > Records read: 37000 (17 MB) 2022-08-25 09:48:37 source > finished reading a stream slice 2022-08-25 09:48:38 source > finished reading a stream slice 2022-08-25 09:48:38 replication-orchestrator > Records read: 38000 (17 MB) 2022-08-25 09:48:38 source > finished reading a stream slice 2022-08-25 09:48:38 source > finished reading a stream slice 2022-08-25 09:48:39 replication-orchestrator > Records read: 39000 (18 MB) 2022-08-25 09:48:39 source > finished reading a stream slice 2022-08-25 09:48:39 source > finished reading a stream slice 2022-08-25 09:48:39 replication-orchestrator > Records read: 40000 (18 MB) 2022-08-25 09:48:39 destination > 2022-08-25 09:48:39 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing s3_user_reports: 13321 records (24 MB) 2022-08-25 09:48:40 source > finished reading a stream slice 2022-08-25 09:48:40 source > finished reading a stream slice 2022-08-25 09:48:40 replication-orchestrator > Records read: 41000 (19 MB) 2022-08-25 09:48:40 source > finished reading a stream slice 2022-08-25 09:48:41 source > finished reading a stream slice 2022-08-25 09:48:41 replication-orchestrator > Records read: 42000 (19 MB) 2022-08-25 09:48:41 source > finished reading a stream slice 2022-08-25 09:48:41 source > finished reading a stream slice 2022-08-25 09:48:41 replication-orchestrator > Records read: 43000 (20 MB) 2022-08-25 09:48:42 source > finished reading a stream slice 2022-08-25 09:48:42 source > finished reading a stream slice 2022-08-25 09:48:42 replication-orchestrator > Records read: 44000 (20 MB) 2022-08-25 09:48:43 source > finished reading a stream slice 2022-08-25 09:48:43 source > finished reading a stream slice 2022-08-25 09:48:43 replication-orchestrator > Records read: 45000 (21 MB) 2022-08-25 09:48:43 source > finished reading a stream slice 2022-08-25 09:48:44 source > finished reading a stream slice 2022-08-25 09:48:44 replication-orchestrator > Records read: 46000 (21 MB) 2022-08-25 09:48:44 source > finished reading a stream slice 2022-08-25 09:48:44 replication-orchestrator > Records read: 47000 (21 MB) 2022-08-25 09:48:45 source > finished reading a stream slice 2022-08-25 09:48:45 source > finished reading a stream slice 2022-08-25 09:48:45 replication-orchestrator > Records read: 48000 (22 MB) 2022-08-25 09:48:45 source > finished reading a stream slice 2022-08-25 09:48:46 source > finished reading a stream slice 2022-08-25 09:48:46 replication-orchestrator > Records read: 49000 (22 MB) 2022-08-25 09:48:46 source > finished reading a stream slice 2022-08-25 09:48:46 source > Read 49074 records from s3_user_reports stream 2022-08-25 09:48:46 source > Finished syncing s3_user_reports 2022-08-25 09:48:46 source > SourceS3 runtimes: Syncing stream s3_user_reports 0:00:56.790934 2022-08-25 09:48:46 source > Finished syncing SourceS3 2022-08-25 09:48:46 replication-orchestrator > Source has no more messages, closing connection. 2022-08-25 09:48:47 replication-orchestrator > (pod: default / source-s3-read-751-1-hutdw) - Closed all resources for pod 2022-08-25 09:48:47 replication-orchestrator > Total records read: 49168 (23 MB) 2022-08-25 09:48:47 replication-orchestrator > One of source or destination thread complete. Waiting on the other. 2022-08-25 09:48:47 destination > 2022-08-25 09:48:47 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2022-08-25 09:48:47 destination > 2022-08-25 09:48:47 INFO i.a.i.d.b.BufferedStreamConsumer(close):171 - executing on success close procedure. 2022-08-25 09:48:47 destination > 2022-08-25 09:48:47 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing s3_user_reports: 9125 records (17 MB) 2022-08-25 09:48:47 destination > 2022-08-25 09:48:47 INFO i.a.i.d.j.SqlOperations(onDestinationCloseOperations):137 - No onDestinationCloseOperations required for this destination. 2022-08-25 09:48:47 destination > 2022-08-25 09:48:47 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):162 - Finalizing tables in destination started for 1 streams 2022-08-25 09:48:47 destination > 2022-08-25 09:48:47 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):167 - Finalizing stream s3_user_reports. schema airbyte, tmp table _airbyte_tmp_zfl_s3_user_reports, final table _airbyte_raw_s3_user_reports 2022-08-25 09:48:47 destination > 2022-08-25 09:48:47 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):180 - Executing finalization of tables. 2022-08-25 09:48:48 destination > 2022-08-25 09:48:48 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):182 - Finalizing tables in destination completed. 2022-08-25 09:48:48 destination > 2022-08-25 09:48:48 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):185 - Cleaning tmp tables in destination started for 1 streams 2022-08-25 09:48:48 destination > 2022-08-25 09:48:48 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):189 - Cleaning tmp table in destination started for stream s3_user_reports. schema airbyte, tmp table name: _airbyte_tmp_zfl_s3_user_reports 2022-08-25 09:48:48 destination > 2022-08-25 09:48:48 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):194 - Cleaning tmp tables in destination completed. 2022-08-25 09:48:48 replication-orchestrator > State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@33086833[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@56343f87[type=,stream=,global=,data={"s3_user_reports":{"_ab_source_file_last_modified":"2022-08-25T09:00:46+0000","schema":{"User ID":"integer","Office":"string","Agent Name":"string","Status":"string","Email":"string","Title":"string","Contacts":"integer","Shared Contacts":"integer","Sents":"integer","Opens":"integer","Clicks":"integer","Total Sends":"integer","Sends Last 30 days":"integer","Last Sent":"string","Last Login":"string","_ab_additional_properties":"object","_ab_source_file_last_modified":"string","_ab_source_file_url":"string"},"history":{"2022-08-22":["20220822_williampitt_activepipe_user_reports.csv"],"2022-08-23":["20220823_williampitt_activepipe_user_reports.csv"],"2022-08-24":["20220824_williampitt_activepipe_user_reports.csv"],"2022-08-25":["20220825_williampitt_activepipe_user_reports.csv"]}}},additionalProperties={}],trace=,additionalProperties={}] 2022-08-25 09:48:48 destination > 2022-08-25 09:48:48 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2022-08-25 09:48:48 destination > 2022-08-25 09:48:48 INFO i.a.i.d.p.PostgresDestination(main):92 - completed destination: class io.airbyte.integrations.destination.postgres.PostgresDestination 2022-08-25 09:48:49 replication-orchestrator > (pod: default / destination-postgres-write-751-1-mnfkr) - Closed all resources for pod 2022-08-25 09:48:49 replication-orchestrator > Source and destination threads complete. 2022-08-25 09:48:49 replication-orchestrator > sync summary: io.airbyte.config.ReplicationAttemptSummary@2d4fb0d8[status=completed,recordsSynced=49074,bytesSynced=24123540,startTime=1661420857423,endTime=1661420929447,totalStats=io.airbyte.config.SyncStats@dc1fadd[recordsEmitted=49074,bytesEmitted=24123540,stateMessagesEmitted=94,recordsCommitted=49074],streamStats=[io.airbyte.config.StreamSyncStats@3ef3f661[streamName=s3_user_reports,stats=io.airbyte.config.SyncStats@baa9ce4[recordsEmitted=49074,bytesEmitted=24123540,stateMessagesEmitted=,recordsCommitted=49074]]]] 2022-08-25 09:48:49 replication-orchestrator > Source output at least one state message 2022-08-25 09:48:49 replication-orchestrator > State capture: Updated state to: Optional[io.airbyte.config.State@45b7c97f[state={"s3_user_reports":{"_ab_source_file_last_modified":"2022-08-25T09:00:46+0000","schema":{"User ID":"integer","Office":"string","Agent Name":"string","Status":"string","Email":"string","Title":"string","Contacts":"integer","Shared Contacts":"integer","Sents":"integer","Opens":"integer","Clicks":"integer","Total Sends":"integer","Sends Last 30 days":"integer","Last Sent":"string","Last Login":"string","_ab_additional_properties":"object","_ab_source_file_last_modified":"string","_ab_source_file_url":"string"},"history":{"2022-08-22":["20220822_williampitt_activepipe_user_reports.csv"],"2022-08-23":["20220823_williampitt_activepipe_user_reports.csv"],"2022-08-24":["20220824_williampitt_activepipe_user_reports.csv"],"2022-08-25":["20220825_williampitt_activepipe_user_reports.csv"]}}}]] 2022-08-25 09:48:49 replication-orchestrator > Returning output... 2022-08-25 09:48:49 replication-orchestrator > Writing async status SUCCEEDED for KubePodInfo[namespace=default, name=orchestrator-repl-job-751-attempt-1]... 2022-08-25 09:48:57 normalization-orchestrator > Writing async status INITIALIZING for KubePodInfo[namespace=default, name=orchestrator-norm-job-751-attempt-1]... 2022-08-25 09:48:58 normalization-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_CPU_REQUEST: 'null' 2022-08-25 09:48:58 normalization-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_CPU_LIMIT: 'null' 2022-08-25 09:48:58 normalization-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_REQUEST: 'null' 2022-08-25 09:48:58 normalization-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_LIMIT: 'null' 2022-08-25 09:48:58 normalization-orchestrator > Using default value for environment variable JOB_KUBE_TOLERATIONS: '' 2022-08-25 09:48:58 normalization-orchestrator > Using default value for environment variable JOB_KUBE_NODE_SELECTORS: '' 2022-08-25 09:48:58 normalization-orchestrator > Using default value for environment variable JOB_KUBE_ANNOTATIONS: '' 2022-08-25 09:48:58 normalization-orchestrator > Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_SECRET: '' 2022-08-25 09:48:58 normalization-orchestrator > Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-08-25 09:48:58 normalization-orchestrator > Using default value for environment variable JOB_KUBE_SIDECAR_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-08-25 09:48:58 normalization-orchestrator > Using default value for environment variable JOB_KUBE_SOCAT_IMAGE: 'alpine/socat:1.7.4.3-r0' 2022-08-25 09:48:58 normalization-orchestrator > Using default value for environment variable JOB_KUBE_BUSYBOX_IMAGE: 'busybox:1.28' 2022-08-25 09:48:58 normalization-orchestrator > Using default value for environment variable JOB_KUBE_CURL_IMAGE: 'curlimages/curl:7.83.1' 2022-08-25 09:48:58 normalization-orchestrator > Using default value for environment variable DEPLOYMENT_MODE: 'OSS' 2022-08-25 09:48:58 normalization-orchestrator > Using Kubernetes namespace: default 2022-08-25 09:48:58 normalization-orchestrator > Logging initialized @5631ms to org.eclipse.jetty.util.log.Slf4jLog 2022-08-25 09:48:58 normalization-orchestrator > jetty-9.4.31.v20200723; built: 2020-07-23T17:57:36.812Z; git: 450ba27947e13e66baa8cd1ce7e85a4461cacc1d; jvm 19-ea+32-2220 2022-08-25 09:48:58 normalization-orchestrator > Started o.e.j.s.ServletContextHandler@32f1fafe{/,null,AVAILABLE} 2022-08-25 09:48:58 normalization-orchestrator > Started ServerConnector@2bc7db89{HTTP/1.1, (http/1.1)}{0.0.0.0:9000} 2022-08-25 09:48:58 normalization-orchestrator > Started @5760ms 2022-08-25 09:48:58 normalization-orchestrator > Writing async status RUNNING for KubePodInfo[namespace=default, name=orchestrator-norm-job-751-attempt-1]... 2022-08-25 09:48:58 normalization-orchestrator > Setting up normalization worker... 2022-08-25 09:48:58 normalization-orchestrator > Running normalization worker... 2022-08-25 09:48:58 normalization-orchestrator > Running normalization. 2022-08-25 09:48:58 normalization-orchestrator > Running with normalization version: airbyte/normalization:0.2.12 2022-08-25 09:48:58 normalization-orchestrator > Attempting to start pod = normalization-normalize-751-1-ofncj for airbyte/normalization:0.2.12 2022-08-25 09:48:58 normalization-orchestrator > normalization-normalize-751-1-ofncj stdoutLocalPort = 9880 2022-08-25 09:48:58 normalization-orchestrator > normalization-normalize-751-1-ofncj stderrLocalPort = 9879 2022-08-25 09:48:58 normalization-orchestrator > Creating stdout socket server... 2022-08-25 09:48:58 normalization-orchestrator > Creating stderr socket server... 2022-08-25 09:48:58 normalization-orchestrator > Creating pod normalization-normalize-751-1-ofncj... 2022-08-25 09:48:59 normalization-orchestrator > Waiting for init container to be ready before copying files... 2022-08-25 09:48:59 normalization-orchestrator > Init container present.. 2022-08-25 09:49:00 normalization-orchestrator > Init container ready.. 2022-08-25 09:49:00 normalization-orchestrator > Copying files... 2022-08-25 09:49:00 normalization-orchestrator > Uploading file: destination_config.json 2022-08-25 09:49:00 normalization-orchestrator > kubectl cp /tmp/52ca97e5-2085-47ac-8fc7-d8e7fd8ff7f0/destination_config.json default/normalization-normalize-751-1-ofncj:/config/destination_config.json -c init 2022-08-25 09:49:01 normalization-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:49:01 normalization-orchestrator > kubectl cp complete, closing process 2022-08-25 09:49:01 normalization-orchestrator > Uploading file: destination_catalog.json 2022-08-25 09:49:01 normalization-orchestrator > kubectl cp /tmp/4bea18d1-a013-49fc-b128-669668a5fe86/destination_catalog.json default/normalization-normalize-751-1-ofncj:/config/destination_catalog.json -c init 2022-08-25 09:49:01 normalization-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:49:01 normalization-orchestrator > kubectl cp complete, closing process 2022-08-25 09:49:01 normalization-orchestrator > Uploading file: FINISHED_UPLOADING 2022-08-25 09:49:01 normalization-orchestrator > kubectl cp /tmp/73d6f0d3-cf2b-40f8-9e0c-53fab7ed3776/FINISHED_UPLOADING default/normalization-normalize-751-1-ofncj:/config/FINISHED_UPLOADING -c init 2022-08-25 09:49:01 normalization-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:49:02 normalization-orchestrator > kubectl cp complete, closing process 2022-08-25 09:49:02 normalization-orchestrator > Waiting until pod is ready... 2022-08-25 09:49:03 normalization-orchestrator > Setting stdout... 2022-08-25 09:49:04 normalization-orchestrator > Setting stderr... 2022-08-25 09:49:05 normalization-orchestrator > MetricClient has not been initialized. Must call MetricClientFactory.CreateMetricClient before using MetricClient. Using a dummy client for now. Ignore this if Airbyte is configured to not publish any metrics. 2022-08-25 09:49:05 normalization-orchestrator > Reading pod IP... 2022-08-25 09:49:05 normalization-orchestrator > Pod IP: 192.168.66.166 2022-08-25 09:49:05 normalization-orchestrator > Using null stdin output stream... 2022-08-25 09:49:05 normalization > Running: transform-config --config destination_config.json --integration-type postgres --out /config 2022-08-25 09:49:05 normalization > Namespace(config='destination_config.json', integration_type=, out='/config') 2022-08-25 09:49:05 normalization > transform_postgres 2022-08-25 09:49:05 normalization > Running: transform-catalog --integration-type postgres --profile-config-dir /config --catalog destination_catalog.json --out /config/models/generated/ --json-column _airbyte_data 2022-08-25 09:49:05 normalization > Processing destination_catalog.json... 2022-08-25 09:49:05 normalization > Generating airbyte_ctes/airbyte/s3_user_reports_ab1.sql from s3_user_reports 2022-08-25 09:49:05 normalization > Generating airbyte_ctes/airbyte/s3_user_reports_ab2.sql from s3_user_reports 2022-08-25 09:49:05 normalization > Generating airbyte_ctes/airbyte/s3_user_reports_ab3.sql from s3_user_reports 2022-08-25 09:49:05 normalization > Generating airbyte_incremental/airbyte/s3_user_reports.sql from s3_user_reports 2022-08-25 09:49:05 normalization > detected no config file for ssh, assuming ssh is off. 2022-08-25 09:49:07 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2022-08-25 09:49:07 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2022-08-25 09:49:07 normalization > 2022-08-25 09:49:07 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2022-08-25 09:49:07 normalization > 2022-08-25 09:49:09 normalization > 09:49:09 Running with dbt=1.0.0 2022-08-25 09:49:09 normalization > 09:49:09 Partial parse save file not found. Starting full parse. 2022-08-25 09:49:11 normalization > 09:49:11 [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2022-08-25 09:49:11 normalization > There are 2 unused configuration paths: 2022-08-25 09:49:11 normalization > - models.airbyte_utils.generated.airbyte_tables 2022-08-25 09:49:11 normalization > - models.airbyte_utils.generated.airbyte_views 2022-08-25 09:49:11 normalization > 2022-08-25 09:49:11 normalization > 09:49:11 Found 4 models, 0 tests, 0 snapshots, 0 analyses, 558 macros, 0 operations, 0 seed files, 1 source, 0 exposures, 0 metrics 2022-08-25 09:49:11 normalization > 09:49:11 2022-08-25 09:49:11 normalization > 09:49:11 Concurrency: 8 threads (target='prod') 2022-08-25 09:49:11 normalization > 09:49:11 2022-08-25 09:49:11 normalization > 09:49:11 1 of 1 START incremental model airbyte.s3_user_reports.................................................................. [RUN] 2022-08-25 09:49:13 normalization > 09:49:13 1 of 1 OK created incremental model airbyte.s3_user_reports............................................................. [INSERT 0 49076 in 1.85s] 2022-08-25 09:49:13 normalization > 09:49:13 2022-08-25 09:49:13 normalization > 09:49:13 Finished running 1 incremental model in 2.32s. 2022-08-25 09:49:13 normalization > 09:49:13 2022-08-25 09:49:13 normalization > 09:49:13 Completed successfully 2022-08-25 09:49:13 normalization > 09:49:13 2022-08-25 09:49:13 normalization > 09:49:13 Done. PASS=1 WARN=0 ERROR=0 SKIP=0 TOTAL=1 2022-08-25 09:49:14 normalization-orchestrator > (pod: default / normalization-normalize-751-1-ofncj) - Closed all resources for pod 2022-08-25 09:49:14 normalization-orchestrator > Normalization executed in 15 seconds. 2022-08-25 09:49:14 normalization-orchestrator > Normalization summary: io.airbyte.config.NormalizationSummary@6206b4a7[startTime=1661420938909,endTime=1661420954733] 2022-08-25 09:49:14 normalization-orchestrator > Writing async status SUCCEEDED for KubePodInfo[namespace=default, name=orchestrator-norm-job-751-attempt-1]... 2022-08-25 09:48:49 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):322 - Stopping temporal heartbeating... 2022-08-25 09:48:49 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-08-25 09:48:49 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):161 - sync summary: io.airbyte.config.StandardSyncOutput@7816d79c[standardSyncSummary=io.airbyte.config.StandardSyncSummary@65e91234[status=completed,recordsSynced=49074,bytesSynced=24123540,startTime=1661420857423,endTime=1661420929447,totalStats=io.airbyte.config.SyncStats@49533714[recordsEmitted=49074,bytesEmitted=24123540,stateMessagesEmitted=94,recordsCommitted=49074],streamStats=[io.airbyte.config.StreamSyncStats@478c1012[streamName=s3_user_reports,stats=io.airbyte.config.SyncStats@9689548[recordsEmitted=49074,bytesEmitted=24123540,stateMessagesEmitted=,recordsCommitted=49074]]]],normalizationSummary=,state=io.airbyte.config.State@243d4ee3[state={"s3_user_reports":{"_ab_source_file_last_modified":"2022-08-25T09:00:46+0000","schema":{"User ID":"integer","Office":"string","Agent Name":"string","Status":"string","Email":"string","Title":"string","Contacts":"integer","Shared Contacts":"integer","Sents":"integer","Opens":"integer","Clicks":"integer","Total Sends":"integer","Sends Last 30 days":"integer","Last Sent":"string","Last Login":"string","_ab_additional_properties":"object","_ab_source_file_last_modified":"string","_ab_source_file_url":"string"},"history":{"2022-08-22":["20220822_williampitt_activepipe_user_reports.csv"],"2022-08-23":["20220823_williampitt_activepipe_user_reports.csv"],"2022-08-24":["20220824_williampitt_activepipe_user_reports.csv"],"2022-08-25":["20220825_williampitt_activepipe_user_reports.csv"]}}}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@740626e7[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@53ada4f5[stream=io.airbyte.protocol.models.AirbyteStream@1ea2a91d[name=s3_user_reports,jsonSchema={"type":"object","properties":{"Email":{"type":["null","string"]},"Opens":{"type":["null","number"]},"Sents":{"type":["null","number"]},"Title":{"type":["null","string"]},"Clicks":{"type":["null","number"]},"Office":{"type":["null","string"]},"Status":{"type":["null","string"]},"User ID":{"type":["null","integer"]},"Contacts":{"type":["null","number"]},"Last Sent":{"type":["null","string"]},"Agent Name":{"type":["null","string"]},"Last Login":{"type":["null","string"]},"Total Sends":{"type":["null","number"]},"Shared Contacts":{"type":["null","number"]},"Sends Last 30 days":{"type":["null","number"]},"_ab_source_file_url":{"type":"string"},"_ab_additional_properties":{"type":"object"},"_ab_source_file_last_modified":{"type":"string","format":"date-time"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[_ab_source_file_last_modified],sourceDefinedPrimaryKey=[],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[_ab_source_file_last_modified],destinationSyncMode=append,primaryKey=[],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-08-25 09:48:49 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-08-25 09:48:49 INFO i.a.w.t.TemporalAttemptExecution(get):107 - Cloud storage job log path: /workspace/751/1/logs.log 2022-08-25 09:48:49 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.41-alpha 2022-08-25 09:48:49 INFO i.a.w.t.s.LauncherWorker(lambda$run$3):142 - Creating orchestrator-norm-job-751-attempt-1 for attempt number: 1 2022-08-25 09:48:49 WARN i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):200 - There are currently running pods for the connection: [orchestrator-repl-job-751-attempt-1] 2022-08-25 09:48:49 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):202 - Attempting to delete pods: [orchestrator-repl-job-751-attempt-1] 2022-08-25 09:48:49 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):207 - Waiting for deletion... 2022-08-25 09:48:50 WARN i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):200 - There are currently running pods for the connection: [orchestrator-repl-job-751-attempt-1] 2022-08-25 09:48:50 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):202 - Attempting to delete pods: [orchestrator-repl-job-751-attempt-1] 2022-08-25 09:48:50 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):207 - Waiting for deletion... 2022-08-25 09:48:52 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):214 - Successfully deleted all running pods for the connection! 2022-08-25 09:48:52 INFO i.a.w.p.AsyncOrchestratorPodProcess(create):318 - Waiting for pod to be running... 2022-08-25 09:48:53 INFO i.a.w.p.AsyncOrchestratorPodProcess(create):341 - Pod default/orchestrator-norm-job-751-attempt-1 is running on 192.168.70.14 2022-08-25 09:48:53 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: destinationLauncherConfig.json 2022-08-25 09:48:53 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/8c81d8e2-5e22-4fe5-9788-57ab89a37993/destinationLauncherConfig.json default/orchestrator-norm-job-751-attempt-1:/config/destinationLauncherConfig.json -c main 2022-08-25 09:48:53 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:48:54 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:48:54 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: envMap.json 2022-08-25 09:48:54 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/337d3e34-9fb5-4da7-8a7a-a007eb9a089c/envMap.json default/orchestrator-norm-job-751-attempt-1:/config/envMap.json -c main 2022-08-25 09:48:54 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:48:54 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:48:54 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: input.json 2022-08-25 09:48:54 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/c6909dd3-3eea-4630-9d3c-285c0e484a04/input.json default/orchestrator-norm-job-751-attempt-1:/config/input.json -c main 2022-08-25 09:48:54 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:48:55 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:48:55 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: KUBE_POD_INFO 2022-08-25 09:48:55 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/c8e543c9-79ef-41d0-a749-bc0495e2e3ea/KUBE_POD_INFO default/orchestrator-norm-job-751-attempt-1:/config/KUBE_POD_INFO -c main 2022-08-25 09:48:55 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:48:55 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:48:55 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: application.txt 2022-08-25 09:48:55 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/c3a1b6c9-0933-4b26-aec0-cbc9e6c68fb7/application.txt default/orchestrator-norm-job-751-attempt-1:/config/application.txt -c main 2022-08-25 09:48:55 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:48:55 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:48:55 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: jobRunConfig.json 2022-08-25 09:48:55 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/7f4eaa90-f405-4ed7-8e6d-539d7f501670/jobRunConfig.json default/orchestrator-norm-job-751-attempt-1:/config/jobRunConfig.json -c main 2022-08-25 09:48:55 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:48:56 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:48:56 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: FINISHED_UPLOADING 2022-08-25 09:48:56 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/0abbbbe1-2538-4f05-8334-7e38740ae6e5/FINISHED_UPLOADING default/orchestrator-norm-job-751-attempt-1:/config/FINISHED_UPLOADING -c main 2022-08-25 09:48:56 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:48:56 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:49:14 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):322 - Stopping temporal heartbeating... 2022-08-25 09:49:14 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-08-25 09:49:14 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-08-25 09:49:14 INFO i.a.w.t.TemporalAttemptExecution(get):107 - Cloud storage job log path: /workspace/751/1/logs.log 2022-08-25 09:49:14 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.41-alpha 2022-08-25 09:49:14 INFO i.a.w.t.s.LauncherWorker(lambda$run$3):142 - Creating orchestrator-dbt-job-751-attempt-1 for attempt number: 1 2022-08-25 09:49:14 WARN i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):200 - There are currently running pods for the connection: [orchestrator-norm-job-751-attempt-1] 2022-08-25 09:49:14 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):202 - Attempting to delete pods: [orchestrator-norm-job-751-attempt-1] 2022-08-25 09:49:14 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):207 - Waiting for deletion... 2022-08-25 09:49:15 WARN i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):200 - There are currently running pods for the connection: [orchestrator-norm-job-751-attempt-1] 2022-08-25 09:49:16 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):202 - Attempting to delete pods: [orchestrator-norm-job-751-attempt-1] 2022-08-25 09:49:16 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):207 - Waiting for deletion... 2022-08-25 09:49:17 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):214 - Successfully deleted all running pods for the connection! 2022-08-25 09:49:17 INFO i.a.w.p.AsyncOrchestratorPodProcess(create):318 - Waiting for pod to be running... 2022-08-25 09:49:22 dbt-orchestrator > Writing async status INITIALIZING for KubePodInfo[namespace=default, name=orchestrator-dbt-job-751-attempt-1]... 2022-08-25 09:49:23 dbt-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_CPU_REQUEST: 'null' 2022-08-25 09:49:23 dbt-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_CPU_LIMIT: 'null' 2022-08-25 09:49:23 dbt-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_REQUEST: 'null' 2022-08-25 09:49:23 dbt-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_LIMIT: 'null' 2022-08-25 09:49:23 dbt-orchestrator > Using default value for environment variable JOB_KUBE_TOLERATIONS: '' 2022-08-25 09:49:23 dbt-orchestrator > Using default value for environment variable JOB_KUBE_NODE_SELECTORS: '' 2022-08-25 09:49:23 dbt-orchestrator > Using default value for environment variable JOB_KUBE_ANNOTATIONS: '' 2022-08-25 09:49:23 dbt-orchestrator > Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_SECRET: '' 2022-08-25 09:49:23 dbt-orchestrator > Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-08-25 09:49:23 dbt-orchestrator > Using default value for environment variable JOB_KUBE_SIDECAR_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-08-25 09:49:23 dbt-orchestrator > Using default value for environment variable JOB_KUBE_SOCAT_IMAGE: 'alpine/socat:1.7.4.3-r0' 2022-08-25 09:49:23 dbt-orchestrator > Using default value for environment variable JOB_KUBE_BUSYBOX_IMAGE: 'busybox:1.28' 2022-08-25 09:49:23 dbt-orchestrator > Using default value for environment variable JOB_KUBE_CURL_IMAGE: 'curlimages/curl:7.83.1' 2022-08-25 09:49:23 dbt-orchestrator > Using default value for environment variable DEPLOYMENT_MODE: 'OSS' 2022-08-25 09:49:23 dbt-orchestrator > Using Kubernetes namespace: default 2022-08-25 09:49:23 dbt-orchestrator > Logging initialized @5690ms to org.eclipse.jetty.util.log.Slf4jLog 2022-08-25 09:49:23 dbt-orchestrator > jetty-9.4.31.v20200723; built: 2020-07-23T17:57:36.812Z; git: 450ba27947e13e66baa8cd1ce7e85a4461cacc1d; jvm 19-ea+32-2220 2022-08-25 09:49:23 dbt-orchestrator > Started o.e.j.s.ServletContextHandler@733c464f{/,null,AVAILABLE} 2022-08-25 09:49:23 dbt-orchestrator > Started ServerConnector@20999517{HTTP/1.1, (http/1.1)}{0.0.0.0:9000} 2022-08-25 09:49:23 dbt-orchestrator > Started @5847ms 2022-08-25 09:49:23 dbt-orchestrator > Writing async status RUNNING for KubePodInfo[namespace=default, name=orchestrator-dbt-job-751-attempt-1]... 2022-08-25 09:49:23 dbt-orchestrator > Setting up dbt worker... 2022-08-25 09:49:23 dbt-orchestrator > Running dbt worker... 2022-08-25 09:49:23 dbt-orchestrator > Running dbt transformation. 2022-08-25 09:49:23 dbt-orchestrator > Running with normalization version: airbyte/normalization:0.2.12 2022-08-25 09:49:23 dbt-orchestrator > Attempting to start pod = normalization-normalize-751-1-xyosy for airbyte/normalization:0.2.12 2022-08-25 09:49:23 dbt-orchestrator > normalization-normalize-751-1-xyosy stdoutLocalPort = 9880 2022-08-25 09:49:23 dbt-orchestrator > normalization-normalize-751-1-xyosy stderrLocalPort = 9879 2022-08-25 09:49:23 dbt-orchestrator > Creating stdout socket server... 2022-08-25 09:49:23 dbt-orchestrator > Creating stderr socket server... 2022-08-25 09:49:23 dbt-orchestrator > Creating pod normalization-normalize-751-1-xyosy... 2022-08-25 09:49:24 dbt-orchestrator > Waiting for init container to be ready before copying files... 2022-08-25 09:49:24 dbt-orchestrator > Init container present.. 2022-08-25 09:49:26 dbt-orchestrator > Init container ready.. 2022-08-25 09:49:26 dbt-orchestrator > Copying files... 2022-08-25 09:49:26 dbt-orchestrator > Uploading file: destination_config.json 2022-08-25 09:49:26 dbt-orchestrator > kubectl cp /tmp/3c21f3ca-5303-4dca-adf1-7b71b2029822/destination_config.json default/normalization-normalize-751-1-xyosy:/config/destination_config.json -c init 2022-08-25 09:49:26 dbt-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:49:26 dbt-orchestrator > kubectl cp complete, closing process 2022-08-25 09:49:26 dbt-orchestrator > Uploading file: FINISHED_UPLOADING 2022-08-25 09:49:26 dbt-orchestrator > kubectl cp /tmp/91828f46-4d4b-4284-b90f-768537fbd30a/FINISHED_UPLOADING default/normalization-normalize-751-1-xyosy:/config/FINISHED_UPLOADING -c init 2022-08-25 09:49:26 dbt-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:49:26 dbt-orchestrator > kubectl cp complete, closing process 2022-08-25 09:49:26 dbt-orchestrator > Waiting until pod is ready... 2022-08-25 09:49:27 dbt-orchestrator > Setting stdout... 2022-08-25 09:49:27 dbt-orchestrator > Setting stderr... 2022-08-25 09:49:29 dbt-orchestrator > MetricClient has not been initialized. Must call MetricClientFactory.CreateMetricClient before using MetricClient. Using a dummy client for now. Ignore this if Airbyte is configured to not publish any metrics. 2022-08-25 09:49:29 dbt-orchestrator > Reading pod IP... 2022-08-25 09:49:29 dbt-orchestrator > Pod IP: 192.168.74.205 2022-08-25 09:49:29 dbt-orchestrator > Using null stdin output stream... 2022-08-25 09:49:29 normalization > Running: git clone --depth 5 --single-branch $GIT_REPO git_repo 2022-08-25 09:49:29 normalization > Last 5 commits in git_repo: 2022-08-25 09:49:29 normalization > 6325314 Merge pull request #21 from Kintaro-io/mvp 2022-08-25 09:49:29 normalization > Cloning into 'git_repo'... 2022-08-25 09:49:29 normalization > f8b58a4 Merge branch 'main' of https://github.com/Kintaro-io/kintaro-data-transform into mvp 2022-08-25 09:49:29 normalization > 105530f Updated models 2022-08-25 09:49:29 normalization > 6ac6e13 Updated models 2022-08-25 09:49:29 normalization > cb8869d Merge pull request #20 from Kintaro-io/mvp 2022-08-25 09:49:29 normalization > /config 2022-08-25 09:49:29 normalization > Running: transform-config --config destination_config.json --integration-type postgres --out /config 2022-08-25 09:49:29 normalization > Namespace(config='destination_config.json', integration_type=, out='/config') 2022-08-25 09:49:29 normalization > transform_postgres 2022-08-25 09:49:30 dbt-orchestrator > (pod: default / normalization-normalize-751-1-xyosy) - Closed all resources for pod 2022-08-25 09:49:30 dbt-orchestrator > Attempting to start pod = dbt-custom-751-1-pcvmq for fishtownanalytics/dbt:1.0.0 2022-08-25 09:49:30 dbt-orchestrator > dbt-custom-751-1-pcvmq stdoutLocalPort = 9878 2022-08-25 09:49:30 dbt-orchestrator > dbt-custom-751-1-pcvmq stderrLocalPort = 9877 2022-08-25 09:49:30 dbt-orchestrator > Creating stdout socket server... 2022-08-25 09:49:30 dbt-orchestrator > Found entrypoint override: /bin/bash 2022-08-25 09:49:30 dbt-orchestrator > Creating stderr socket server... 2022-08-25 09:49:30 dbt-orchestrator > Creating pod dbt-custom-751-1-pcvmq... 2022-08-25 09:49:30 dbt-orchestrator > Waiting for init container to be ready before copying files... 2022-08-25 09:49:30 dbt-orchestrator > Init container present.. 2022-08-25 09:49:32 dbt-orchestrator > Init container ready.. 2022-08-25 09:49:32 dbt-orchestrator > Copying files... 2022-08-25 09:49:32 dbt-orchestrator > Uploading file: entrypoint.sh 2022-08-25 09:49:32 dbt-orchestrator > kubectl cp /tmp/88abe399-6456-4ab4-8f70-80e53adb7f1b/entrypoint.sh default/dbt-custom-751-1-pcvmq:/config/entrypoint.sh -c init 2022-08-25 09:49:32 dbt-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:49:32 dbt-orchestrator > kubectl cp complete, closing process 2022-08-25 09:49:32 dbt-orchestrator > Uploading file: sshtunneling.sh 2022-08-25 09:49:32 dbt-orchestrator > kubectl cp /tmp/fff2e716-7dc1-4b35-b29b-6e5d2883799f/sshtunneling.sh default/dbt-custom-751-1-pcvmq:/config/sshtunneling.sh -c init 2022-08-25 09:49:32 dbt-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:49:32 dbt-orchestrator > kubectl cp complete, closing process 2022-08-25 09:49:32 dbt-orchestrator > Uploading file: FINISHED_UPLOADING 2022-08-25 09:49:32 dbt-orchestrator > kubectl cp /tmp/eec08ee8-78d7-4875-b2d5-0a94075f0b21/FINISHED_UPLOADING default/dbt-custom-751-1-pcvmq:/config/FINISHED_UPLOADING -c init 2022-08-25 09:49:32 dbt-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:49:32 dbt-orchestrator > kubectl cp complete, closing process 2022-08-25 09:49:32 dbt-orchestrator > Waiting until pod is ready... 2022-08-25 09:49:33 dbt-orchestrator > Setting stdout... 2022-08-25 09:49:33 dbt-orchestrator > Setting stderr... 2022-08-25 09:49:34 dbt-orchestrator > MetricClient has not been initialized. Must call MetricClientFactory.CreateMetricClient before using MetricClient. Using a dummy client for now. Ignore this if Airbyte is configured to not publish any metrics. 2022-08-25 09:49:34 dbt-orchestrator > Reading pod IP... 2022-08-25 09:49:34 dbt-orchestrator > Pod IP: 192.168.42.99 2022-08-25 09:49:34 dbt-orchestrator > Using null stdin output stream... 2022-08-25 09:49:34 dbt-orchestrator > generic gobbler IOException: Socket closed. Typically happens when cancelling a job. 2022-08-25 09:49:34 dbt-orchestrator > (pod: default / dbt-custom-751-1-pcvmq) - Closed all resources for pod 2022-08-25 09:49:34 dbt-orchestrator > Writing async status FAILED for KubePodInfo[namespace=default, name=orchestrator-dbt-job-751-attempt-1]... 2022-08-25 09:49:19 INFO i.a.w.p.AsyncOrchestratorPodProcess(create):341 - Pod default/orchestrator-dbt-job-751-attempt-1 is running on 192.168.90.23 2022-08-25 09:49:19 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: destinationLauncherConfig.json 2022-08-25 09:49:19 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/95c13fc5-6d5e-4ec5-a16c-8524783524e9/destinationLauncherConfig.json default/orchestrator-dbt-job-751-attempt-1:/config/destinationLauncherConfig.json -c main 2022-08-25 09:49:19 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:49:19 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:49:19 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: envMap.json 2022-08-25 09:49:19 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/0f1a3274-9d4f-449e-88f5-ca871e88b247/envMap.json default/orchestrator-dbt-job-751-attempt-1:/config/envMap.json -c main 2022-08-25 09:49:19 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:49:19 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:49:19 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: input.json 2022-08-25 09:49:19 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/1b047ebd-04ff-42f2-ba71-2d8f3ddb9247/input.json default/orchestrator-dbt-job-751-attempt-1:/config/input.json -c main 2022-08-25 09:49:19 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:49:20 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:49:20 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: KUBE_POD_INFO 2022-08-25 09:49:20 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/deaf7feb-2ae7-4e22-85d5-6665c0d5da5d/KUBE_POD_INFO default/orchestrator-dbt-job-751-attempt-1:/config/KUBE_POD_INFO -c main 2022-08-25 09:49:20 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:49:20 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:49:20 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: application.txt 2022-08-25 09:49:20 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/a515b768-18f1-4dd2-afaf-f543da339b23/application.txt default/orchestrator-dbt-job-751-attempt-1:/config/application.txt -c main 2022-08-25 09:49:20 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:49:21 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:49:21 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: jobRunConfig.json 2022-08-25 09:49:21 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/8066bf90-4e3f-4501-ad5a-209f84b5c33f/jobRunConfig.json default/orchestrator-dbt-job-751-attempt-1:/config/jobRunConfig.json -c main 2022-08-25 09:49:21 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:49:21 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:49:21 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: FINISHED_UPLOADING 2022-08-25 09:49:21 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/1fcb9fcf-8710-4242-8b6d-db9720ac23c6/FINISHED_UPLOADING default/orchestrator-dbt-job-751-attempt-1:/config/FINISHED_UPLOADING -c main 2022-08-25 09:49:21 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:49:21 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:49:34 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):322 - Stopping temporal heartbeating... 2022-08-25 09:49:34 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):158 - Completing future exceptionally... java.lang.RuntimeException: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:320) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.LauncherWorker.run(LauncherWorker.java:90) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at java.lang.Thread.run(Thread.java:1589) [?:?] Caused by: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at io.airbyte.workers.temporal.sync.LauncherWorker.lambda$run$3(LauncherWorker.java:181) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:315) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 3 more Caused by: io.airbyte.workers.exception.WorkerException: Non-zero exit code! at io.airbyte.workers.temporal.sync.LauncherWorker.lambda$run$3(LauncherWorker.java:165) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:315) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 3 more 2022-08-25 09:49:34 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-08-25 09:49:34 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-08-25 09:49:34 WARN i.t.i.a.POJOActivityTaskHandler(activityFailureToResult):307 - Activity failure. ActivityId=f53ba1ed-b197-3dd2-932d-8b12e41a0509, activityType=Run, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: java.lang.RuntimeException: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:289) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.run(DbtTransformationActivityImpl.java:77) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) [?:?] at java.lang.Thread.run(Thread.java:1589) [?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: java.lang.RuntimeException: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:56) ~[temporal-serviceclient-1.8.1.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:448) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:51) ~[temporal-sdk-1.8.1.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:135) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.lambda$run$3(DbtTransformationActivityImpl.java:108) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:284) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 12 more Caused by: java.util.concurrent.ExecutionException: java.lang.RuntimeException: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:129) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.lambda$run$3(DbtTransformationActivityImpl.java:108) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:284) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 12 more Caused by: java.lang.RuntimeException: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:320) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.LauncherWorker.run(LauncherWorker.java:90) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at io.airbyte.workers.temporal.sync.LauncherWorker.lambda$run$3(LauncherWorker.java:181) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:315) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.LauncherWorker.run(LauncherWorker.java:90) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Non-zero exit code! at io.airbyte.workers.temporal.sync.LauncherWorker.lambda$run$3(LauncherWorker.java:165) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:315) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.LauncherWorker.run(LauncherWorker.java:90) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 1 more 2022-08-25 09:49:34 INFO i.a.w.t.TemporalAttemptExecution(get):107 - Cloud storage job log path: /workspace/751/2/logs.log 2022-08-25 09:49:55 replication-orchestrator > Writing async status INITIALIZING for KubePodInfo[namespace=default, name=orchestrator-repl-job-751-attempt-2]... 2022-08-25 09:49:34 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.41-alpha 2022-08-25 09:49:34 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = source-s3-check-751-2-frzpz for airbyte/source-s3:0.1.17 2022-08-25 09:49:34 INFO i.a.w.p.KubeProcessFactory(create):103 - source-s3-check-751-2-frzpz stdoutLocalPort = 9008 2022-08-25 09:49:34 INFO i.a.w.p.KubeProcessFactory(create):106 - source-s3-check-751-2-frzpz stderrLocalPort = 9009 2022-08-25 09:49:34 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):587 - Creating stdout socket server... 2022-08-25 09:49:34 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):605 - Creating stderr socket server... 2022-08-25 09:49:34 INFO i.a.w.p.KubePodProcess():518 - Creating pod source-s3-check-751-2-frzpz... 2022-08-25 09:49:34 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):308 - Waiting for init container to be ready before copying files... 2022-08-25 09:49:35 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):312 - Init container present.. 2022-08-25 09:49:37 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):315 - Init container ready.. 2022-08-25 09:49:37 INFO i.a.w.p.KubePodProcess():549 - Copying files... 2022-08-25 09:49:37 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):257 - Uploading file: source_config.json 2022-08-25 09:49:37 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp /tmp/82e33df4-7b88-4e63-b10e-d4bbe1c17321/source_config.json default/source-s3-check-751-2-frzpz:/config/source_config.json -c init 2022-08-25 09:49:37 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):268 - Waiting for kubectl cp to complete 2022-08-25 09:49:37 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):282 - kubectl cp complete, closing process 2022-08-25 09:49:37 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):257 - Uploading file: FINISHED_UPLOADING 2022-08-25 09:49:37 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp /tmp/8b4aa8bd-9119-4f3a-babb-b3948e1a5906/FINISHED_UPLOADING default/source-s3-check-751-2-frzpz:/config/FINISHED_UPLOADING -c init 2022-08-25 09:49:37 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):268 - Waiting for kubectl cp to complete 2022-08-25 09:49:38 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):282 - kubectl cp complete, closing process 2022-08-25 09:49:38 INFO i.a.w.p.KubePodProcess():552 - Waiting until pod is ready... 2022-08-25 09:49:39 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):596 - Setting stdout... 2022-08-25 09:49:39 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):608 - Setting stderr... 2022-08-25 09:49:40 INFO i.a.w.p.KubePodProcess():568 - Reading pod IP... 2022-08-25 09:49:40 INFO i.a.w.p.KubePodProcess():570 - Pod IP: 192.168.82.211 2022-08-25 09:49:40 INFO i.a.w.p.KubePodProcess():577 - Using null stdin output stream... 2022-08-25 09:49:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):99 - initialised stream with format: 2022-08-25 09:49:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):99 - initialised stream with format: {'encoding': 'utf8', 'filetype': 'csv', 'delimiter': ',', 'block_size': 10000, 'quote_char': '"', 'escape_char': '\\', 'double_quote': True, 'infer_datatypes': True, 'advanced_options': '{}', 'newlines_in_values': True, 'additional_reader_options': '{}'} 2022-08-25 09:49:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):99 - Iterating S3 bucket 'kintaro-activepipe' 2022-08-25 09:49:40 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):99 - Check succeeded 2022-08-25 09:49:41 INFO i.a.w.p.KubePodProcess(close):717 - (pod: default / source-s3-check-751-2-frzpz) - Closed all resources for pod 2022-08-25 09:49:41 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-08-25 09:49:41 INFO i.a.w.t.TemporalAttemptExecution(get):107 - Cloud storage job log path: /workspace/751/2/logs.log 2022-08-25 09:49:41 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.41-alpha 2022-08-25 09:49:41 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = destination-postgres-check-751-2-yzxjs for airbyte/destination-postgres:0.3.21 2022-08-25 09:49:41 INFO i.a.w.p.KubeProcessFactory(create):103 - destination-postgres-check-751-2-yzxjs stdoutLocalPort = 9006 2022-08-25 09:49:41 INFO i.a.w.p.KubeProcessFactory(create):106 - destination-postgres-check-751-2-yzxjs stderrLocalPort = 9007 2022-08-25 09:49:41 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):587 - Creating stdout socket server... 2022-08-25 09:49:41 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):605 - Creating stderr socket server... 2022-08-25 09:49:41 INFO i.a.w.p.KubePodProcess():518 - Creating pod destination-postgres-check-751-2-yzxjs... 2022-08-25 09:49:42 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):308 - Waiting for init container to be ready before copying files... 2022-08-25 09:49:42 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):312 - Init container present.. 2022-08-25 09:49:43 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):315 - Init container ready.. 2022-08-25 09:49:43 INFO i.a.w.p.KubePodProcess():549 - Copying files... 2022-08-25 09:49:43 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):257 - Uploading file: source_config.json 2022-08-25 09:49:43 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp /tmp/2a5fb525-45b0-48a7-8af8-007b77043ad7/source_config.json default/destination-postgres-check-751-2-yzxjs:/config/source_config.json -c init 2022-08-25 09:49:43 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):268 - Waiting for kubectl cp to complete 2022-08-25 09:49:43 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):282 - kubectl cp complete, closing process 2022-08-25 09:49:43 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):257 - Uploading file: FINISHED_UPLOADING 2022-08-25 09:49:43 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp /tmp/594d31fd-8726-45f1-8a10-faf8e8697439/FINISHED_UPLOADING default/destination-postgres-check-751-2-yzxjs:/config/FINISHED_UPLOADING -c init 2022-08-25 09:49:43 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):268 - Waiting for kubectl cp to complete 2022-08-25 09:49:43 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):282 - kubectl cp complete, closing process 2022-08-25 09:49:43 INFO i.a.w.p.KubePodProcess():552 - Waiting until pod is ready... 2022-08-25 09:49:44 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):596 - Setting stdout... 2022-08-25 09:49:44 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):608 - Setting stderr... 2022-08-25 09:49:46 INFO i.a.w.p.KubePodProcess():568 - Reading pod IP... 2022-08-25 09:49:46 INFO i.a.w.p.KubePodProcess():570 - Pod IP: 192.168.75.131 2022-08-25 09:49:46 INFO i.a.w.p.KubePodProcess():577 - Using null stdin output stream... 2022-08-25 09:49:46 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:49:46 INFO i.a.i.d.p.PostgresDestination(main):90 - starting destination: class io.airbyte.integrations.destination.postgres.PostgresDestination 2022-08-25 09:49:46 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings. 2022-08-25 09:49:46 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:49:46 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:49:46 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:49:46 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:49:46 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-08-25 09:49:46 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-08-25 09:49:46 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:49:46 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-08-25 09:49:46 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:49:46 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2022-08-25 09:49:46 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:49:46 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK 2022-08-25 09:49:46 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:49:46 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-08-25 09:49:46 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:49:46 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:49:46 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:49:46 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:49:46 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:49:46 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:49:46 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:49:46 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:49:46 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:49:46 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2022-08-25 09:49:46 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:49:46 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2022-08-25 09:49:46 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:49:46 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2022-08-25 09:49:47 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:49:47 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated... 2022-08-25 09:49:47 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:49:47 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed. 2022-08-25 09:49:47 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:49:47 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2022-08-25 09:49:47 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-25 09:49:47 INFO i.a.i.d.p.PostgresDestination(main):92 - completed destination: class io.airbyte.integrations.destination.postgres.PostgresDestination 2022-08-25 09:49:49 INFO i.a.w.p.KubePodProcess(close):717 - (pod: default / destination-postgres-check-751-2-yzxjs) - Closed all resources for pod 2022-08-25 09:49:49 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-08-25 09:49:49 INFO i.a.w.t.TemporalAttemptExecution(get):107 - Cloud storage job log path: /workspace/751/2/logs.log 2022-08-25 09:49:49 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.41-alpha 2022-08-25 09:49:49 INFO i.a.w.t.s.LauncherWorker(lambda$run$3):142 - Creating orchestrator-repl-job-751-attempt-2 for attempt number: 2 2022-08-25 09:49:49 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):214 - Successfully deleted all running pods for the connection! 2022-08-25 09:49:49 INFO i.a.w.p.AsyncOrchestratorPodProcess(create):318 - Waiting for pod to be running... 2022-08-25 09:49:51 INFO i.a.w.p.AsyncOrchestratorPodProcess(create):341 - Pod default/orchestrator-repl-job-751-attempt-2 is running on 192.168.83.219 2022-08-25 09:49:51 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: envMap.json 2022-08-25 09:49:51 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/aa4a0b03-3bf2-4bd4-b45b-870a116c0c27/envMap.json default/orchestrator-repl-job-751-attempt-2:/config/envMap.json -c main 2022-08-25 09:49:51 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:49:51 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:49:51 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: application.txt 2022-08-25 09:49:51 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/2d58d73c-3114-4087-ace5-6a77630fcd27/application.txt default/orchestrator-repl-job-751-attempt-2:/config/application.txt -c main 2022-08-25 09:49:51 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:49:52 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:49:52 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: jobRunConfig.json 2022-08-25 09:49:52 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/fa6eb190-7045-4d78-92a8-c71b55516162/jobRunConfig.json default/orchestrator-repl-job-751-attempt-2:/config/jobRunConfig.json -c main 2022-08-25 09:49:52 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:49:52 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:49:52 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: destinationLauncherConfig.json 2022-08-25 09:49:52 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/de8cca36-9051-4186-93a0-f909899a6ec6/destinationLauncherConfig.json default/orchestrator-repl-job-751-attempt-2:/config/destinationLauncherConfig.json -c main 2022-08-25 09:49:52 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:49:53 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:49:53 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: sourceLauncherConfig.json 2022-08-25 09:49:53 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/331663d0-f275-49a8-8fa6-44e6c4920a58/sourceLauncherConfig.json default/orchestrator-repl-job-751-attempt-2:/config/sourceLauncherConfig.json -c main 2022-08-25 09:49:53 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:49:53 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:49:53 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: input.json 2022-08-25 09:49:53 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/65b6f1cb-64cb-454e-bb02-1931e6c271d7/input.json default/orchestrator-repl-job-751-attempt-2:/config/input.json -c main 2022-08-25 09:49:53 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:49:54 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:49:54 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: KUBE_POD_INFO 2022-08-25 09:49:54 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/ac105957-3087-4254-8d0b-92bcb41cc8f9/KUBE_POD_INFO default/orchestrator-repl-job-751-attempt-2:/config/KUBE_POD_INFO -c main 2022-08-25 09:49:54 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:49:54 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:49:54 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: FINISHED_UPLOADING 2022-08-25 09:49:54 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/1d8692cb-410f-4233-844a-d0bc1463ffd0/FINISHED_UPLOADING default/orchestrator-repl-job-751-attempt-2:/config/FINISHED_UPLOADING -c main 2022-08-25 09:49:54 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:49:54 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:49:56 replication-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_CPU_REQUEST: 'null' 2022-08-25 09:49:56 replication-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_CPU_LIMIT: 'null' 2022-08-25 09:49:56 replication-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_REQUEST: 'null' 2022-08-25 09:49:56 replication-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_LIMIT: 'null' 2022-08-25 09:49:56 replication-orchestrator > Using default value for environment variable JOB_KUBE_TOLERATIONS: '' 2022-08-25 09:49:56 replication-orchestrator > Using default value for environment variable JOB_KUBE_NODE_SELECTORS: '' 2022-08-25 09:49:56 replication-orchestrator > Using default value for environment variable JOB_KUBE_ANNOTATIONS: '' 2022-08-25 09:49:56 replication-orchestrator > Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_SECRET: '' 2022-08-25 09:49:56 replication-orchestrator > Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-08-25 09:49:56 replication-orchestrator > Using default value for environment variable JOB_KUBE_SIDECAR_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-08-25 09:49:56 replication-orchestrator > Using default value for environment variable JOB_KUBE_SOCAT_IMAGE: 'alpine/socat:1.7.4.3-r0' 2022-08-25 09:49:56 replication-orchestrator > Using default value for environment variable JOB_KUBE_BUSYBOX_IMAGE: 'busybox:1.28' 2022-08-25 09:49:56 replication-orchestrator > Using default value for environment variable JOB_KUBE_CURL_IMAGE: 'curlimages/curl:7.83.1' 2022-08-25 09:49:56 replication-orchestrator > Using default value for environment variable DEPLOYMENT_MODE: 'OSS' 2022-08-25 09:49:56 replication-orchestrator > Using Kubernetes namespace: default 2022-08-25 09:49:56 replication-orchestrator > Logging initialized @5983ms to org.eclipse.jetty.util.log.Slf4jLog 2022-08-25 09:49:56 replication-orchestrator > jetty-9.4.31.v20200723; built: 2020-07-23T17:57:36.812Z; git: 450ba27947e13e66baa8cd1ce7e85a4461cacc1d; jvm 19-ea+32-2220 2022-08-25 09:49:56 replication-orchestrator > Started o.e.j.s.ServletContextHandler@3f6f3cc{/,null,AVAILABLE} 2022-08-25 09:49:56 replication-orchestrator > Started ServerConnector@76cf841{HTTP/1.1, (http/1.1)}{0.0.0.0:9000} 2022-08-25 09:49:56 replication-orchestrator > Started @6159ms 2022-08-25 09:49:56 replication-orchestrator > Writing async status RUNNING for KubePodInfo[namespace=default, name=orchestrator-repl-job-751-attempt-2]... 2022-08-25 09:49:56 replication-orchestrator > Setting up source launcher... 2022-08-25 09:49:56 replication-orchestrator > Setting up destination launcher... 2022-08-25 09:49:56 replication-orchestrator > Setting up source... 2022-08-25 09:49:57 replication-orchestrator > Setting up replication worker... 2022-08-25 09:49:57 replication-orchestrator > Running replication worker... 2022-08-25 09:49:57 replication-orchestrator > start sync worker. job id: 751 attempt id: 2 2022-08-25 09:49:57 replication-orchestrator > configured sync modes: {null.s3_user_reports=incremental - append} 2022-08-25 09:49:57 replication-orchestrator > Running destination... 2022-08-25 09:49:57 replication-orchestrator > Attempting to start pod = destination-postgres-write-751-2-uzlwv for airbyte/destination-postgres:0.3.21 2022-08-25 09:49:57 replication-orchestrator > destination-postgres-write-751-2-uzlwv stdoutLocalPort = 9877 2022-08-25 09:49:57 replication-orchestrator > destination-postgres-write-751-2-uzlwv stderrLocalPort = 9878 2022-08-25 09:49:57 replication-orchestrator > Creating stdout socket server... 2022-08-25 09:49:57 replication-orchestrator > Creating stderr socket server... 2022-08-25 09:49:57 replication-orchestrator > Creating pod destination-postgres-write-751-2-uzlwv... 2022-08-25 09:49:58 replication-orchestrator > Waiting for init container to be ready before copying files... 2022-08-25 09:49:58 replication-orchestrator > Init container present.. 2022-08-25 09:49:59 replication-orchestrator > Init container ready.. 2022-08-25 09:49:59 replication-orchestrator > Copying files... 2022-08-25 09:49:59 replication-orchestrator > Uploading file: destination_config.json 2022-08-25 09:49:59 replication-orchestrator > kubectl cp /tmp/62265f23-8927-406d-8a4e-3ec0ba4c04ad/destination_config.json default/destination-postgres-write-751-2-uzlwv:/config/destination_config.json -c init 2022-08-25 09:49:59 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:50:00 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:50:00 replication-orchestrator > Uploading file: destination_catalog.json 2022-08-25 09:50:00 replication-orchestrator > kubectl cp /tmp/5a191b2c-3ce6-4700-bf45-5f3a703bb9fd/destination_catalog.json default/destination-postgres-write-751-2-uzlwv:/config/destination_catalog.json -c init 2022-08-25 09:50:00 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:50:00 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:50:00 replication-orchestrator > Uploading file: FINISHED_UPLOADING 2022-08-25 09:50:00 replication-orchestrator > kubectl cp /tmp/14791477-a9db-4b00-b6ae-e19fd63738b9/FINISHED_UPLOADING default/destination-postgres-write-751-2-uzlwv:/config/FINISHED_UPLOADING -c init 2022-08-25 09:50:00 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:50:00 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:50:00 replication-orchestrator > Waiting until pod is ready... 2022-08-25 09:50:02 replication-orchestrator > Setting stdout... 2022-08-25 09:50:02 replication-orchestrator > Setting stderr... 2022-08-25 09:50:04 replication-orchestrator > MetricClient has not been initialized. Must call MetricClientFactory.CreateMetricClient before using MetricClient. Using a dummy client for now. Ignore this if Airbyte is configured to not publish any metrics. 2022-08-25 09:50:04 replication-orchestrator > Reading pod IP... 2022-08-25 09:50:04 replication-orchestrator > Pod IP: 192.168.66.166 2022-08-25 09:50:04 replication-orchestrator > Creating stdin socket... 2022-08-25 09:50:04 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-08-25 09:50:04 replication-orchestrator > Attempting to start pod = source-s3-read-751-2-aqnal for airbyte/source-s3:0.1.17 2022-08-25 09:50:04 replication-orchestrator > source-s3-read-751-2-aqnal stdoutLocalPort = 9879 2022-08-25 09:50:04 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:50:04 replication-orchestrator > source-s3-read-751-2-aqnal stderrLocalPort = 9880 2022-08-25 09:50:04 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:50:04 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:50:04 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-25 09:50:04 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-08-25 09:50:04 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-08-25 09:50:04 replication-orchestrator > Creating stdout socket server... 2022-08-25 09:50:04 replication-orchestrator > Creating pod source-s3-read-751-2-aqnal... 2022-08-25 09:50:04 replication-orchestrator > Creating stderr socket server... 2022-08-25 09:50:04 replication-orchestrator > Waiting for init container to be ready before copying files... 2022-08-25 09:50:04 replication-orchestrator > Init container present.. 2022-08-25 09:50:05 replication-orchestrator > Init container ready.. 2022-08-25 09:50:05 replication-orchestrator > Copying files... 2022-08-25 09:50:05 replication-orchestrator > Uploading file: input_state.json 2022-08-25 09:50:05 replication-orchestrator > kubectl cp /tmp/9907789e-fb77-44c0-a18d-7f11173a2d90/input_state.json default/source-s3-read-751-2-aqnal:/config/input_state.json -c init 2022-08-25 09:50:05 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:50:06 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:50:06 replication-orchestrator > Uploading file: source_config.json 2022-08-25 09:50:06 replication-orchestrator > kubectl cp /tmp/b72e5d61-9cb1-443f-8627-5aace488cc28/source_config.json default/source-s3-read-751-2-aqnal:/config/source_config.json -c init 2022-08-25 09:50:06 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:50:06 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:50:06 replication-orchestrator > Uploading file: source_catalog.json 2022-08-25 09:50:06 replication-orchestrator > kubectl cp /tmp/9ed2011e-d3b6-4966-8d98-2b23422c8080/source_catalog.json default/source-s3-read-751-2-aqnal:/config/source_catalog.json -c init 2022-08-25 09:50:06 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:50:06 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:50:06 replication-orchestrator > Uploading file: FINISHED_UPLOADING 2022-08-25 09:50:06 replication-orchestrator > kubectl cp /tmp/8898fd24-9c55-4995-a906-3a42dcca8471/FINISHED_UPLOADING default/source-s3-read-751-2-aqnal:/config/FINISHED_UPLOADING -c init 2022-08-25 09:50:06 replication-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:50:07 replication-orchestrator > kubectl cp complete, closing process 2022-08-25 09:50:07 replication-orchestrator > Waiting until pod is ready... 2022-08-25 09:50:08 replication-orchestrator > Setting stdout... 2022-08-25 09:50:08 replication-orchestrator > Setting stderr... 2022-08-25 09:50:09 replication-orchestrator > MetricClient has not been initialized. Must call MetricClientFactory.CreateMetricClient before using MetricClient. Using a dummy client for now. Ignore this if Airbyte is configured to not publish any metrics. 2022-08-25 09:50:09 replication-orchestrator > Reading pod IP... 2022-08-25 09:50:09 replication-orchestrator > Pod IP: 192.168.59.43 2022-08-25 09:50:09 replication-orchestrator > Using null stdin output stream... 2022-08-25 09:50:09 replication-orchestrator > Destination output thread started. 2022-08-25 09:50:09 destination > 2022-08-25 09:50:04 INFO i.a.i.d.p.PostgresDestination(main):90 - starting destination: class io.airbyte.integrations.destination.postgres.PostgresDestination 2022-08-25 09:50:09 replication-orchestrator > Replication thread started. 2022-08-25 09:50:09 destination > 2022-08-25 09:50:04 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-08-25 09:50:09 replication-orchestrator > Waiting for source and destination threads to complete. 2022-08-25 09:50:09 destination > 2022-08-25 09:50:04 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2022-08-25 09:50:09 destination > 2022-08-25 09:50:04 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE 2022-08-25 09:50:09 destination > 2022-08-25 09:50:04 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-08-25 09:50:09 destination > 2022-08-25 09:50:04 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:50:09 destination > 2022-08-25 09:50:04 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:50:09 destination > 2022-08-25 09:50:04 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:50:09 destination > 2022-08-25 09:50:04 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:50:09 destination > 2022-08-25 09:50:04 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL 2022-08-25 09:50:09 destination > 2022-08-25 09:50:04 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2022-08-25 09:50:09 destination > 2022-08-25 09:50:04 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2022-08-25 09:50:09 destination > 2022-08-25 09:50:04 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):97 - Write config: WriteConfig{streamName=s3_user_reports, namespace=null, outputSchemaName=airbyte, tmpTableName=_airbyte_tmp_bkb_s3_user_reports, outputTableName=_airbyte_raw_s3_user_reports, syncMode=append} 2022-08-25 09:50:09 destination > 2022-08-25 09:50:04 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2022-08-25 09:50:09 destination > 2022-08-25 09:50:04 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):122 - Preparing tmp tables in destination started for 1 streams 2022-08-25 09:50:09 destination > 2022-08-25 09:50:04 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):126 - Preparing tmp table in destination started for stream s3_user_reports. schema: airbyte, tmp table name: _airbyte_tmp_bkb_s3_user_reports 2022-08-25 09:50:09 destination > 2022-08-25 09:50:05 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):132 - Preparing tables in destination completed. 2022-08-25 09:50:09 replication-orchestrator > Unknown keyword existingJavaType - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-25 09:50:09 source > initialised stream with format: 2022-08-25 09:50:09 source > Starting syncing SourceS3 2022-08-25 09:50:09 source > initialised stream with format: {'encoding': 'utf8', 'filetype': 'csv', 'delimiter': ',', 'block_size': 10000, 'quote_char': '"', 'escape_char': '\\', 'double_quote': True, 'infer_datatypes': True, 'advanced_options': '{}', 'newlines_in_values': True, 'additional_reader_options': '{}'} 2022-08-25 09:50:09 source > Syncing stream: s3_user_reports 2022-08-25 09:50:09 source > Iterating S3 bucket 'kintaro-activepipe' 2022-08-25 09:50:18 source > timed out while running infer_schema_process after 4 seconds, retrying... 2022-08-25 09:50:33 source > determined master schema: {'User ID': 'integer', 'Office': 'string', 'Agent Name': 'string', 'Status': 'string', 'Email': 'string', 'Title': 'string', 'Contacts': 'integer', 'Shared Contacts': 'integer', 'Sents': 'integer', 'Opens': 'integer', 'Clicks': 'integer', 'Total Sends': 'integer', 'Sends Last 30 days': 'integer', 'Last Sent': 'string', 'Last Login': 'string'} 2022-08-25 09:50:34 source > finished reading a stream slice 2022-08-25 09:50:35 replication-orchestrator > Records read: 1000 (480 KB) 2022-08-25 09:50:35 source > finished reading a stream slice 2022-08-25 09:50:35 source > finished reading a stream slice 2022-08-25 09:50:35 replication-orchestrator > Records read: 2000 (959 KB) 2022-08-25 09:50:35 source > finished reading a stream slice 2022-08-25 09:50:36 source > finished reading a stream slice 2022-08-25 09:50:36 replication-orchestrator > Records read: 3000 (1 MB) 2022-08-25 09:50:36 source > finished reading a stream slice 2022-08-25 09:50:36 source > finished reading a stream slice 2022-08-25 09:50:36 replication-orchestrator > Records read: 4000 (1 MB) 2022-08-25 09:50:36 source > finished reading a stream slice 2022-08-25 09:50:37 source > finished reading a stream slice 2022-08-25 09:50:37 replication-orchestrator > Records read: 5000 (2 MB) 2022-08-25 09:50:37 source > finished reading a stream slice 2022-08-25 09:50:38 source > finished reading a stream slice 2022-08-25 09:50:38 replication-orchestrator > Records read: 6000 (2 MB) 2022-08-25 09:50:38 source > finished reading a stream slice 2022-08-25 09:50:38 source > finished reading a stream slice 2022-08-25 09:50:39 replication-orchestrator > Records read: 7000 (3 MB) 2022-08-25 09:50:39 source > finished reading a stream slice 2022-08-25 09:50:39 source > finished reading a stream slice 2022-08-25 09:50:39 replication-orchestrator > Records read: 8000 (3 MB) 2022-08-25 09:50:40 source > finished reading a stream slice 2022-08-25 09:50:40 source > finished reading a stream slice 2022-08-25 09:50:40 replication-orchestrator > Records read: 9000 (4 MB) 2022-08-25 09:50:40 source > finished reading a stream slice 2022-08-25 09:50:41 source > finished reading a stream slice 2022-08-25 09:50:41 replication-orchestrator > Records read: 10000 (4 MB) 2022-08-25 09:50:41 source > finished reading a stream slice 2022-08-25 09:50:42 source > finished reading a stream slice 2022-08-25 09:50:42 replication-orchestrator > Records read: 11000 (5 MB) 2022-08-25 09:50:42 source > finished reading a stream slice 2022-08-25 09:50:42 source > finished reading a stream slice 2022-08-25 09:50:42 replication-orchestrator > Records read: 12000 (5 MB) 2022-08-25 09:50:43 source > finished reading a stream slice 2022-08-25 09:50:43 source > finished reading a stream slice 2022-08-25 09:50:43 replication-orchestrator > Records read: 13000 (6 MB) 2022-08-25 09:50:43 destination > 2022-08-25 09:50:43 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing s3_user_reports: 13337 records (24 MB) 2022-08-25 09:50:43 source > finished reading a stream slice 2022-08-25 09:50:44 replication-orchestrator > Records read: 14000 (6 MB) 2022-08-25 09:50:44 source > finished reading a stream slice 2022-08-25 09:50:44 source > finished reading a stream slice 2022-08-25 09:50:44 replication-orchestrator > Records read: 15000 (7 MB) 2022-08-25 09:50:44 source > finished reading a stream slice 2022-08-25 09:50:45 source > finished reading a stream slice 2022-08-25 09:50:45 replication-orchestrator > Records read: 16000 (7 MB) 2022-08-25 09:50:45 source > finished reading a stream slice 2022-08-25 09:50:45 source > finished reading a stream slice 2022-08-25 09:50:46 replication-orchestrator > Records read: 17000 (7 MB) 2022-08-25 09:50:46 source > finished reading a stream slice 2022-08-25 09:50:46 source > finished reading a stream slice 2022-08-25 09:50:46 replication-orchestrator > Records read: 18000 (8 MB) 2022-08-25 09:50:47 source > finished reading a stream slice 2022-08-25 09:50:47 source > finished reading a stream slice 2022-08-25 09:50:47 replication-orchestrator > Records read: 19000 (8 MB) 2022-08-25 09:50:47 source > finished reading a stream slice 2022-08-25 09:50:47 source > finished reading a stream slice 2022-08-25 09:50:48 replication-orchestrator > Records read: 20000 (9 MB) 2022-08-25 09:50:48 source > finished reading a stream slice 2022-08-25 09:50:48 source > finished reading a stream slice 2022-08-25 09:50:48 replication-orchestrator > Records read: 21000 (9 MB) 2022-08-25 09:50:49 source > finished reading a stream slice 2022-08-25 09:50:49 source > finished reading a stream slice 2022-08-25 09:50:49 replication-orchestrator > Records read: 22000 (10 MB) 2022-08-25 09:50:49 source > finished reading a stream slice 2022-08-25 09:50:50 source > finished reading a stream slice 2022-08-25 09:50:50 replication-orchestrator > Records read: 23000 (10 MB) 2022-08-25 09:50:50 source > finished reading a stream slice 2022-08-25 09:50:50 source > finished reading a stream slice 2022-08-25 09:50:51 replication-orchestrator > Records read: 24000 (11 MB) 2022-08-25 09:50:51 source > finished reading a stream slice 2022-08-25 09:50:51 source > finished reading a stream slice 2022-08-25 09:50:51 replication-orchestrator > Records read: 25000 (11 MB) 2022-08-25 09:50:52 source > finished reading a stream slice 2022-08-25 09:50:52 replication-orchestrator > Records read: 26000 (12 MB) 2022-08-25 09:50:52 source > finished reading a stream slice 2022-08-25 09:50:52 source > finished reading a stream slice 2022-08-25 09:50:52 destination > 2022-08-25 09:50:52 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing s3_user_reports: 13291 records (24 MB) 2022-08-25 09:50:52 replication-orchestrator > Records read: 27000 (12 MB) 2022-08-25 09:50:53 source > finished reading a stream slice 2022-08-25 09:50:53 source > finished reading a stream slice 2022-08-25 09:50:53 replication-orchestrator > Records read: 28000 (13 MB) 2022-08-25 09:50:53 source > finished reading a stream slice 2022-08-25 09:50:54 source > finished reading a stream slice 2022-08-25 09:50:54 replication-orchestrator > Records read: 29000 (13 MB) 2022-08-25 09:50:54 source > finished reading a stream slice 2022-08-25 09:50:54 source > finished reading a stream slice 2022-08-25 09:50:54 replication-orchestrator > Records read: 30000 (14 MB) 2022-08-25 09:50:55 source > finished reading a stream slice 2022-08-25 09:50:55 source > finished reading a stream slice 2022-08-25 09:50:55 replication-orchestrator > Records read: 31000 (14 MB) 2022-08-25 09:50:55 source > finished reading a stream slice 2022-08-25 09:50:56 source > finished reading a stream slice 2022-08-25 09:50:56 replication-orchestrator > Records read: 32000 (14 MB) 2022-08-25 09:50:56 source > finished reading a stream slice 2022-08-25 09:50:57 source > finished reading a stream slice 2022-08-25 09:50:57 replication-orchestrator > Records read: 33000 (15 MB) 2022-08-25 09:50:57 source > finished reading a stream slice 2022-08-25 09:50:57 source > finished reading a stream slice 2022-08-25 09:50:57 replication-orchestrator > Records read: 34000 (15 MB) 2022-08-25 09:50:58 source > finished reading a stream slice 2022-08-25 09:50:58 source > finished reading a stream slice 2022-08-25 09:50:58 replication-orchestrator > Records read: 35000 (16 MB) 2022-08-25 09:50:58 source > finished reading a stream slice 2022-08-25 09:50:59 source > finished reading a stream slice 2022-08-25 09:50:59 replication-orchestrator > Records read: 36000 (16 MB) 2022-08-25 09:50:59 source > finished reading a stream slice 2022-08-25 09:50:59 replication-orchestrator > Records read: 37000 (17 MB) 2022-08-25 09:50:59 source > finished reading a stream slice 2022-08-25 09:51:00 source > finished reading a stream slice 2022-08-25 09:51:00 replication-orchestrator > Records read: 38000 (17 MB) 2022-08-25 09:51:00 source > finished reading a stream slice 2022-08-25 09:51:00 source > finished reading a stream slice 2022-08-25 09:51:01 replication-orchestrator > Records read: 39000 (18 MB) 2022-08-25 09:51:01 source > finished reading a stream slice 2022-08-25 09:51:01 source > finished reading a stream slice 2022-08-25 09:51:01 replication-orchestrator > Records read: 40000 (18 MB) 2022-08-25 09:51:01 destination > 2022-08-25 09:51:01 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing s3_user_reports: 13321 records (24 MB) 2022-08-25 09:51:02 source > finished reading a stream slice 2022-08-25 09:51:02 source > finished reading a stream slice 2022-08-25 09:51:02 replication-orchestrator > Records read: 41000 (19 MB) 2022-08-25 09:51:02 source > finished reading a stream slice 2022-08-25 09:51:03 source > finished reading a stream slice 2022-08-25 09:51:03 replication-orchestrator > Records read: 42000 (19 MB) 2022-08-25 09:51:03 source > finished reading a stream slice 2022-08-25 09:51:03 source > finished reading a stream slice 2022-08-25 09:51:04 replication-orchestrator > Records read: 43000 (20 MB) 2022-08-25 09:51:04 source > finished reading a stream slice 2022-08-25 09:51:04 source > finished reading a stream slice 2022-08-25 09:51:04 replication-orchestrator > Records read: 44000 (20 MB) 2022-08-25 09:51:05 source > finished reading a stream slice 2022-08-25 09:51:05 source > finished reading a stream slice 2022-08-25 09:51:05 replication-orchestrator > Records read: 45000 (21 MB) 2022-08-25 09:51:05 source > finished reading a stream slice 2022-08-25 09:51:06 source > finished reading a stream slice 2022-08-25 09:51:06 replication-orchestrator > Records read: 46000 (21 MB) 2022-08-25 09:51:06 source > finished reading a stream slice 2022-08-25 09:51:06 replication-orchestrator > Records read: 47000 (21 MB) 2022-08-25 09:51:06 source > finished reading a stream slice 2022-08-25 09:51:07 source > finished reading a stream slice 2022-08-25 09:51:07 replication-orchestrator > Records read: 48000 (22 MB) 2022-08-25 09:51:07 source > finished reading a stream slice 2022-08-25 09:51:07 source > finished reading a stream slice 2022-08-25 09:51:07 replication-orchestrator > Records read: 49000 (22 MB) 2022-08-25 09:51:08 source > finished reading a stream slice 2022-08-25 09:51:08 source > Read 49074 records from s3_user_reports stream 2022-08-25 09:51:08 source > Finished syncing s3_user_reports 2022-08-25 09:51:08 source > SourceS3 runtimes: Syncing stream s3_user_reports 0:00:58.395763 2022-08-25 09:51:08 source > Finished syncing SourceS3 2022-08-25 09:51:08 replication-orchestrator > Source has no more messages, closing connection. 2022-08-25 09:51:08 replication-orchestrator > (pod: default / source-s3-read-751-2-aqnal) - Closed all resources for pod 2022-08-25 09:51:08 replication-orchestrator > Total records read: 49168 (23 MB) 2022-08-25 09:51:08 replication-orchestrator > One of source or destination thread complete. Waiting on the other. 2022-08-25 09:51:09 destination > 2022-08-25 09:51:09 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2022-08-25 09:51:09 destination > 2022-08-25 09:51:09 INFO i.a.i.d.b.BufferedStreamConsumer(close):171 - executing on success close procedure. 2022-08-25 09:51:09 destination > 2022-08-25 09:51:09 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):86 - Flushing s3_user_reports: 9125 records (17 MB) 2022-08-25 09:51:09 destination > 2022-08-25 09:51:09 INFO i.a.i.d.j.SqlOperations(onDestinationCloseOperations):137 - No onDestinationCloseOperations required for this destination. 2022-08-25 09:51:09 destination > 2022-08-25 09:51:09 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):162 - Finalizing tables in destination started for 1 streams 2022-08-25 09:51:09 destination > 2022-08-25 09:51:09 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):167 - Finalizing stream s3_user_reports. schema airbyte, tmp table _airbyte_tmp_bkb_s3_user_reports, final table _airbyte_raw_s3_user_reports 2022-08-25 09:51:09 destination > 2022-08-25 09:51:09 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):180 - Executing finalization of tables. 2022-08-25 09:51:10 destination > 2022-08-25 09:51:10 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):182 - Finalizing tables in destination completed. 2022-08-25 09:51:10 destination > 2022-08-25 09:51:10 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):185 - Cleaning tmp tables in destination started for 1 streams 2022-08-25 09:51:10 destination > 2022-08-25 09:51:10 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):189 - Cleaning tmp table in destination started for stream s3_user_reports. schema airbyte, tmp table name: _airbyte_tmp_bkb_s3_user_reports 2022-08-25 09:51:10 destination > 2022-08-25 09:51:10 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):194 - Cleaning tmp tables in destination completed. 2022-08-25 09:51:10 replication-orchestrator > State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@6514cf12[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@29f2697c[type=,stream=,global=,data={"s3_user_reports":{"_ab_source_file_last_modified":"2022-08-25T09:00:46+0000","schema":{"User ID":"integer","Office":"string","Agent Name":"string","Status":"string","Email":"string","Title":"string","Contacts":"integer","Shared Contacts":"integer","Sents":"integer","Opens":"integer","Clicks":"integer","Total Sends":"integer","Sends Last 30 days":"integer","Last Sent":"string","Last Login":"string","_ab_additional_properties":"object","_ab_source_file_last_modified":"string","_ab_source_file_url":"string"},"history":{"2022-08-22":["20220822_williampitt_activepipe_user_reports.csv"],"2022-08-23":["20220823_williampitt_activepipe_user_reports.csv"],"2022-08-24":["20220824_williampitt_activepipe_user_reports.csv"],"2022-08-25":["20220825_williampitt_activepipe_user_reports.csv"]}}},additionalProperties={}],trace=,additionalProperties={}] 2022-08-25 09:51:10 destination > 2022-08-25 09:51:10 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination 2022-08-25 09:51:10 destination > 2022-08-25 09:51:10 INFO i.a.i.d.p.PostgresDestination(main):92 - completed destination: class io.airbyte.integrations.destination.postgres.PostgresDestination 2022-08-25 09:51:10 replication-orchestrator > (pod: default / destination-postgres-write-751-2-uzlwv) - Closed all resources for pod 2022-08-25 09:51:10 replication-orchestrator > Source and destination threads complete. 2022-08-25 09:51:10 replication-orchestrator > sync summary: io.airbyte.config.ReplicationAttemptSummary@14d1737a[status=completed,recordsSynced=49074,bytesSynced=24123540,startTime=1661420997405,endTime=1661421070492,totalStats=io.airbyte.config.SyncStats@482a58c7[recordsEmitted=49074,bytesEmitted=24123540,stateMessagesEmitted=94,recordsCommitted=49074],streamStats=[io.airbyte.config.StreamSyncStats@3e74fd84[streamName=s3_user_reports,stats=io.airbyte.config.SyncStats@147efd9[recordsEmitted=49074,bytesEmitted=24123540,stateMessagesEmitted=,recordsCommitted=49074]]]] 2022-08-25 09:51:10 replication-orchestrator > Source output at least one state message 2022-08-25 09:51:10 replication-orchestrator > State capture: Updated state to: Optional[io.airbyte.config.State@baa9ce4[state={"s3_user_reports":{"_ab_source_file_last_modified":"2022-08-25T09:00:46+0000","schema":{"User ID":"integer","Office":"string","Agent Name":"string","Status":"string","Email":"string","Title":"string","Contacts":"integer","Shared Contacts":"integer","Sents":"integer","Opens":"integer","Clicks":"integer","Total Sends":"integer","Sends Last 30 days":"integer","Last Sent":"string","Last Login":"string","_ab_additional_properties":"object","_ab_source_file_last_modified":"string","_ab_source_file_url":"string"},"history":{"2022-08-22":["20220822_williampitt_activepipe_user_reports.csv"],"2022-08-23":["20220823_williampitt_activepipe_user_reports.csv"],"2022-08-24":["20220824_williampitt_activepipe_user_reports.csv"],"2022-08-25":["20220825_williampitt_activepipe_user_reports.csv"]}}}]] 2022-08-25 09:51:10 replication-orchestrator > Returning output... 2022-08-25 09:51:10 replication-orchestrator > Writing async status SUCCEEDED for KubePodInfo[namespace=default, name=orchestrator-repl-job-751-attempt-2]... 2022-08-25 09:51:18 normalization-orchestrator > Writing async status INITIALIZING for KubePodInfo[namespace=default, name=orchestrator-norm-job-751-attempt-2]... 2022-08-25 09:51:10 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):322 - Stopping temporal heartbeating... 2022-08-25 09:51:10 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-08-25 09:51:10 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):161 - sync summary: io.airbyte.config.StandardSyncOutput@38114f03[standardSyncSummary=io.airbyte.config.StandardSyncSummary@4b35bbd4[status=completed,recordsSynced=49074,bytesSynced=24123540,startTime=1661420997405,endTime=1661421070492,totalStats=io.airbyte.config.SyncStats@1418162[recordsEmitted=49074,bytesEmitted=24123540,stateMessagesEmitted=94,recordsCommitted=49074],streamStats=[io.airbyte.config.StreamSyncStats@7df2430c[streamName=s3_user_reports,stats=io.airbyte.config.SyncStats@4fa972e6[recordsEmitted=49074,bytesEmitted=24123540,stateMessagesEmitted=,recordsCommitted=49074]]]],normalizationSummary=,state=io.airbyte.config.State@29a48bdc[state={"s3_user_reports":{"_ab_source_file_last_modified":"2022-08-25T09:00:46+0000","schema":{"User ID":"integer","Office":"string","Agent Name":"string","Status":"string","Email":"string","Title":"string","Contacts":"integer","Shared Contacts":"integer","Sents":"integer","Opens":"integer","Clicks":"integer","Total Sends":"integer","Sends Last 30 days":"integer","Last Sent":"string","Last Login":"string","_ab_additional_properties":"object","_ab_source_file_last_modified":"string","_ab_source_file_url":"string"},"history":{"2022-08-22":["20220822_williampitt_activepipe_user_reports.csv"],"2022-08-23":["20220823_williampitt_activepipe_user_reports.csv"],"2022-08-24":["20220824_williampitt_activepipe_user_reports.csv"],"2022-08-25":["20220825_williampitt_activepipe_user_reports.csv"]}}}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@24e3451b[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@4be698a8[stream=io.airbyte.protocol.models.AirbyteStream@4fdced70[name=s3_user_reports,jsonSchema={"type":"object","properties":{"Email":{"type":["null","string"]},"Opens":{"type":["null","number"]},"Sents":{"type":["null","number"]},"Title":{"type":["null","string"]},"Clicks":{"type":["null","number"]},"Office":{"type":["null","string"]},"Status":{"type":["null","string"]},"User ID":{"type":["null","integer"]},"Contacts":{"type":["null","number"]},"Last Sent":{"type":["null","string"]},"Agent Name":{"type":["null","string"]},"Last Login":{"type":["null","string"]},"Total Sends":{"type":["null","number"]},"Shared Contacts":{"type":["null","number"]},"Sends Last 30 days":{"type":["null","number"]},"_ab_source_file_url":{"type":"string"},"_ab_additional_properties":{"type":"object"},"_ab_source_file_last_modified":{"type":"string","format":"date-time"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[_ab_source_file_last_modified],sourceDefinedPrimaryKey=[],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[_ab_source_file_last_modified],destinationSyncMode=append,primaryKey=[],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-08-25 09:51:10 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-08-25 09:51:10 INFO i.a.w.t.TemporalAttemptExecution(get):107 - Cloud storage job log path: /workspace/751/2/logs.log 2022-08-25 09:51:10 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.41-alpha 2022-08-25 09:51:10 INFO i.a.w.t.s.LauncherWorker(lambda$run$3):142 - Creating orchestrator-norm-job-751-attempt-2 for attempt number: 2 2022-08-25 09:51:10 WARN i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):200 - There are currently running pods for the connection: [orchestrator-repl-job-751-attempt-2] 2022-08-25 09:51:10 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):202 - Attempting to delete pods: [orchestrator-repl-job-751-attempt-2] 2022-08-25 09:51:10 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):207 - Waiting for deletion... 2022-08-25 09:51:11 WARN i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):200 - There are currently running pods for the connection: [orchestrator-repl-job-751-attempt-2] 2022-08-25 09:51:11 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):202 - Attempting to delete pods: [orchestrator-repl-job-751-attempt-2] 2022-08-25 09:51:11 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):207 - Waiting for deletion... 2022-08-25 09:51:12 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):214 - Successfully deleted all running pods for the connection! 2022-08-25 09:51:12 INFO i.a.w.p.AsyncOrchestratorPodProcess(create):318 - Waiting for pod to be running... 2022-08-25 09:51:14 INFO i.a.w.p.AsyncOrchestratorPodProcess(create):341 - Pod default/orchestrator-norm-job-751-attempt-2 is running on 192.168.82.211 2022-08-25 09:51:14 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: destinationLauncherConfig.json 2022-08-25 09:51:14 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/68e41578-7377-468f-b6de-3d3df19fbb00/destinationLauncherConfig.json default/orchestrator-norm-job-751-attempt-2:/config/destinationLauncherConfig.json -c main 2022-08-25 09:51:15 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:51:15 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:51:15 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: envMap.json 2022-08-25 09:51:15 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/6d640b74-db24-4b19-894a-7977ce4008b8/envMap.json default/orchestrator-norm-job-751-attempt-2:/config/envMap.json -c main 2022-08-25 09:51:15 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:51:15 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:51:15 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: input.json 2022-08-25 09:51:15 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/c138e265-1a68-4ccd-8d77-f00924324b1d/input.json default/orchestrator-norm-job-751-attempt-2:/config/input.json -c main 2022-08-25 09:51:15 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:51:16 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:51:16 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: KUBE_POD_INFO 2022-08-25 09:51:16 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/b9367f26-1559-4196-89f7-ce4778e415f0/KUBE_POD_INFO default/orchestrator-norm-job-751-attempt-2:/config/KUBE_POD_INFO -c main 2022-08-25 09:51:16 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:51:16 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:51:16 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: application.txt 2022-08-25 09:51:16 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/13509e2e-6c61-4190-b264-e8b3d231cde8/application.txt default/orchestrator-norm-job-751-attempt-2:/config/application.txt -c main 2022-08-25 09:51:16 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:51:16 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:51:16 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: jobRunConfig.json 2022-08-25 09:51:16 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/fdec64ae-130a-4d4b-b735-8fb6c5bd7b96/jobRunConfig.json default/orchestrator-norm-job-751-attempt-2:/config/jobRunConfig.json -c main 2022-08-25 09:51:16 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:51:17 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:51:17 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: FINISHED_UPLOADING 2022-08-25 09:51:17 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/56f3cb5c-bd33-4219-97f5-19a2c8a7846b/FINISHED_UPLOADING default/orchestrator-norm-job-751-attempt-2:/config/FINISHED_UPLOADING -c main 2022-08-25 09:51:17 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:51:17 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:51:19 normalization-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_CPU_REQUEST: 'null' 2022-08-25 09:51:19 normalization-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_CPU_LIMIT: 'null' 2022-08-25 09:51:19 normalization-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_REQUEST: 'null' 2022-08-25 09:51:19 normalization-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_LIMIT: 'null' 2022-08-25 09:51:19 normalization-orchestrator > Using default value for environment variable JOB_KUBE_TOLERATIONS: '' 2022-08-25 09:51:19 normalization-orchestrator > Using default value for environment variable JOB_KUBE_NODE_SELECTORS: '' 2022-08-25 09:51:19 normalization-orchestrator > Using default value for environment variable JOB_KUBE_ANNOTATIONS: '' 2022-08-25 09:51:19 normalization-orchestrator > Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_SECRET: '' 2022-08-25 09:51:19 normalization-orchestrator > Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-08-25 09:51:19 normalization-orchestrator > Using default value for environment variable JOB_KUBE_SIDECAR_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-08-25 09:51:19 normalization-orchestrator > Using default value for environment variable JOB_KUBE_SOCAT_IMAGE: 'alpine/socat:1.7.4.3-r0' 2022-08-25 09:51:19 normalization-orchestrator > Using default value for environment variable JOB_KUBE_BUSYBOX_IMAGE: 'busybox:1.28' 2022-08-25 09:51:19 normalization-orchestrator > Using default value for environment variable JOB_KUBE_CURL_IMAGE: 'curlimages/curl:7.83.1' 2022-08-25 09:51:19 normalization-orchestrator > Using default value for environment variable DEPLOYMENT_MODE: 'OSS' 2022-08-25 09:51:19 normalization-orchestrator > Using Kubernetes namespace: default 2022-08-25 09:51:19 normalization-orchestrator > Logging initialized @5712ms to org.eclipse.jetty.util.log.Slf4jLog 2022-08-25 09:51:19 normalization-orchestrator > jetty-9.4.31.v20200723; built: 2020-07-23T17:57:36.812Z; git: 450ba27947e13e66baa8cd1ce7e85a4461cacc1d; jvm 19-ea+32-2220 2022-08-25 09:51:19 normalization-orchestrator > Started o.e.j.s.ServletContextHandler@19c1820d{/,null,AVAILABLE} 2022-08-25 09:51:19 normalization-orchestrator > Started ServerConnector@5df63359{HTTP/1.1, (http/1.1)}{0.0.0.0:9000} 2022-08-25 09:51:19 normalization-orchestrator > Started @5845ms 2022-08-25 09:51:19 normalization-orchestrator > Writing async status RUNNING for KubePodInfo[namespace=default, name=orchestrator-norm-job-751-attempt-2]... 2022-08-25 09:51:19 normalization-orchestrator > Setting up normalization worker... 2022-08-25 09:51:19 normalization-orchestrator > Running normalization worker... 2022-08-25 09:51:19 normalization-orchestrator > Running normalization. 2022-08-25 09:51:19 normalization-orchestrator > Running with normalization version: airbyte/normalization:0.2.12 2022-08-25 09:51:19 normalization-orchestrator > Attempting to start pod = normalization-normalize-751-2-ewpof for airbyte/normalization:0.2.12 2022-08-25 09:51:19 normalization-orchestrator > normalization-normalize-751-2-ewpof stdoutLocalPort = 9880 2022-08-25 09:51:19 normalization-orchestrator > normalization-normalize-751-2-ewpof stderrLocalPort = 9877 2022-08-25 09:51:19 normalization-orchestrator > Creating stdout socket server... 2022-08-25 09:51:19 normalization-orchestrator > Creating stderr socket server... 2022-08-25 09:51:19 normalization-orchestrator > Creating pod normalization-normalize-751-2-ewpof... 2022-08-25 09:51:20 normalization-orchestrator > Waiting for init container to be ready before copying files... 2022-08-25 09:51:20 normalization-orchestrator > Init container present.. 2022-08-25 09:51:22 normalization-orchestrator > Init container ready.. 2022-08-25 09:51:22 normalization-orchestrator > Copying files... 2022-08-25 09:51:22 normalization-orchestrator > Uploading file: destination_config.json 2022-08-25 09:51:22 normalization-orchestrator > kubectl cp /tmp/b81cd8e7-dfa5-4e68-912d-6d545444716e/destination_config.json default/normalization-normalize-751-2-ewpof:/config/destination_config.json -c init 2022-08-25 09:51:22 normalization-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:51:22 normalization-orchestrator > kubectl cp complete, closing process 2022-08-25 09:51:22 normalization-orchestrator > Uploading file: destination_catalog.json 2022-08-25 09:51:22 normalization-orchestrator > kubectl cp /tmp/a3326a53-79ed-4413-a11a-17b360aaacb2/destination_catalog.json default/normalization-normalize-751-2-ewpof:/config/destination_catalog.json -c init 2022-08-25 09:51:22 normalization-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:51:22 normalization-orchestrator > kubectl cp complete, closing process 2022-08-25 09:51:22 normalization-orchestrator > Uploading file: FINISHED_UPLOADING 2022-08-25 09:51:22 normalization-orchestrator > kubectl cp /tmp/2e314147-a41a-4d66-99e3-ff5364670fed/FINISHED_UPLOADING default/normalization-normalize-751-2-ewpof:/config/FINISHED_UPLOADING -c init 2022-08-25 09:51:22 normalization-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:51:23 normalization-orchestrator > kubectl cp complete, closing process 2022-08-25 09:51:23 normalization-orchestrator > Waiting until pod is ready... 2022-08-25 09:51:25 normalization-orchestrator > Setting stdout... 2022-08-25 09:51:25 normalization-orchestrator > Setting stderr... 2022-08-25 09:51:26 normalization-orchestrator > MetricClient has not been initialized. Must call MetricClientFactory.CreateMetricClient before using MetricClient. Using a dummy client for now. Ignore this if Airbyte is configured to not publish any metrics. 2022-08-25 09:51:26 normalization-orchestrator > Reading pod IP... 2022-08-25 09:51:26 normalization-orchestrator > Pod IP: 192.168.70.14 2022-08-25 09:51:26 normalization-orchestrator > Using null stdin output stream... 2022-08-25 09:51:26 normalization > Running: transform-config --config destination_config.json --integration-type postgres --out /config 2022-08-25 09:51:26 normalization > Namespace(config='destination_config.json', integration_type=, out='/config') 2022-08-25 09:51:26 normalization > transform_postgres 2022-08-25 09:51:26 normalization > Running: transform-catalog --integration-type postgres --profile-config-dir /config --catalog destination_catalog.json --out /config/models/generated/ --json-column _airbyte_data 2022-08-25 09:51:26 normalization > Processing destination_catalog.json... 2022-08-25 09:51:26 normalization > Generating airbyte_ctes/airbyte/s3_user_reports_ab1.sql from s3_user_reports 2022-08-25 09:51:26 normalization > Generating airbyte_ctes/airbyte/s3_user_reports_ab2.sql from s3_user_reports 2022-08-25 09:51:26 normalization > Generating airbyte_ctes/airbyte/s3_user_reports_ab3.sql from s3_user_reports 2022-08-25 09:51:26 normalization > Generating airbyte_incremental/airbyte/s3_user_reports.sql from s3_user_reports 2022-08-25 09:51:26 normalization > detected no config file for ssh, assuming ssh is off. 2022-08-25 09:51:28 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2022-08-25 09:51:28 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2022-08-25 09:51:28 normalization > 2022-08-25 09:51:28 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2022-08-25 09:51:28 normalization > 2022-08-25 09:51:31 normalization > 09:51:31 Running with dbt=1.0.0 2022-08-25 09:51:31 normalization > 09:51:31 Partial parse save file not found. Starting full parse. 2022-08-25 09:51:32 normalization > 09:51:32 [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2022-08-25 09:51:32 normalization > There are 2 unused configuration paths: 2022-08-25 09:51:32 normalization > - models.airbyte_utils.generated.airbyte_views 2022-08-25 09:51:32 normalization > - models.airbyte_utils.generated.airbyte_tables 2022-08-25 09:51:32 normalization > 2022-08-25 09:51:32 normalization > 09:51:32 Found 4 models, 0 tests, 0 snapshots, 0 analyses, 558 macros, 0 operations, 0 seed files, 1 source, 0 exposures, 0 metrics 2022-08-25 09:51:32 normalization > 09:51:32 2022-08-25 09:51:32 normalization > 09:51:32 Concurrency: 8 threads (target='prod') 2022-08-25 09:51:32 normalization > 09:51:32 2022-08-25 09:51:32 normalization > 09:51:32 1 of 1 START incremental model airbyte.s3_user_reports.................................................................. [RUN] 2022-08-25 09:51:33 normalization > 09:51:33 1 of 1 OK created incremental model airbyte.s3_user_reports............................................................. [INSERT 0 49075 in 1.05s] 2022-08-25 09:51:33 normalization > 09:51:33 2022-08-25 09:51:33 normalization > 09:51:33 Finished running 1 incremental model in 1.43s. 2022-08-25 09:51:34 normalization > 09:51:34 2022-08-25 09:51:34 normalization > 09:51:34 Completed successfully 2022-08-25 09:51:34 normalization > 09:51:34 2022-08-25 09:51:34 normalization > 09:51:34 Done. PASS=1 WARN=0 ERROR=0 SKIP=0 TOTAL=1 2022-08-25 09:51:34 normalization-orchestrator > (pod: default / normalization-normalize-751-2-ewpof) - Closed all resources for pod 2022-08-25 09:51:34 normalization-orchestrator > Normalization executed in 15 seconds. 2022-08-25 09:51:34 normalization-orchestrator > Normalization summary: io.airbyte.config.NormalizationSummary@25f0c5e7[startTime=1661421079752,endTime=1661421094792] 2022-08-25 09:51:34 normalization-orchestrator > Writing async status SUCCEEDED for KubePodInfo[namespace=default, name=orchestrator-norm-job-751-attempt-2]... 2022-08-25 09:51:43 dbt-orchestrator > Writing async status INITIALIZING for KubePodInfo[namespace=default, name=orchestrator-dbt-job-751-attempt-2]... 2022-08-25 09:51:43 dbt-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_CPU_REQUEST: 'null' 2022-08-25 09:51:43 dbt-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_CPU_LIMIT: 'null' 2022-08-25 09:51:43 dbt-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_REQUEST: 'null' 2022-08-25 09:51:43 dbt-orchestrator > Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_LIMIT: 'null' 2022-08-25 09:51:43 dbt-orchestrator > Using default value for environment variable JOB_KUBE_TOLERATIONS: '' 2022-08-25 09:51:43 dbt-orchestrator > Using default value for environment variable JOB_KUBE_NODE_SELECTORS: '' 2022-08-25 09:51:43 dbt-orchestrator > Using default value for environment variable JOB_KUBE_ANNOTATIONS: '' 2022-08-25 09:51:43 dbt-orchestrator > Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_SECRET: '' 2022-08-25 09:51:43 dbt-orchestrator > Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-08-25 09:51:43 dbt-orchestrator > Using default value for environment variable JOB_KUBE_SIDECAR_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-08-25 09:51:43 dbt-orchestrator > Using default value for environment variable JOB_KUBE_SOCAT_IMAGE: 'alpine/socat:1.7.4.3-r0' 2022-08-25 09:51:43 dbt-orchestrator > Using default value for environment variable JOB_KUBE_BUSYBOX_IMAGE: 'busybox:1.28' 2022-08-25 09:51:43 dbt-orchestrator > Using default value for environment variable JOB_KUBE_CURL_IMAGE: 'curlimages/curl:7.83.1' 2022-08-25 09:51:43 dbt-orchestrator > Using default value for environment variable DEPLOYMENT_MODE: 'OSS' 2022-08-25 09:51:43 dbt-orchestrator > Using Kubernetes namespace: default 2022-08-25 09:51:43 dbt-orchestrator > Logging initialized @5747ms to org.eclipse.jetty.util.log.Slf4jLog 2022-08-25 09:51:44 dbt-orchestrator > jetty-9.4.31.v20200723; built: 2020-07-23T17:57:36.812Z; git: 450ba27947e13e66baa8cd1ce7e85a4461cacc1d; jvm 19-ea+32-2220 2022-08-25 09:51:44 dbt-orchestrator > Started o.e.j.s.ServletContextHandler@180b3819{/,null,AVAILABLE} 2022-08-25 09:51:44 dbt-orchestrator > Started ServerConnector@297c9a9b{HTTP/1.1, (http/1.1)}{0.0.0.0:9000} 2022-08-25 09:51:44 dbt-orchestrator > Started @5885ms 2022-08-25 09:51:44 dbt-orchestrator > Writing async status RUNNING for KubePodInfo[namespace=default, name=orchestrator-dbt-job-751-attempt-2]... 2022-08-25 09:51:44 dbt-orchestrator > Setting up dbt worker... 2022-08-25 09:51:44 dbt-orchestrator > Running dbt worker... 2022-08-25 09:51:44 dbt-orchestrator > Running dbt transformation. 2022-08-25 09:51:44 dbt-orchestrator > Running with normalization version: airbyte/normalization:0.2.12 2022-08-25 09:51:44 dbt-orchestrator > Attempting to start pod = normalization-normalize-751-2-mmjpr for airbyte/normalization:0.2.12 2022-08-25 09:51:44 dbt-orchestrator > normalization-normalize-751-2-mmjpr stdoutLocalPort = 9879 2022-08-25 09:51:44 dbt-orchestrator > normalization-normalize-751-2-mmjpr stderrLocalPort = 9880 2022-08-25 09:51:44 dbt-orchestrator > Creating stdout socket server... 2022-08-25 09:51:44 dbt-orchestrator > Creating stderr socket server... 2022-08-25 09:51:44 dbt-orchestrator > Creating pod normalization-normalize-751-2-mmjpr... 2022-08-25 09:51:44 dbt-orchestrator > Waiting for init container to be ready before copying files... 2022-08-25 09:51:44 dbt-orchestrator > Init container present.. 2022-08-25 09:51:46 dbt-orchestrator > Init container ready.. 2022-08-25 09:51:46 dbt-orchestrator > Copying files... 2022-08-25 09:51:46 dbt-orchestrator > Uploading file: destination_config.json 2022-08-25 09:51:46 dbt-orchestrator > kubectl cp /tmp/1cd20493-cd5c-4c60-806b-02d33ca0c71c/destination_config.json default/normalization-normalize-751-2-mmjpr:/config/destination_config.json -c init 2022-08-25 09:51:46 dbt-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:51:46 dbt-orchestrator > kubectl cp complete, closing process 2022-08-25 09:51:46 dbt-orchestrator > Uploading file: FINISHED_UPLOADING 2022-08-25 09:51:46 dbt-orchestrator > kubectl cp /tmp/d179ea85-c297-4ebe-8468-96fd88cc383a/FINISHED_UPLOADING default/normalization-normalize-751-2-mmjpr:/config/FINISHED_UPLOADING -c init 2022-08-25 09:51:46 dbt-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:51:47 dbt-orchestrator > kubectl cp complete, closing process 2022-08-25 09:51:47 dbt-orchestrator > Waiting until pod is ready... 2022-08-25 09:51:47 dbt-orchestrator > Setting stdout... 2022-08-25 09:51:48 dbt-orchestrator > Setting stderr... 2022-08-25 09:51:49 dbt-orchestrator > MetricClient has not been initialized. Must call MetricClientFactory.CreateMetricClient before using MetricClient. Using a dummy client for now. Ignore this if Airbyte is configured to not publish any metrics. 2022-08-25 09:51:49 dbt-orchestrator > Reading pod IP... 2022-08-25 09:51:49 dbt-orchestrator > Pod IP: 192.168.66.166 2022-08-25 09:51:49 dbt-orchestrator > Using null stdin output stream... 2022-08-25 09:51:49 normalization > Running: git clone --depth 5 --single-branch $GIT_REPO git_repo 2022-08-25 09:51:49 normalization > Last 5 commits in git_repo: 2022-08-25 09:51:49 normalization > 6325314 Merge pull request #21 from Kintaro-io/mvp 2022-08-25 09:51:49 normalization > f8b58a4 Merge branch 'main' of https://github.com/Kintaro-io/kintaro-data-transform into mvp 2022-08-25 09:51:49 normalization > 105530f Updated models 2022-08-25 09:51:49 normalization > 6ac6e13 Updated models 2022-08-25 09:51:49 normalization > cb8869d Merge pull request #20 from Kintaro-io/mvp 2022-08-25 09:51:49 normalization > /config 2022-08-25 09:51:49 normalization > Running: transform-config --config destination_config.json --integration-type postgres --out /config 2022-08-25 09:51:49 normalization > Namespace(config='destination_config.json', integration_type=, out='/config') 2022-08-25 09:51:49 normalization > transform_postgres 2022-08-25 09:51:49 dbt-orchestrator > generic gobbler IOException: Socket closed. Typically happens when cancelling a job. 2022-08-25 09:51:49 dbt-orchestrator > (pod: default / normalization-normalize-751-2-mmjpr) - Closed all resources for pod 2022-08-25 09:51:49 dbt-orchestrator > generic gobbler IOException: Socket closed. Typically happens when cancelling a job. 2022-08-25 09:51:49 dbt-orchestrator > Attempting to start pod = dbt-custom-751-2-pzbvd for fishtownanalytics/dbt:1.0.0 2022-08-25 09:51:49 dbt-orchestrator > dbt-custom-751-2-pzbvd stdoutLocalPort = 9877 2022-08-25 09:51:49 dbt-orchestrator > dbt-custom-751-2-pzbvd stderrLocalPort = 9878 2022-08-25 09:51:49 dbt-orchestrator > Creating stdout socket server... 2022-08-25 09:51:49 dbt-orchestrator > Creating stderr socket server... 2022-08-25 09:51:49 dbt-orchestrator > Found entrypoint override: /bin/bash 2022-08-25 09:51:49 dbt-orchestrator > Creating pod dbt-custom-751-2-pzbvd... 2022-08-25 09:51:49 dbt-orchestrator > Waiting for init container to be ready before copying files... 2022-08-25 09:51:49 dbt-orchestrator > Init container present.. 2022-08-25 09:51:51 dbt-orchestrator > Init container ready.. 2022-08-25 09:51:51 dbt-orchestrator > Copying files... 2022-08-25 09:51:51 dbt-orchestrator > Uploading file: entrypoint.sh 2022-08-25 09:51:51 dbt-orchestrator > kubectl cp /tmp/4677d6b1-6276-4dad-8637-4a6383c348a4/entrypoint.sh default/dbt-custom-751-2-pzbvd:/config/entrypoint.sh -c init 2022-08-25 09:51:51 dbt-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:51:51 dbt-orchestrator > kubectl cp complete, closing process 2022-08-25 09:51:51 dbt-orchestrator > Uploading file: sshtunneling.sh 2022-08-25 09:51:51 dbt-orchestrator > kubectl cp /tmp/ffbbdc3b-3ae7-4d65-9b4c-bafcc10355b9/sshtunneling.sh default/dbt-custom-751-2-pzbvd:/config/sshtunneling.sh -c init 2022-08-25 09:51:51 dbt-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:51:52 dbt-orchestrator > kubectl cp complete, closing process 2022-08-25 09:51:52 dbt-orchestrator > Uploading file: FINISHED_UPLOADING 2022-08-25 09:51:52 dbt-orchestrator > kubectl cp /tmp/3d7f7cff-0258-4158-a5cf-f3e4154718f7/FINISHED_UPLOADING default/dbt-custom-751-2-pzbvd:/config/FINISHED_UPLOADING -c init 2022-08-25 09:51:52 dbt-orchestrator > Waiting for kubectl cp to complete 2022-08-25 09:51:52 dbt-orchestrator > kubectl cp complete, closing process 2022-08-25 09:51:52 dbt-orchestrator > Waiting until pod is ready... 2022-08-25 09:51:53 dbt-orchestrator > Setting stdout... 2022-08-25 09:51:54 dbt-orchestrator > Setting stderr... 2022-08-25 09:51:54 dbt-orchestrator > MetricClient has not been initialized. Must call MetricClientFactory.CreateMetricClient before using MetricClient. Using a dummy client for now. Ignore this if Airbyte is configured to not publish any metrics. 2022-08-25 09:51:54 dbt-orchestrator > Reading pod IP... 2022-08-25 09:51:54 dbt-orchestrator > Pod IP: 192.168.42.99 2022-08-25 09:51:54 dbt-orchestrator > Using null stdin output stream... 2022-08-25 09:51:54 dbt-orchestrator > (pod: default / dbt-custom-751-2-pzbvd) - Closed all resources for pod 2022-08-25 09:51:54 dbt-orchestrator > generic gobbler IOException: Socket closed. Typically happens when cancelling a job. 2022-08-25 09:51:54 dbt-orchestrator > Writing async status FAILED for KubePodInfo[namespace=default, name=orchestrator-dbt-job-751-attempt-2]... 2022-08-25 09:51:34 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):322 - Stopping temporal heartbeating... 2022-08-25 09:51:34 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-08-25 09:51:34 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-08-25 09:51:34 INFO i.a.w.t.TemporalAttemptExecution(get):107 - Cloud storage job log path: /workspace/751/2/logs.log 2022-08-25 09:51:34 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.39.41-alpha 2022-08-25 09:51:34 INFO i.a.w.t.s.LauncherWorker(lambda$run$3):142 - Creating orchestrator-dbt-job-751-attempt-2 for attempt number: 2 2022-08-25 09:51:35 WARN i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):200 - There are currently running pods for the connection: [orchestrator-norm-job-751-attempt-2] 2022-08-25 09:51:35 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):202 - Attempting to delete pods: [orchestrator-norm-job-751-attempt-2] 2022-08-25 09:51:35 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):207 - Waiting for deletion... 2022-08-25 09:51:36 WARN i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):200 - There are currently running pods for the connection: [orchestrator-norm-job-751-attempt-2] 2022-08-25 09:51:36 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):202 - Attempting to delete pods: [orchestrator-norm-job-751-attempt-2] 2022-08-25 09:51:36 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):207 - Waiting for deletion... 2022-08-25 09:51:37 INFO i.a.w.t.s.LauncherWorker(killRunningPodsForConnection):214 - Successfully deleted all running pods for the connection! 2022-08-25 09:51:37 INFO i.a.w.p.AsyncOrchestratorPodProcess(create):318 - Waiting for pod to be running... 2022-08-25 09:51:39 INFO i.a.w.p.AsyncOrchestratorPodProcess(create):341 - Pod default/orchestrator-dbt-job-751-attempt-2 is running on 192.168.88.10 2022-08-25 09:51:39 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: destinationLauncherConfig.json 2022-08-25 09:51:39 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/98d1264c-b488-4793-ada3-faedd35796dd/destinationLauncherConfig.json default/orchestrator-dbt-job-751-attempt-2:/config/destinationLauncherConfig.json -c main 2022-08-25 09:51:39 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:51:39 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:51:39 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: envMap.json 2022-08-25 09:51:39 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/66ff0582-6de0-4a20-a4d2-a12c6b5bf16a/envMap.json default/orchestrator-dbt-job-751-attempt-2:/config/envMap.json -c main 2022-08-25 09:51:39 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:51:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:51:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: input.json 2022-08-25 09:51:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/68994a08-a576-4f4a-b429-5c55e05fb76d/input.json default/orchestrator-dbt-job-751-attempt-2:/config/input.json -c main 2022-08-25 09:51:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:51:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:51:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: KUBE_POD_INFO 2022-08-25 09:51:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/62e78831-7000-4522-b14e-5adb3224cdf6/KUBE_POD_INFO default/orchestrator-dbt-job-751-attempt-2:/config/KUBE_POD_INFO -c main 2022-08-25 09:51:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:51:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:51:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: application.txt 2022-08-25 09:51:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/f0055958-58bb-4aa4-8c94-bf75d3cb51f9/application.txt default/orchestrator-dbt-job-751-attempt-2:/config/application.txt -c main 2022-08-25 09:51:40 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:51:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:51:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: jobRunConfig.json 2022-08-25 09:51:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/74b469b5-435a-45e4-954c-9352d6473974/jobRunConfig.json default/orchestrator-dbt-job-751-attempt-2:/config/jobRunConfig.json -c main 2022-08-25 09:51:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:51:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:51:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):361 - Uploading file: FINISHED_UPLOADING 2022-08-25 09:51:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):369 - kubectl cp /tmp/a6762125-c251-4f30-98da-6d9e232e1c13/FINISHED_UPLOADING default/orchestrator-dbt-job-751-attempt-2:/config/FINISHED_UPLOADING -c main 2022-08-25 09:51:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):372 - Waiting for kubectl cp to complete 2022-08-25 09:51:41 INFO i.a.w.p.AsyncOrchestratorPodProcess(copyFilesToKubeConfigVolumeMain):379 - kubectl cp complete, closing process 2022-08-25 09:51:55 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):322 - Stopping temporal heartbeating... 2022-08-25 09:51:55 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):158 - Completing future exceptionally... java.lang.RuntimeException: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:320) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.LauncherWorker.run(LauncherWorker.java:90) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at java.lang.Thread.run(Thread.java:1589) [?:?] Caused by: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at io.airbyte.workers.temporal.sync.LauncherWorker.lambda$run$3(LauncherWorker.java:181) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:315) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 3 more Caused by: io.airbyte.workers.exception.WorkerException: Non-zero exit code! at io.airbyte.workers.temporal.sync.LauncherWorker.lambda$run$3(LauncherWorker.java:165) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:315) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 3 more 2022-08-25 09:51:55 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-08-25 09:51:55 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-08-25 09:51:55 WARN i.t.i.a.POJOActivityTaskHandler(activityFailureToResult):307 - Activity failure. ActivityId=345440bf-03a6-3f9b-bb0b-e59905788317, activityType=Run, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: java.lang.RuntimeException: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:289) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.run(DbtTransformationActivityImpl.java:77) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) [?:?] at java.lang.Thread.run(Thread.java:1589) [?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: java.lang.RuntimeException: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:56) ~[temporal-serviceclient-1.8.1.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:448) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:51) ~[temporal-sdk-1.8.1.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:135) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.lambda$run$3(DbtTransformationActivityImpl.java:108) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:284) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 12 more Caused by: java.util.concurrent.ExecutionException: java.lang.RuntimeException: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:129) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.DbtTransformationActivityImpl.lambda$run$3(DbtTransformationActivityImpl.java:108) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:284) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 12 more Caused by: java.lang.RuntimeException: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:320) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.LauncherWorker.run(LauncherWorker.java:90) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Running the launcher dbt-orchestrator failed at io.airbyte.workers.temporal.sync.LauncherWorker.lambda$run$3(LauncherWorker.java:181) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:315) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.LauncherWorker.run(LauncherWorker.java:90) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Non-zero exit code! at io.airbyte.workers.temporal.sync.LauncherWorker.lambda$run$3(LauncherWorker.java:165) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:315) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.sync.LauncherWorker.run(LauncherWorker.java:90) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.39.41-alpha.jar:?] ... 1 more