2022-10-07 13:08:48 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Cloud storage job log path: /workspace/865/0/logs.log 2022-10-07 13:08:48 INFO i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.6 2022-10-07 13:09:21 destination > 2022-10-07 13:09:16 INFO i.a.i.d.r.RedshiftDestination(main):63 - starting destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-07 13:09:21 source > Starting syncing SourceIntercom 2022-10-07 13:09:21 source > Using start_date: 1646092800.0 2022-10-07 13:09:21 source > Syncing stream: contacts 2022-10-07 13:09:21 destination > 2022-10-07 13:09:16 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-10-07 13:08:48 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = source-intercom-check-865-0-hpxaw for airbyte/source-intercom:0.1.26 with resources io.airbyte.config.ResourceRequirements@9f6d799[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-07 13:08:48 INFO i.a.w.p.KubeProcessFactory(create):103 - source-intercom-check-865-0-hpxaw stdoutLocalPort = 9018 2022-10-07 13:08:48 INFO i.a.w.p.KubeProcessFactory(create):106 - source-intercom-check-865-0-hpxaw stderrLocalPort = 9020 2022-10-07 13:08:48 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:08:48 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-10-07 13:08:48 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:08:48 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):589 - Creating stdout socket server... 2022-10-07 13:08:48 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):607 - Creating stderr socket server... 2022-10-07 13:08:48 INFO i.a.w.p.KubePodProcess():520 - Creating pod source-intercom-check-865-0-hpxaw... 2022-10-07 13:08:48 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):309 - Waiting for init container to be ready before copying files... 2022-10-07 13:08:48 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):313 - Init container present.. 2022-10-07 13:08:50 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):316 - Init container ready.. 2022-10-07 13:08:50 INFO i.a.w.p.KubePodProcess():551 - Copying files... 2022-10-07 13:08:50 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: source_config.json 2022-10-07 13:08:50 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/a3e1263b-4fc0-482a-86c3-48850d5ea375/source_config.json dev/source-intercom-check-865-0-hpxaw:/config/source_config.json -c init 2022-10-07 13:08:50 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:08:51 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:08:51 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: FINISHED_UPLOADING 2022-10-07 13:08:51 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/8d674d1c-288f-47ef-b433-82dbe368f80e/FINISHED_UPLOADING dev/source-intercom-check-865-0-hpxaw:/config/FINISHED_UPLOADING -c init 2022-10-07 13:08:51 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:08:52 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):327 - Waiting for init container to terminate before checking exit value... 2022-10-07 13:08:52 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):332 - Init container terminated with exit value 0. 2022-10-07 13:08:52 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):277 - Init was successful; ignoring non-zero kubectl cp exit code for success indicator file. 2022-10-07 13:08:52 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:08:52 INFO i.a.w.p.KubePodProcess():554 - Waiting until pod is ready... 2022-10-07 13:08:53 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):598 - Setting stdout... 2022-10-07 13:08:53 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):610 - Setting stderr... 2022-10-07 13:08:54 INFO i.a.w.p.KubePodProcess():570 - Reading pod IP... 2022-10-07 13:08:54 INFO i.a.w.p.KubePodProcess():572 - Pod IP: 14.0.3.81 2022-10-07 13:08:54 INFO i.a.w.p.KubePodProcess():579 - Using null stdin output stream... 2022-10-07 13:08:55 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Check succeeded 2022-10-07 13:08:56 INFO i.a.w.p.KubePodProcess(close):737 - (pod: dev / source-intercom-check-865-0-hpxaw) - Closed all resources for pod 2022-10-07 13:08:56 INFO i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling... 2022-10-07 13:08:56 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:08:56 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-07 13:08:56 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:08:56 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Cloud storage job log path: /workspace/865/0/logs.log 2022-10-07 13:08:56 INFO i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.6 2022-10-07 13:08:56 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:08:56 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = destination-redshift-check-865-0-jacet for airbyte/destination-redshift:0.3.49 with resources io.airbyte.config.ResourceRequirements@9f6d799[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-07 13:08:56 INFO i.a.w.p.KubeProcessFactory(create):103 - destination-redshift-check-865-0-jacet stdoutLocalPort = 9019 2022-10-07 13:08:56 INFO i.a.w.p.KubeProcessFactory(create):106 - destination-redshift-check-865-0-jacet stderrLocalPort = 9021 2022-10-07 13:08:56 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-10-07 13:08:56 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:08:56 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):589 - Creating stdout socket server... 2022-10-07 13:08:56 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):607 - Creating stderr socket server... 2022-10-07 13:08:56 INFO i.a.w.p.KubePodProcess():520 - Creating pod destination-redshift-check-865-0-jacet... 2022-10-07 13:08:56 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):309 - Waiting for init container to be ready before copying files... 2022-10-07 13:08:56 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):313 - Init container present.. 2022-10-07 13:08:59 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):316 - Init container ready.. 2022-10-07 13:08:59 INFO i.a.w.p.KubePodProcess():551 - Copying files... 2022-10-07 13:08:59 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: source_config.json 2022-10-07 13:08:59 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/73cf4aba-fecb-401b-9003-377b602ade24/source_config.json dev/destination-redshift-check-865-0-jacet:/config/source_config.json -c init 2022-10-07 13:08:59 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:08:59 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:08:59 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: FINISHED_UPLOADING 2022-10-07 13:08:59 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/026c70eb-1f12-498f-afef-0db07c8ba9de/FINISHED_UPLOADING dev/destination-redshift-check-865-0-jacet:/config/FINISHED_UPLOADING -c init 2022-10-07 13:08:59 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:09:00 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:09:00 INFO i.a.w.p.KubePodProcess():554 - Waiting until pod is ready... 2022-10-07 13:09:01 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):598 - Setting stdout... 2022-10-07 13:09:01 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):610 - Setting stderr... 2022-10-07 13:09:02 INFO i.a.w.p.KubePodProcess():570 - Reading pod IP... 2022-10-07 13:09:02 INFO i.a.w.p.KubePodProcess():572 - Pod IP: 14.0.3.67 2022-10-07 13:09:02 INFO i.a.w.p.KubePodProcess():579 - Using null stdin output stream... 2022-10-07 13:09:03 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:09:03 INFO i.a.i.d.r.RedshiftDestination(main):63 - starting destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-07 13:09:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:09:04 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-10-07 13:09:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:09:04 INFO i.a.i.b.IntegrationRunner(runInternal):104 - Running integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-07 13:09:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:09:04 INFO i.a.i.b.IntegrationRunner(runInternal):105 - Command: CHECK 2022-10-07 13:09:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:09:04 INFO i.a.i.b.IntegrationRunner(runInternal):106 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-10-07 13:09:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:09:04 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-07 13:09:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:09:04 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-07 13:09:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:09:04 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-07 13:09:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:09:04 WARN i.a.i.d.r.RedshiftDestination(determineUploadMode):54 - The "standard" upload mode is not performant, and is not recommended for production. Please use the Amazon S3 upload mode if you are syncing a large amount of data. 2022-10-07 13:09:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:09:04 INFO i.a.i.d.j.c.SwitchingDestination(check):55 - Using destination type: STANDARD 2022-10-07 13:09:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:09:04 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2022-10-07 13:09:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:09:04 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2022-10-07 13:09:05 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:09:05 INFO c.z.h.p.PoolBase(getAndSetNetworkTimeout):536 - HikariPool-1 - Driver does not support get/set network timeout for connections. ([Amazon][JDBC](10220) Driver does not support this optional feature.) 2022-10-07 13:09:05 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:09:05 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated... 2022-10-07 13:09:05 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:09:05 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed. 2022-10-07 13:09:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:09:06 INFO i.a.i.b.IntegrationRunner(runInternal):152 - Completed integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-07 13:09:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:09:06 INFO i.a.i.d.r.RedshiftDestination(main):65 - completed destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-07 13:09:07 INFO i.a.w.p.KubePodProcess(close):737 - (pod: dev / destination-redshift-check-865-0-jacet) - Closed all resources for pod 2022-10-07 13:09:07 INFO i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling... 2022-10-07 13:09:07 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:09:07 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-07 13:09:07 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:09:07 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Cloud storage job log path: /workspace/865/0/logs.log 2022-10-07 13:09:07 INFO i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.6 2022-10-07 13:09:07 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):49 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-10-07 13:09:07 INFO i.a.c.EnvConfigs(getEnvOrDefault):1096 - Using default value for environment variable METRIC_CLIENT: '' 2022-10-07 13:09:07 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2022-10-07 13:09:07 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):49 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-10-07 13:09:07 INFO i.a.w.g.DefaultReplicationWorker(run):122 - start sync worker. job id: 865 attempt id: 0 2022-10-07 13:09:07 INFO i.a.w.g.DefaultReplicationWorker(run):135 - configured sync modes: {null.contacts=incremental - append} 2022-10-07 13:09:07 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-10-07 13:09:07 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = destination-redshift-write-865-0-nguvw for airbyte/destination-redshift:0.3.49 with resources io.airbyte.config.ResourceRequirements@659945d0[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-07 13:09:07 INFO i.a.w.p.KubeProcessFactory(create):103 - destination-redshift-write-865-0-nguvw stdoutLocalPort = 9012 2022-10-07 13:09:07 INFO i.a.w.p.KubeProcessFactory(create):106 - destination-redshift-write-865-0-nguvw stderrLocalPort = 9013 2022-10-07 13:09:07 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:09:07 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START REPLICATION ----- 2022-10-07 13:09:07 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:09:07 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):589 - Creating stdout socket server... 2022-10-07 13:09:07 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):607 - Creating stderr socket server... 2022-10-07 13:09:07 INFO i.a.w.p.KubePodProcess():520 - Creating pod destination-redshift-write-865-0-nguvw... 2022-10-07 13:09:07 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):309 - Waiting for init container to be ready before copying files... 2022-10-07 13:09:07 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):313 - Init container present.. 2022-10-07 13:09:09 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):316 - Init container ready.. 2022-10-07 13:09:09 INFO i.a.w.p.KubePodProcess():551 - Copying files... 2022-10-07 13:09:09 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: destination_config.json 2022-10-07 13:09:09 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/c1b65c46-2054-474f-9d25-ef2e27740728/destination_config.json dev/destination-redshift-write-865-0-nguvw:/config/destination_config.json -c init 2022-10-07 13:09:09 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:09:10 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:09:10 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: destination_catalog.json 2022-10-07 13:09:10 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/e0a71a31-fd98-4f54-9bce-afed1a59ce74/destination_catalog.json dev/destination-redshift-write-865-0-nguvw:/config/destination_catalog.json -c init 2022-10-07 13:09:10 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:09:11 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:09:11 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: FINISHED_UPLOADING 2022-10-07 13:09:11 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/f6a627f0-4a04-4ed7-b544-389c798881d6/FINISHED_UPLOADING dev/destination-redshift-write-865-0-nguvw:/config/FINISHED_UPLOADING -c init 2022-10-07 13:09:11 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:09:11 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):327 - Waiting for init container to terminate before checking exit value... 2022-10-07 13:09:12 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):332 - Init container terminated with exit value 0. 2022-10-07 13:09:12 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):277 - Init was successful; ignoring non-zero kubectl cp exit code for success indicator file. 2022-10-07 13:09:12 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:09:12 INFO i.a.w.p.KubePodProcess():554 - Waiting until pod is ready... 2022-10-07 13:09:12 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):598 - Setting stdout... 2022-10-07 13:09:12 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):610 - Setting stderr... 2022-10-07 13:09:13 INFO i.a.w.p.KubePodProcess():570 - Reading pod IP... 2022-10-07 13:09:13 INFO i.a.w.p.KubePodProcess():572 - Pod IP: 14.0.3.68 2022-10-07 13:09:13 INFO i.a.w.p.KubePodProcess():575 - Creating stdin socket... 2022-10-07 13:09:13 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = source-intercom-read-865-0-goskp for airbyte/source-intercom:0.1.26 with resources io.airbyte.config.ResourceRequirements@2ea208fd[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-07 13:09:13 INFO i.a.w.p.KubeProcessFactory(create):103 - source-intercom-read-865-0-goskp stdoutLocalPort = 9034 2022-10-07 13:09:13 INFO i.a.w.p.KubeProcessFactory(create):106 - source-intercom-read-865-0-goskp stderrLocalPort = 9035 2022-10-07 13:09:13 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):589 - Creating stdout socket server... 2022-10-07 13:09:13 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):607 - Creating stderr socket server... 2022-10-07 13:09:13 INFO i.a.w.p.KubePodProcess():520 - Creating pod source-intercom-read-865-0-goskp... 2022-10-07 13:09:13 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):309 - Waiting for init container to be ready before copying files... 2022-10-07 13:09:13 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):313 - Init container present.. 2022-10-07 13:09:16 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):316 - Init container ready.. 2022-10-07 13:09:16 INFO i.a.w.p.KubePodProcess():551 - Copying files... 2022-10-07 13:09:16 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: source_config.json 2022-10-07 13:09:16 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/55cce174-7448-4133-966d-554f05d16778/source_config.json dev/source-intercom-read-865-0-goskp:/config/source_config.json -c init 2022-10-07 13:09:16 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:09:16 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:09:16 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: source_catalog.json 2022-10-07 13:09:16 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/634f8335-cd0b-4624-8f05-d17c56844592/source_catalog.json dev/source-intercom-read-865-0-goskp:/config/source_catalog.json -c init 2022-10-07 13:09:16 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:09:17 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:09:17 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: FINISHED_UPLOADING 2022-10-07 13:09:17 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/af2f35e5-21e6-4030-9dbe-6cca23584cfb/FINISHED_UPLOADING dev/source-intercom-read-865-0-goskp:/config/FINISHED_UPLOADING -c init 2022-10-07 13:09:17 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:09:17 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:09:17 INFO i.a.w.p.KubePodProcess():554 - Waiting until pod is ready... 2022-10-07 13:09:19 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):598 - Setting stdout... 2022-10-07 13:09:19 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):610 - Setting stderr... 2022-10-07 13:09:21 INFO i.a.w.p.KubePodProcess():570 - Reading pod IP... 2022-10-07 13:09:21 INFO i.a.w.p.KubePodProcess():572 - Pod IP: 14.0.3.69 2022-10-07 13:09:21 INFO i.a.w.p.KubePodProcess():579 - Using null stdin output stream... 2022-10-07 13:09:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):435 - Destination output thread started. 2022-10-07 13:09:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):322 - Replication thread started. 2022-10-07 13:09:21 INFO i.a.w.g.DefaultReplicationWorker(run):177 - Waiting for source and destination threads to complete. 2022-10-07 13:09:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):355 - Source has no more messages, closing connection. 2022-10-07 13:09:22 INFO i.a.w.p.KubePodProcess(close):737 - (pod: dev / source-intercom-read-865-0-goskp) - Closed all resources for pod 2022-10-07 13:09:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):363 - Total records read: 10 (16 KB) 2022-10-07 13:09:22 INFO i.a.w.g.DefaultReplicationWorker(run):182 - One of source or destination thread complete. Waiting on the other. 2022-10-07 13:09:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):445 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@22533b29[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@e7699da[type=,stream=,global=,data={"contacts":{"updated_at":1665062726}},additionalProperties={}],trace=,additionalProperties={}] 2022-10-07 13:09:24 INFO i.a.w.p.KubePodProcess(close):737 - (pod: dev / destination-redshift-write-865-0-nguvw) - Closed all resources for pod 2022-10-07 13:09:24 INFO i.a.w.g.DefaultReplicationWorker(run):184 - Source and destination threads complete. 2022-10-07 13:09:24 INFO i.a.w.g.DefaultReplicationWorker(run):279 - Source output at least one state message 2022-10-07 13:09:24 INFO i.a.w.g.DefaultReplicationWorker(run):285 - State capture: Updated state to: Optional[io.airbyte.config.State@2854e19a[state={"contacts":{"updated_at":1665062726}}]] 2022-10-07 13:09:24 INFO i.a.w.g.DefaultReplicationWorker(run):300 - sync summary: { "status" : "completed", "recordsSynced" : 9, "bytesSynced" : 16923, "startTime" : 1665148147733, "endTime" : 1665148164655, "totalStats" : { "recordsEmitted" : 9, "bytesEmitted" : 16923, "sourceStateMessagesEmitted" : 1, "destinationStateMessagesEmitted" : 1, "recordsCommitted" : 9, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 2, "meanSecondsBetweenStateMessageEmittedandCommitted" : 2 }, "streamStats" : [ { "streamName" : "contacts", "stats" : { "recordsEmitted" : 9, "bytesEmitted" : 16923, "recordsCommitted" : 9 } } ] } 2022-10-07 13:09:24 INFO i.a.w.g.DefaultReplicationWorker(run):301 - failures: [ ] 2022-10-07 13:09:24 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:09:24 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END REPLICATION ----- 2022-10-07 13:09:24 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:09:24 INFO i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling... 2022-10-07 13:09:24 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):166 - sync summary: io.airbyte.config.StandardSyncOutput@38ff934[standardSyncSummary=io.airbyte.config.StandardSyncSummary@6c444ca4[status=completed,recordsSynced=9,bytesSynced=16923,startTime=1665148147733,endTime=1665148164655,totalStats=io.airbyte.config.SyncStats@79e2b87e[recordsEmitted=9,bytesEmitted=16923,sourceStateMessagesEmitted=1,destinationStateMessagesEmitted=1,recordsCommitted=9,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=2,meanSecondsBetweenStateMessageEmittedandCommitted=2,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@21f9e51f[streamName=contacts,stats=io.airbyte.config.SyncStats@5dc3ee4d[recordsEmitted=9,bytesEmitted=16923,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=9,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,additionalProperties={}]]]],normalizationSummary=,state=io.airbyte.config.State@2854e19a[state={"contacts":{"updated_at":1665062726}}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@132cb83d[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@7fe1d36e[stream=io.airbyte.protocol.models.AirbyteStream@115e0090[name=contacts,jsonSchema={"type":["null","object"],"properties":{"id":{"type":["null","string"]},"os":{"type":["null","string"]},"name":{"type":["null","string"]},"role":{"type":["null","string"]},"tags":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"data":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"id":{"type":["null","string"]},"url":{"type":["null","string"]},"type":{"type":["null","string"]}}}},"type":{"type":["null","string"]},"has_more":{"type":["null","boolean"]},"total_count":{"type":["null","integer"]}}},"type":{"type":["null","string"]},"email":{"type":["null","string"]},"notes":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"data":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"id":{"type":["null","string"]},"url":{"type":["null","string"]},"type":{"type":["null","string"]}}}},"type":{"type":["null","string"]},"has_more":{"type":["null","boolean"]},"total_count":{"type":["null","integer"]}}},"phone":{"type":["null","string"]},"avatar":{"type":["null","string"]},"browser":{"type":["null","string"]},"location":{"type":["null","object"],"properties":{"city":{"type":["null","string"]},"type":{"type":["null","string"]},"region":{"type":["null","string"]},"country":{"type":["null","string"]}}},"owner_id":{"type":["null","integer"]},"companies":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"data":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"id":{"type":["null","string"]},"url":{"type":["null","string"]},"type":{"type":["null","string"]}}}},"type":{"type":["null","string"]},"has_more":{"type":["null","boolean"]},"total_count":{"type":["null","integer"]}}},"created_at":{"type":["null","integer"]},"ios_device":{"type":["null","string"]},"updated_at":{"type":["null","integer"]},"external_id":{"type":["null","string"]},"sms_consent":{"type":["null","boolean"]},"ios_app_name":{"type":["null","string"]},"last_seen_at":{"type":["null","integer"]},"signed_up_at":{"type":["null","integer"]},"workspace_id":{"type":["null","string"]},"android_device":{"type":["null","string"]},"ios_os_version":{"type":["null","string"]},"browser_version":{"type":["null","string"]},"ios_app_version":{"type":["null","string"]},"ios_sdk_version":{"type":["null","string"]},"last_replied_at":{"type":["null","integer"]},"social_profiles":{"type":["null","object"],"properties":{"data":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"name":{"type":["null","string"]},"type":{"type":["null","string"]}}}},"type":{"type":["null","string"]}}},"android_app_name":{"type":["null","string"]},"browser_language":{"type":["null","string"]},"has_hard_bounced":{"type":["null","boolean"]},"ios_last_seen_at":{"type":["null","integer"]},"custom_attributes":{"type":["null","object"],"properties":{},"additionalProperties":true},"language_override":{"type":["null","string"]},"last_contacted_at":{"type":["null","integer"]},"android_os_version":{"type":["null","string"]},"android_app_version":{"type":["null","string"]},"android_sdk_version":{"type":["null","string"]},"android_last_seen_at":{"type":["null","string"],"format":"date-time"},"last_email_opened_at":{"type":["null","integer"]},"marked_email_as_spam":{"type":["null","boolean"]},"last_email_clicked_at":{"type":["null","integer"]},"unsubscribed_from_sms":{"type":["null","boolean"]},"unsubscribed_from_emails":{"type":["null","boolean"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-10-07 13:09:24 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):312 - Stopping temporal heartbeating... 2022-10-07 13:09:24 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Cloud storage job log path: /workspace/865/0/logs.log 2022-10-07 13:09:24 INFO i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.6 2022-10-07 13:09:24 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):138 - Running with normalization version: airbyte/normalization-redshift:0.2.21 2022-10-07 13:09:24 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:09:24 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START DEFAULT NORMALIZATION ----- 2022-10-07 13:09:24 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:09:24 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = normalization-redshift-normalize-865-0-jpfbu for airbyte/normalization-redshift:0.2.21 with resources io.airbyte.config.ResourceRequirements@1b965871[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-07 13:09:24 INFO i.a.w.p.KubeProcessFactory(create):103 - normalization-redshift-normalize-865-0-jpfbu stdoutLocalPort = 9028 2022-10-07 13:09:24 INFO i.a.w.p.KubeProcessFactory(create):106 - normalization-redshift-normalize-865-0-jpfbu stderrLocalPort = 9029 2022-10-07 13:09:24 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):589 - Creating stdout socket server... 2022-10-07 13:09:24 INFO i.a.w.p.KubePodProcess():520 - Creating pod normalization-redshift-normalize-865-0-jpfbu... 2022-10-07 13:09:24 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):607 - Creating stderr socket server... 2022-10-07 13:09:25 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):309 - Waiting for init container to be ready before copying files... 2022-10-07 13:09:25 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):313 - Init container present.. 2022-10-07 13:09:27 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):316 - Init container ready.. 2022-10-07 13:09:27 INFO i.a.w.p.KubePodProcess():551 - Copying files... 2022-10-07 13:09:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: destination_config.json 2022-10-07 13:09:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/1b50ff7d-8f9b-42e4-b376-8d490a69d837/destination_config.json dev/normalization-redshift-normalize-865-0-jpfbu:/config/destination_config.json -c init 2022-10-07 13:09:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:09:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:09:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: destination_catalog.json 2022-10-07 13:09:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/c1f153cd-37aa-4e7f-a93a-a95430656265/destination_catalog.json dev/normalization-redshift-normalize-865-0-jpfbu:/config/destination_catalog.json -c init 2022-10-07 13:09:27 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:09:28 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:09:28 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: FINISHED_UPLOADING 2022-10-07 13:09:28 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/efd498fb-74bc-424b-abc5-b99b84f8efd1/FINISHED_UPLOADING dev/normalization-redshift-normalize-865-0-jpfbu:/config/FINISHED_UPLOADING -c init 2022-10-07 13:09:28 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:09:28 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:09:28 INFO i.a.w.p.KubePodProcess():554 - Waiting until pod is ready... 2022-10-07 13:09:29 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):598 - Setting stdout... 2022-10-07 13:09:29 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):610 - Setting stderr... 2022-10-07 13:09:30 INFO i.a.w.p.KubePodProcess():570 - Reading pod IP... 2022-10-07 13:09:30 INFO i.a.w.p.KubePodProcess():572 - Pod IP: 14.0.3.74 2022-10-07 13:09:30 INFO i.a.w.p.KubePodProcess():579 - Using null stdin output stream... 2022-10-07 13:09:34 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2022-10-07 13:09:34 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2022-10-07 13:09:21 destination > 2022-10-07 13:09:16 INFO i.a.i.b.IntegrationRunner(runInternal):104 - Running integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-07 13:09:21 destination > 2022-10-07 13:09:16 INFO i.a.i.b.IntegrationRunner(runInternal):105 - Command: WRITE 2022-10-07 13:09:21 destination > 2022-10-07 13:09:16 INFO i.a.i.b.IntegrationRunner(runInternal):106 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-10-07 13:09:21 destination > 2022-10-07 13:09:17 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-07 13:09:21 destination > 2022-10-07 13:09:17 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-07 13:09:21 destination > 2022-10-07 13:09:17 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-07 13:09:21 destination > 2022-10-07 13:09:17 WARN i.a.i.d.r.RedshiftDestination(determineUploadMode):54 - The "standard" upload mode is not performant, and is not recommended for production. Please use the Amazon S3 upload mode if you are syncing a large amount of data. 2022-10-07 13:09:21 destination > 2022-10-07 13:09:17 INFO i.a.i.d.j.c.SwitchingDestination(getConsumer):65 - Using destination type: STANDARD 2022-10-07 13:09:21 destination > 2022-10-07 13:09:17 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2022-10-07 13:09:21 destination > 2022-10-07 13:09:18 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2022-10-07 13:09:21 destination > 2022-10-07 13:09:18 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=contacts, namespace=null, outputSchemaName=airbyte_latest_data, tmpTableName=_airbyte_tmp_wzq_contacts, outputTableName=_airbyte_raw_contacts, syncMode=append} 2022-10-07 13:09:21 destination > 2022-10-07 13:09:18 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2022-10-07 13:09:21 destination > 2022-10-07 13:09:18 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):123 - Preparing tmp tables in destination started for 1 streams 2022-10-07 13:09:21 destination > 2022-10-07 13:09:18 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream contacts. schema: airbyte_latest_data, tmp table name: _airbyte_tmp_wzq_contacts 2022-10-07 13:09:21 destination > 2022-10-07 13:09:19 INFO c.z.h.p.PoolBase(getAndSetNetworkTimeout):536 - HikariPool-1 - Driver does not support get/set network timeout for connections. ([Amazon][JDBC](10220) Driver does not support this optional feature.) 2022-10-07 13:09:21 destination > 2022-10-07 13:09:19 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):133 - Preparing tables in destination completed. 2022-10-07 13:09:21 source > Read 9 records from contacts stream 2022-10-07 13:09:21 source > Finished syncing contacts 2022-10-07 13:09:21 source > SourceIntercom runtimes: Syncing stream contacts 0:00:00.385667 2022-10-07 13:09:21 source > Finished syncing SourceIntercom 2022-10-07 13:09:22 destination > 2022-10-07 13:09:22 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):62 - Airbyte message consumer: succeeded. 2022-10-07 13:09:22 destination > 2022-10-07 13:09:22 INFO i.a.i.d.b.BufferedStreamConsumer(close):171 - executing on success close procedure. 2022-10-07 13:09:22 destination > 2022-10-07 13:09:22 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(flushAll):84 - Flushing contacts: 9 records (78 KB) 2022-10-07 13:09:22 destination > 2022-10-07 13:09:22 INFO i.a.i.d.r.o.RedshiftSqlOperations(insertRecordsInternal):89 - actual size of batch: 9 2022-10-07 13:09:23 destination > 2022-10-07 13:09:23 INFO i.a.i.d.r.o.RedshiftSqlOperations(onDestinationCloseOperations):139 - Executing operations for Redshift Destination DB engine... 2022-10-07 13:09:23 destination > 2022-10-07 13:09:23 INFO i.a.i.d.r.o.RedshiftSqlOperations(discoverNotSuperTables):189 - Discovering NOT SUPER table types... 2022-10-07 13:09:23 destination > 2022-10-07 13:09:23 INFO i.a.i.d.r.o.RedshiftSqlOperations(onDestinationCloseOperations):157 - Executing operations for Redshift Destination DB engine completed. 2022-10-07 13:09:23 destination > 2022-10-07 13:09:23 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):163 - Finalizing tables in destination started for 1 streams 2022-10-07 13:09:23 destination > 2022-10-07 13:09:23 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream contacts. schema airbyte_latest_data, tmp table _airbyte_tmp_wzq_contacts, final table _airbyte_raw_contacts 2022-10-07 13:09:23 destination > 2022-10-07 13:09:23 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - Executing finalization of tables. 2022-10-07 13:09:23 destination > 2022-10-07 13:09:23 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):183 - Finalizing tables in destination completed. 2022-10-07 13:09:23 destination > 2022-10-07 13:09:23 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):186 - Cleaning tmp tables in destination started for 1 streams 2022-10-07 13:09:23 destination > 2022-10-07 13:09:23 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream contacts. schema airbyte_latest_data, tmp table name: _airbyte_tmp_wzq_contacts 2022-10-07 13:09:23 destination > 2022-10-07 13:09:23 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):195 - Cleaning tmp tables in destination completed. 2022-10-07 13:09:23 destination > 2022-10-07 13:09:23 INFO i.a.i.b.IntegrationRunner(runInternal):152 - Completed integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-07 13:09:23 destination > 2022-10-07 13:09:23 INFO i.a.i.d.r.RedshiftDestination(main):65 - completed destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-07 13:09:30 normalization > Running: transform-config --config destination_config.json --integration-type redshift --out /config 2022-10-07 13:09:30 normalization > Namespace(config='destination_config.json', integration_type=, out='/config') 2022-10-07 13:09:30 normalization > transform_redshift 2022-10-07 13:09:30 normalization > Running: transform-catalog --integration-type redshift --profile-config-dir /config --catalog destination_catalog.json --out /config/models/generated/ --json-column _airbyte_data 2022-10-07 13:09:31 normalization > Processing destination_catalog.json... 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_ab1.sql from contacts 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_ab2.sql from contacts 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_ab3.sql from contacts 2022-10-07 13:09:31 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts.sql from contacts 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_tags_ab1.sql from contacts/tags 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_tags_ab2.sql from contacts/tags 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_tags_ab3.sql from contacts/tags 2022-10-07 13:09:31 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts_tags.sql from contacts/tags 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_notes_ab1.sql from contacts/notes 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_notes_ab2.sql from contacts/notes 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_notes_ab3.sql from contacts/notes 2022-10-07 13:09:31 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts_notes.sql from contacts/notes 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_location_ab1.sql from contacts/location 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_location_ab2.sql from contacts/location 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_location_ab3.sql from contacts/location 2022-10-07 13:09:31 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts_location.sql from contacts/location 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_companies_ab1.sql from contacts/companies 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_companies_ab2.sql from contacts/companies 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_companies_ab3.sql from contacts/companies 2022-10-07 13:09:31 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts_companies.sql from contacts/companies 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_social_profiles_ab1.sql from contacts/social_profiles 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_social_profiles_ab2.sql from contacts/social_profiles 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_social_profiles_ab3.sql from contacts/social_profiles 2022-10-07 13:09:31 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts_social_profiles.sql from contacts/social_profiles 2022-10-07 13:09:31 normalization > Ignoring stream 'custom_attributes' from contacts/custom_attributes because properties list is empty 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_tags_data_ab1.sql from contacts/tags/data 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_tags_data_ab2.sql from contacts/tags/data 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_tags_data_ab3.sql from contacts/tags/data 2022-10-07 13:09:31 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts_tags_data.sql from contacts/tags/data 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_notes_data_ab1.sql from contacts/notes/data 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_notes_data_ab2.sql from contacts/notes/data 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_notes_data_ab3.sql from contacts/notes/data 2022-10-07 13:09:31 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts_notes_data.sql from contacts/notes/data 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_companies_data_ab1.sql from contacts/companies/data 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_companies_data_ab2.sql from contacts/companies/data 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_companies_data_ab3.sql from contacts/companies/data 2022-10-07 13:09:31 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts_companies_data.sql from contacts/companies/data 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_social_profiles_data_ab1.sql from contacts/social_profiles/data 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_social_profiles_data_ab2.sql from contacts/social_profiles/data 2022-10-07 13:09:31 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_social_profiles_data_ab3.sql from contacts/social_profiles/data 2022-10-07 13:09:31 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts_social_profiles_data.sql from contacts/social_profiles/data 2022-10-07 13:09:31 normalization > detected no config file for ssh, assuming ssh is off. 2022-10-07 13:09:34 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2022-10-07 13:09:34 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2022-10-07 13:09:34 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2022-10-07 13:09:39 normalization > Running with dbt=1.0.0 2022-10-07 13:09:39 normalization > Partial parse save file not found. Starting full parse. 2022-10-07 13:09:41 normalization > [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. There are 2 unused configuration paths: - models.airbyte_utils.generated.airbyte_tables - models.airbyte_utils.generated.airbyte_views 2022-10-07 13:09:41 normalization > Found 40 models, 0 tests, 0 snapshots, 0 analyses, 605 macros, 0 operations, 0 seed files, 1 source, 0 exposures, 0 metrics 2022-10-07 13:09:42 normalization > Concurrency: 4 threads (target='prod') 2022-10-07 13:10:00 normalization > 1 of 10 START incremental model airbyte_latest_data.contacts............................................................ [RUN] 2022-10-07 13:10:14 normalization > 1 of 10 OK created incremental model airbyte_latest_data.contacts....................................................... [INSERT 0 10 in 13.68s] 2022-10-07 13:10:20 normalization > 2 of 10 START incremental model airbyte_latest_data.contacts_social_profiles............................................ [RUN] 2022-10-07 13:10:21 normalization > 3 of 10 START incremental model airbyte_latest_data.contacts_location................................................... [RUN] 2022-10-07 13:10:22 normalization > 4 of 10 START incremental model airbyte_latest_data.contacts_notes...................................................... [RUN] 2022-10-07 13:10:22 normalization > 5 of 10 START incremental model airbyte_latest_data.contacts_companies.................................................. [RUN] 2022-10-07 13:10:30 normalization > 2 of 10 OK created incremental model airbyte_latest_data.contacts_social_profiles....................................... [INSERT 0 10 in 9.69s] 2022-10-07 13:10:33 normalization > 6 of 10 START incremental model airbyte_latest_data.contacts_tags....................................................... [RUN] 2022-10-07 13:10:36 normalization > 3 of 10 OK created incremental model airbyte_latest_data.contacts_location.............................................. [INSERT 0 10 in 15.54s] 2022-10-07 13:10:38 normalization > 7 of 10 START incremental model airbyte_latest_data.contacts_social_profiles_data....................................... [RUN] 2022-10-07 13:10:41 normalization > 5 of 10 OK created incremental model airbyte_latest_data.contacts_companies............................................. [INSERT 0 10 in 18.49s] 2022-10-07 13:10:41 normalization > 4 of 10 OK created incremental model airbyte_latest_data.contacts_notes................................................. [INSERT 0 10 in 19.79s] 2022-10-07 13:10:41 normalization > 6 of 10 OK created incremental model airbyte_latest_data.contacts_tags.................................................. [INSERT 0 10 in 8.63s] 2022-10-07 13:10:43 normalization > 7 of 10 OK created incremental model airbyte_latest_data.contacts_social_profiles_data.................................. [INSERT 0 11 in 5.73s] 2022-10-07 13:10:46 normalization > 8 of 10 START incremental model airbyte_latest_data.contacts_companies_data............................................. [RUN] 2022-10-07 13:10:46 normalization > 9 of 10 START incremental model airbyte_latest_data.contacts_notes_data................................................. [RUN] 2022-10-07 13:10:46 normalization > 10 of 10 START incremental model airbyte_latest_data.contacts_tags_data................................................. [RUN] 2022-10-07 13:10:51 normalization > 8 of 10 OK created incremental model airbyte_latest_data.contacts_companies_data........................................ [INSERT 0 11 in 5.01s] 2022-10-07 13:10:51 normalization > 10 of 10 OK created incremental model airbyte_latest_data.contacts_tags_data............................................ [INSERT 0 216 in 4.92s] 2022-10-07 13:10:51 normalization > 9 of 10 OK created incremental model airbyte_latest_data.contacts_notes_data............................................ [INSERT 0 11 in 5.05s] 2022-10-07 13:10:51 normalization > Finished running 10 incremental models in 70.32s. 2022-10-07 13:10:51 normalization > Completed successfully 2022-10-07 13:10:51 normalization > Done. PASS=10 WARN=0 ERROR=0 SKIP=0 TOTAL=10 2022-10-07 13:10:52 INFO i.a.w.p.KubePodProcess(close):737 - (pod: dev / normalization-redshift-normalize-865-0-jpfbu) - Closed all resources for pod 2022-10-07 13:10:52 INFO i.a.w.g.DefaultNormalizationWorker(run):82 - Normalization executed in 1 minute 27 seconds. 2022-10-07 13:10:52 INFO i.a.w.g.DefaultNormalizationWorker(run):95 - Normalization summary: io.airbyte.config.NormalizationSummary@1d4cb707[startTime=1665148164930,endTime=1665148252682,failures=[]] 2022-10-07 13:10:52 INFO i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling... 2022-10-07 13:10:52 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):312 - Stopping temporal heartbeating... 2022-10-07 13:10:52 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:10:52 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END DEFAULT NORMALIZATION ----- 2022-10-07 13:10:52 INFO i.a.c.i.LineGobbler(voidCall):114 -