2022-10-07 13:11:23 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Cloud storage job log path: /workspace/866/0/logs.log 2022-10-07 13:11:48 destination > 2022-10-07 13:11:44 INFO i.a.i.d.r.RedshiftDestination(main):63 - starting destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-07 13:11:23 INFO i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.6 2022-10-07 13:11:23 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:11:23 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-10-07 13:11:23 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = source-intercom-check-866-0-xjlbu for airbyte/source-intercom:0.1.26 with resources io.airbyte.config.ResourceRequirements@9f6d799[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-07 13:11:23 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:11:23 INFO i.a.w.p.KubeProcessFactory(create):103 - source-intercom-check-866-0-xjlbu stdoutLocalPort = 9032 2022-10-07 13:11:23 INFO i.a.w.p.KubeProcessFactory(create):106 - source-intercom-check-866-0-xjlbu stderrLocalPort = 9033 2022-10-07 13:11:23 INFO i.a.w.p.KubePodProcess():520 - Creating pod source-intercom-check-866-0-xjlbu... 2022-10-07 13:11:23 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):589 - Creating stdout socket server... 2022-10-07 13:11:23 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):607 - Creating stderr socket server... 2022-10-07 13:11:23 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):309 - Waiting for init container to be ready before copying files... 2022-10-07 13:11:23 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):313 - Init container present.. 2022-10-07 13:11:24 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):316 - Init container ready.. 2022-10-07 13:11:24 INFO i.a.w.p.KubePodProcess():551 - Copying files... 2022-10-07 13:11:24 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: source_config.json 2022-10-07 13:11:24 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/1a6c2663-0958-452a-849e-2839bb25fae2/source_config.json dev/source-intercom-check-866-0-xjlbu:/config/source_config.json -c init 2022-10-07 13:11:24 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:11:25 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:11:25 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: FINISHED_UPLOADING 2022-10-07 13:11:25 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/34c67f72-517b-4cf8-ab25-d86f7b2d2e8c/FINISHED_UPLOADING dev/source-intercom-check-866-0-xjlbu:/config/FINISHED_UPLOADING -c init 2022-10-07 13:11:25 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:11:26 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:11:26 INFO i.a.w.p.KubePodProcess():554 - Waiting until pod is ready... 2022-10-07 13:11:27 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):598 - Setting stdout... 2022-10-07 13:11:27 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):610 - Setting stderr... 2022-10-07 13:11:28 INFO i.a.w.p.KubePodProcess():570 - Reading pod IP... 2022-10-07 13:11:28 INFO i.a.w.p.KubePodProcess():572 - Pod IP: 14.0.3.68 2022-10-07 13:11:28 INFO i.a.w.p.KubePodProcess():579 - Using null stdin output stream... 2022-10-07 13:11:28 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Check succeeded 2022-10-07 13:11:29 INFO i.a.w.p.KubePodProcess(close):737 - (pod: dev / source-intercom-check-866-0-xjlbu) - Closed all resources for pod 2022-10-07 13:11:29 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:11:29 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-07 13:11:29 INFO i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling... 2022-10-07 13:11:29 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:11:29 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Cloud storage job log path: /workspace/866/0/logs.log 2022-10-07 13:11:29 INFO i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.6 2022-10-07 13:11:29 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = destination-redshift-check-866-0-hjbyf for airbyte/destination-redshift:0.3.49 with resources io.airbyte.config.ResourceRequirements@9f6d799[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-07 13:11:29 INFO i.a.w.p.KubeProcessFactory(create):103 - destination-redshift-check-866-0-hjbyf stdoutLocalPort = 9024 2022-10-07 13:11:29 INFO i.a.w.p.KubeProcessFactory(create):106 - destination-redshift-check-866-0-hjbyf stderrLocalPort = 9025 2022-10-07 13:11:29 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:11:29 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-10-07 13:11:29 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:11:29 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):589 - Creating stdout socket server... 2022-10-07 13:11:29 INFO i.a.w.p.KubePodProcess():520 - Creating pod destination-redshift-check-866-0-hjbyf... 2022-10-07 13:11:29 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):607 - Creating stderr socket server... 2022-10-07 13:11:29 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):309 - Waiting for init container to be ready before copying files... 2022-10-07 13:11:29 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):313 - Init container present.. 2022-10-07 13:11:31 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):316 - Init container ready.. 2022-10-07 13:11:31 INFO i.a.w.p.KubePodProcess():551 - Copying files... 2022-10-07 13:11:31 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: source_config.json 2022-10-07 13:11:31 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/ae47939f-9a9c-4312-9305-263a31116785/source_config.json dev/destination-redshift-check-866-0-hjbyf:/config/source_config.json -c init 2022-10-07 13:11:31 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:11:31 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:11:31 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: FINISHED_UPLOADING 2022-10-07 13:11:31 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/9a4f807c-bff2-4e71-9d50-c99aa8d2841b/FINISHED_UPLOADING dev/destination-redshift-check-866-0-hjbyf:/config/FINISHED_UPLOADING -c init 2022-10-07 13:11:31 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:11:31 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:11:31 INFO i.a.w.p.KubePodProcess():554 - Waiting until pod is ready... 2022-10-07 13:11:32 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):598 - Setting stdout... 2022-10-07 13:11:32 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):610 - Setting stderr... 2022-10-07 13:11:33 INFO i.a.w.p.KubePodProcess():570 - Reading pod IP... 2022-10-07 13:11:33 INFO i.a.w.p.KubePodProcess():572 - Pod IP: 14.0.3.67 2022-10-07 13:11:33 INFO i.a.w.p.KubePodProcess():579 - Using null stdin output stream... 2022-10-07 13:11:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:11:34 INFO i.a.i.d.r.RedshiftDestination(main):63 - starting destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-07 13:11:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:11:34 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-10-07 13:11:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:11:34 INFO i.a.i.b.IntegrationRunner(runInternal):104 - Running integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-07 13:11:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:11:34 INFO i.a.i.b.IntegrationRunner(runInternal):105 - Command: CHECK 2022-10-07 13:11:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:11:34 INFO i.a.i.b.IntegrationRunner(runInternal):106 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-10-07 13:11:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:11:34 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-07 13:11:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:11:34 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-07 13:11:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:11:34 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-07 13:11:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:11:34 WARN i.a.i.d.r.RedshiftDestination(determineUploadMode):54 - The "standard" upload mode is not performant, and is not recommended for production. Please use the Amazon S3 upload mode if you are syncing a large amount of data. 2022-10-07 13:11:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:11:34 INFO i.a.i.d.j.c.SwitchingDestination(check):55 - Using destination type: STANDARD 2022-10-07 13:11:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:11:34 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2022-10-07 13:11:35 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:11:35 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2022-10-07 13:11:35 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:11:35 INFO c.z.h.p.PoolBase(getAndSetNetworkTimeout):536 - HikariPool-1 - Driver does not support get/set network timeout for connections. ([Amazon][JDBC](10220) Driver does not support this optional feature.) 2022-10-07 13:11:36 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:11:36 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated... 2022-10-07 13:11:36 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:11:36 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed. 2022-10-07 13:11:36 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:11:36 INFO i.a.i.b.IntegrationRunner(runInternal):152 - Completed integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-07 13:11:36 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-07 13:11:36 INFO i.a.i.d.r.RedshiftDestination(main):65 - completed destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-07 13:11:37 INFO i.a.w.p.KubePodProcess(close):737 - (pod: dev / destination-redshift-check-866-0-hjbyf) - Closed all resources for pod 2022-10-07 13:11:37 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:11:37 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-07 13:11:37 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:11:37 INFO i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling... 2022-10-07 13:11:37 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Cloud storage job log path: /workspace/866/0/logs.log 2022-10-07 13:11:37 INFO i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.6 2022-10-07 13:11:37 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):49 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-10-07 13:11:37 INFO i.a.c.EnvConfigs(getEnvOrDefault):1096 - Using default value for environment variable METRIC_CLIENT: '' 2022-10-07 13:11:37 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2022-10-07 13:11:37 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):49 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-10-07 13:11:37 INFO i.a.w.g.DefaultReplicationWorker(run):122 - start sync worker. job id: 866 attempt id: 0 2022-10-07 13:11:37 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:11:37 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START REPLICATION ----- 2022-10-07 13:11:37 INFO i.a.w.g.DefaultReplicationWorker(run):135 - configured sync modes: {null.contacts=incremental - append} 2022-10-07 13:11:37 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:11:37 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-10-07 13:11:37 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = destination-redshift-write-866-0-ggere for airbyte/destination-redshift:0.3.49 with resources io.airbyte.config.ResourceRequirements@216bd899[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-07 13:11:37 INFO i.a.w.p.KubeProcessFactory(create):103 - destination-redshift-write-866-0-ggere stdoutLocalPort = 9002 2022-10-07 13:11:37 INFO i.a.w.p.KubeProcessFactory(create):106 - destination-redshift-write-866-0-ggere stderrLocalPort = 9003 2022-10-07 13:11:37 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):589 - Creating stdout socket server... 2022-10-07 13:11:37 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):607 - Creating stderr socket server... 2022-10-07 13:11:37 INFO i.a.w.p.KubePodProcess():520 - Creating pod destination-redshift-write-866-0-ggere... 2022-10-07 13:11:37 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):309 - Waiting for init container to be ready before copying files... 2022-10-07 13:11:37 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):313 - Init container present.. 2022-10-07 13:11:39 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):316 - Init container ready.. 2022-10-07 13:11:39 INFO i.a.w.p.KubePodProcess():551 - Copying files... 2022-10-07 13:11:39 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: destination_config.json 2022-10-07 13:11:39 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/130a3158-f683-4cd9-9fda-bce4b0e5de61/destination_config.json dev/destination-redshift-write-866-0-ggere:/config/destination_config.json -c init 2022-10-07 13:11:39 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:11:39 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:11:39 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: destination_catalog.json 2022-10-07 13:11:39 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/fd2e829d-6782-4229-9fd8-d14e596d5198/destination_catalog.json dev/destination-redshift-write-866-0-ggere:/config/destination_catalog.json -c init 2022-10-07 13:11:39 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:11:39 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:11:39 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: FINISHED_UPLOADING 2022-10-07 13:11:39 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/ae9d6b8f-f854-4782-977d-c9f10f252aea/FINISHED_UPLOADING dev/destination-redshift-write-866-0-ggere:/config/FINISHED_UPLOADING -c init 2022-10-07 13:11:39 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:11:40 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:11:40 INFO i.a.w.p.KubePodProcess():554 - Waiting until pod is ready... 2022-10-07 13:11:41 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):598 - Setting stdout... 2022-10-07 13:11:41 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):610 - Setting stderr... 2022-10-07 13:11:42 INFO i.a.w.p.KubePodProcess():570 - Reading pod IP... 2022-10-07 13:11:42 INFO i.a.w.p.KubePodProcess():572 - Pod IP: 14.0.3.69 2022-10-07 13:11:42 INFO i.a.w.p.KubePodProcess():575 - Creating stdin socket... 2022-10-07 13:11:42 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = source-intercom-read-866-0-hkofn for airbyte/source-intercom:0.1.26 with resources io.airbyte.config.ResourceRequirements@7873face[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-07 13:11:42 INFO i.a.w.p.KubeProcessFactory(create):103 - source-intercom-read-866-0-hkofn stdoutLocalPort = 9040 2022-10-07 13:11:42 INFO i.a.w.p.KubeProcessFactory(create):106 - source-intercom-read-866-0-hkofn stderrLocalPort = 9001 2022-10-07 13:11:42 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):589 - Creating stdout socket server... 2022-10-07 13:11:42 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):607 - Creating stderr socket server... 2022-10-07 13:11:42 INFO i.a.w.p.KubePodProcess():520 - Creating pod source-intercom-read-866-0-hkofn... 2022-10-07 13:11:42 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):309 - Waiting for init container to be ready before copying files... 2022-10-07 13:11:42 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):313 - Init container present.. 2022-10-07 13:11:45 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):316 - Init container ready.. 2022-10-07 13:11:45 INFO i.a.w.p.KubePodProcess():551 - Copying files... 2022-10-07 13:11:45 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: input_state.json 2022-10-07 13:11:45 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/3783bbf0-2811-4aad-9d5a-2d9f9ed7af29/input_state.json dev/source-intercom-read-866-0-hkofn:/config/input_state.json -c init 2022-10-07 13:11:45 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:11:45 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:11:45 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: source_config.json 2022-10-07 13:11:45 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/c5a64379-3299-4fa7-a5af-a01995ff6a3a/source_config.json dev/source-intercom-read-866-0-hkofn:/config/source_config.json -c init 2022-10-07 13:11:45 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:11:46 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:11:46 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: source_catalog.json 2022-10-07 13:11:46 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/3841c5ff-ed5d-4b45-b90c-299638717542/source_catalog.json dev/source-intercom-read-866-0-hkofn:/config/source_catalog.json -c init 2022-10-07 13:11:46 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:11:46 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:11:46 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: FINISHED_UPLOADING 2022-10-07 13:11:46 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/c1b18a58-6de6-43d1-a770-1a9ef128c95b/FINISHED_UPLOADING dev/source-intercom-read-866-0-hkofn:/config/FINISHED_UPLOADING -c init 2022-10-07 13:11:46 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:11:46 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:11:46 INFO i.a.w.p.KubePodProcess():554 - Waiting until pod is ready... 2022-10-07 13:11:47 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):598 - Setting stdout... 2022-10-07 13:11:47 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):610 - Setting stderr... 2022-10-07 13:11:48 INFO i.a.w.p.KubePodProcess():570 - Reading pod IP... 2022-10-07 13:11:48 INFO i.a.w.p.KubePodProcess():572 - Pod IP: 14.0.3.70 2022-10-07 13:11:48 INFO i.a.w.p.KubePodProcess():579 - Using null stdin output stream... 2022-10-07 13:11:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):435 - Destination output thread started. 2022-10-07 13:11:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):322 - Replication thread started. 2022-10-07 13:11:48 INFO i.a.w.g.DefaultReplicationWorker(run):177 - Waiting for source and destination threads to complete. 2022-10-07 13:11:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):355 - Source has no more messages, closing connection. 2022-10-07 13:11:49 INFO i.a.w.p.KubePodProcess(close):737 - (pod: dev / source-intercom-read-866-0-hkofn) - Closed all resources for pod 2022-10-07 13:11:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):363 - Total records read: 2 (2 KB) 2022-10-07 13:11:49 INFO i.a.w.g.DefaultReplicationWorker(run):182 - One of source or destination thread complete. Waiting on the other. 2022-10-07 13:11:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):445 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@52cba2c8[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@1c4b6d1c[type=,stream=,global=,data={"contacts":{"updated_at":1665062726}},additionalProperties={}],trace=,additionalProperties={}] 2022-10-07 13:11:51 INFO i.a.w.p.KubePodProcess(close):737 - (pod: dev / destination-redshift-write-866-0-ggere) - Closed all resources for pod 2022-10-07 13:11:51 INFO i.a.w.g.DefaultReplicationWorker(run):184 - Source and destination threads complete. 2022-10-07 13:11:51 INFO i.a.w.g.DefaultReplicationWorker(run):279 - Source output at least one state message 2022-10-07 13:11:51 INFO i.a.w.g.DefaultReplicationWorker(run):285 - State capture: Updated state to: Optional[io.airbyte.config.State@70507b3c[state={"contacts":{"updated_at":1665062726}}]] 2022-10-07 13:11:51 INFO i.a.w.g.DefaultReplicationWorker(run):300 - sync summary: { "status" : "completed", "recordsSynced" : 1, "bytesSynced" : 2249, "startTime" : 1665148297697, "endTime" : 1665148311715, "totalStats" : { "recordsEmitted" : 1, "bytesEmitted" : 2249, "sourceStateMessagesEmitted" : 1, "destinationStateMessagesEmitted" : 1, "recordsCommitted" : 1, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 1, "meanSecondsBetweenStateMessageEmittedandCommitted" : 1 }, "streamStats" : [ { "streamName" : "contacts", "stats" : { "recordsEmitted" : 1, "bytesEmitted" : 2249, "recordsCommitted" : 1 } } ] } 2022-10-07 13:11:51 INFO i.a.w.g.DefaultReplicationWorker(run):301 - failures: [ ] 2022-10-07 13:11:51 INFO i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling... 2022-10-07 13:11:51 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):166 - sync summary: io.airbyte.config.StandardSyncOutput@2e8b82fb[standardSyncSummary=io.airbyte.config.StandardSyncSummary@445305b9[status=completed,recordsSynced=1,bytesSynced=2249,startTime=1665148297697,endTime=1665148311715,totalStats=io.airbyte.config.SyncStats@65b5885e[recordsEmitted=1,bytesEmitted=2249,sourceStateMessagesEmitted=1,destinationStateMessagesEmitted=1,recordsCommitted=1,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=1,meanSecondsBetweenStateMessageEmittedandCommitted=1,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@5a403e61[streamName=contacts,stats=io.airbyte.config.SyncStats@28aef388[recordsEmitted=1,bytesEmitted=2249,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=1,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,additionalProperties={}]]]],normalizationSummary=,state=io.airbyte.config.State@70507b3c[state={"contacts":{"updated_at":1665062726}}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@748c45e9[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@3d32c45e[stream=io.airbyte.protocol.models.AirbyteStream@66da46af[name=contacts,jsonSchema={"type":["null","object"],"properties":{"id":{"type":["null","string"]},"os":{"type":["null","string"]},"name":{"type":["null","string"]},"role":{"type":["null","string"]},"tags":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"data":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"id":{"type":["null","string"]},"url":{"type":["null","string"]},"type":{"type":["null","string"]}}}},"type":{"type":["null","string"]},"has_more":{"type":["null","boolean"]},"total_count":{"type":["null","integer"]}}},"type":{"type":["null","string"]},"email":{"type":["null","string"]},"notes":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"data":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"id":{"type":["null","string"]},"url":{"type":["null","string"]},"type":{"type":["null","string"]}}}},"type":{"type":["null","string"]},"has_more":{"type":["null","boolean"]},"total_count":{"type":["null","integer"]}}},"phone":{"type":["null","string"]},"avatar":{"type":["null","string"]},"browser":{"type":["null","string"]},"location":{"type":["null","object"],"properties":{"city":{"type":["null","string"]},"type":{"type":["null","string"]},"region":{"type":["null","string"]},"country":{"type":["null","string"]}}},"owner_id":{"type":["null","integer"]},"companies":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"data":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"id":{"type":["null","string"]},"url":{"type":["null","string"]},"type":{"type":["null","string"]}}}},"type":{"type":["null","string"]},"has_more":{"type":["null","boolean"]},"total_count":{"type":["null","integer"]}}},"created_at":{"type":["null","integer"]},"ios_device":{"type":["null","string"]},"updated_at":{"type":["null","integer"]},"external_id":{"type":["null","string"]},"sms_consent":{"type":["null","boolean"]},"ios_app_name":{"type":["null","string"]},"last_seen_at":{"type":["null","integer"]},"signed_up_at":{"type":["null","integer"]},"workspace_id":{"type":["null","string"]},"android_device":{"type":["null","string"]},"ios_os_version":{"type":["null","string"]},"browser_version":{"type":["null","string"]},"ios_app_version":{"type":["null","string"]},"ios_sdk_version":{"type":["null","string"]},"last_replied_at":{"type":["null","integer"]},"social_profiles":{"type":["null","object"],"properties":{"data":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"name":{"type":["null","string"]},"type":{"type":["null","string"]}}}},"type":{"type":["null","string"]}}},"android_app_name":{"type":["null","string"]},"browser_language":{"type":["null","string"]},"has_hard_bounced":{"type":["null","boolean"]},"ios_last_seen_at":{"type":["null","integer"]},"custom_attributes":{"type":["null","object"],"properties":{},"additionalProperties":true},"language_override":{"type":["null","string"]},"last_contacted_at":{"type":["null","integer"]},"android_os_version":{"type":["null","string"]},"android_app_version":{"type":["null","string"]},"android_sdk_version":{"type":["null","string"]},"android_last_seen_at":{"type":["null","string"],"format":"date-time"},"last_email_opened_at":{"type":["null","integer"]},"marked_email_as_spam":{"type":["null","boolean"]},"last_email_clicked_at":{"type":["null","integer"]},"unsubscribed_from_sms":{"type":["null","boolean"]},"unsubscribed_from_emails":{"type":["null","boolean"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-10-07 13:11:51 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):312 - Stopping temporal heartbeating... 2022-10-07 13:11:51 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:11:51 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END REPLICATION ----- 2022-10-07 13:11:51 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:11:51 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Cloud storage job log path: /workspace/866/0/logs.log 2022-10-07 13:11:51 INFO i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.6 2022-10-07 13:11:52 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:11:52 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START DEFAULT NORMALIZATION ----- 2022-10-07 13:11:52 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:11:52 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):138 - Running with normalization version: airbyte/normalization-redshift:0.2.21 2022-10-07 13:11:52 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = normalization-redshift-normalize-866-0-ilcwu for airbyte/normalization-redshift:0.2.21 with resources io.airbyte.config.ResourceRequirements@fedbc6[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-07 13:11:52 INFO i.a.w.p.KubeProcessFactory(create):103 - normalization-redshift-normalize-866-0-ilcwu stdoutLocalPort = 9004 2022-10-07 13:11:52 INFO i.a.w.p.KubeProcessFactory(create):106 - normalization-redshift-normalize-866-0-ilcwu stderrLocalPort = 9005 2022-10-07 13:11:52 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):589 - Creating stdout socket server... 2022-10-07 13:11:52 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):607 - Creating stderr socket server... 2022-10-07 13:11:52 INFO i.a.w.p.KubePodProcess():520 - Creating pod normalization-redshift-normalize-866-0-ilcwu... 2022-10-07 13:11:52 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):309 - Waiting for init container to be ready before copying files... 2022-10-07 13:11:52 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):313 - Init container present.. 2022-10-07 13:11:54 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):316 - Init container ready.. 2022-10-07 13:11:54 INFO i.a.w.p.KubePodProcess():551 - Copying files... 2022-10-07 13:11:54 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: destination_config.json 2022-10-07 13:11:54 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/e8a414d7-2361-43e3-bc0a-23af71077118/destination_config.json dev/normalization-redshift-normalize-866-0-ilcwu:/config/destination_config.json -c init 2022-10-07 13:11:54 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:11:54 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:11:54 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: destination_catalog.json 2022-10-07 13:11:54 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/4c5a6f53-1795-4a95-9195-d3c58cdfa194/destination_catalog.json dev/normalization-redshift-normalize-866-0-ilcwu:/config/destination_catalog.json -c init 2022-10-07 13:11:54 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:11:54 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:11:54 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: FINISHED_UPLOADING 2022-10-07 13:11:54 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/7130e2ab-54bc-4707-ba4d-a1402c7c51f9/FINISHED_UPLOADING dev/normalization-redshift-normalize-866-0-ilcwu:/config/FINISHED_UPLOADING -c init 2022-10-07 13:11:54 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-07 13:11:55 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-07 13:11:55 INFO i.a.w.p.KubePodProcess():554 - Waiting until pod is ready... 2022-10-07 13:11:56 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):598 - Setting stdout... 2022-10-07 13:11:56 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):610 - Setting stderr... 2022-10-07 13:11:57 INFO i.a.w.p.KubePodProcess():570 - Reading pod IP... 2022-10-07 13:11:57 INFO i.a.w.p.KubePodProcess():572 - Pod IP: 14.0.3.74 2022-10-07 13:11:57 INFO i.a.w.p.KubePodProcess():579 - Using null stdin output stream... 2022-10-07 13:12:00 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2022-10-07 13:12:00 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2022-10-07 13:11:48 destination > 2022-10-07 13:11:44 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-10-07 13:11:48 destination > 2022-10-07 13:11:44 INFO i.a.i.b.IntegrationRunner(runInternal):104 - Running integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-07 13:11:48 destination > 2022-10-07 13:11:44 INFO i.a.i.b.IntegrationRunner(runInternal):105 - Command: WRITE 2022-10-07 13:11:48 destination > 2022-10-07 13:11:44 INFO i.a.i.b.IntegrationRunner(runInternal):106 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-10-07 13:11:48 destination > 2022-10-07 13:11:44 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-07 13:11:48 destination > 2022-10-07 13:11:44 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-07 13:11:48 destination > 2022-10-07 13:11:44 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-07 13:11:48 destination > 2022-10-07 13:11:44 WARN i.a.i.d.r.RedshiftDestination(determineUploadMode):54 - The "standard" upload mode is not performant, and is not recommended for production. Please use the Amazon S3 upload mode if you are syncing a large amount of data. 2022-10-07 13:11:48 destination > 2022-10-07 13:11:44 INFO i.a.i.d.j.c.SwitchingDestination(getConsumer):65 - Using destination type: STANDARD 2022-10-07 13:11:48 destination > 2022-10-07 13:11:44 INFO c.z.h.HikariDataSource():80 - HikariPool-1 - Starting... 2022-10-07 13:11:48 destination > 2022-10-07 13:11:44 INFO c.z.h.HikariDataSource():82 - HikariPool-1 - Start completed. 2022-10-07 13:11:48 destination > 2022-10-07 13:11:44 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=contacts, namespace=null, outputSchemaName=airbyte_latest_data, tmpTableName=_airbyte_tmp_ehm_contacts, outputTableName=_airbyte_raw_contacts, syncMode=append} 2022-10-07 13:11:48 destination > 2022-10-07 13:11:44 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2022-10-07 13:11:48 destination > 2022-10-07 13:11:44 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):123 - Preparing tmp tables in destination started for 1 streams 2022-10-07 13:11:48 destination > 2022-10-07 13:11:44 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream contacts. schema: airbyte_latest_data, tmp table name: _airbyte_tmp_ehm_contacts 2022-10-07 13:11:48 destination > 2022-10-07 13:11:45 INFO c.z.h.p.PoolBase(getAndSetNetworkTimeout):536 - HikariPool-1 - Driver does not support get/set network timeout for connections. ([Amazon][JDBC](10220) Driver does not support this optional feature.) 2022-10-07 13:11:48 destination > 2022-10-07 13:11:45 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):133 - Preparing tables in destination completed. 2022-10-07 13:11:48 source > Starting syncing SourceIntercom 2022-10-07 13:11:48 source > Using start_date: 1646092800.0 2022-10-07 13:11:48 source > Syncing stream: contacts 2022-10-07 13:11:49 source > Read 1 records from contacts stream 2022-10-07 13:11:49 source > Finished syncing contacts 2022-10-07 13:11:49 source > SourceIntercom runtimes: Syncing stream contacts 0:00:00.373758 2022-10-07 13:11:49 source > Finished syncing SourceIntercom 2022-10-07 13:11:50 destination > 2022-10-07 13:11:50 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):62 - Airbyte message consumer: succeeded. 2022-10-07 13:11:50 destination > 2022-10-07 13:11:50 INFO i.a.i.d.b.BufferedStreamConsumer(close):171 - executing on success close procedure. 2022-10-07 13:11:50 destination > 2022-10-07 13:11:50 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(flushAll):84 - Flushing contacts: 1 records (8 KB) 2022-10-07 13:11:50 destination > 2022-10-07 13:11:50 INFO i.a.i.d.r.o.RedshiftSqlOperations(insertRecordsInternal):89 - actual size of batch: 1 2022-10-07 13:11:50 destination > 2022-10-07 13:11:50 INFO i.a.i.d.r.o.RedshiftSqlOperations(onDestinationCloseOperations):139 - Executing operations for Redshift Destination DB engine... 2022-10-07 13:11:50 destination > 2022-10-07 13:11:50 INFO i.a.i.d.r.o.RedshiftSqlOperations(discoverNotSuperTables):189 - Discovering NOT SUPER table types... 2022-10-07 13:11:50 destination > 2022-10-07 13:11:50 INFO i.a.i.d.r.o.RedshiftSqlOperations(onDestinationCloseOperations):157 - Executing operations for Redshift Destination DB engine completed. 2022-10-07 13:11:50 destination > 2022-10-07 13:11:50 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):163 - Finalizing tables in destination started for 1 streams 2022-10-07 13:11:50 destination > 2022-10-07 13:11:50 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):168 - Finalizing stream contacts. schema airbyte_latest_data, tmp table _airbyte_tmp_ehm_contacts, final table _airbyte_raw_contacts 2022-10-07 13:11:50 destination > 2022-10-07 13:11:50 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):181 - Executing finalization of tables. 2022-10-07 13:11:50 destination > 2022-10-07 13:11:50 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):183 - Finalizing tables in destination completed. 2022-10-07 13:11:50 destination > 2022-10-07 13:11:50 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):186 - Cleaning tmp tables in destination started for 1 streams 2022-10-07 13:11:50 destination > 2022-10-07 13:11:50 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):190 - Cleaning tmp table in destination started for stream contacts. schema airbyte_latest_data, tmp table name: _airbyte_tmp_ehm_contacts 2022-10-07 13:11:50 destination > 2022-10-07 13:11:50 INFO i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onCloseFunction$3):195 - Cleaning tmp tables in destination completed. 2022-10-07 13:11:50 destination > 2022-10-07 13:11:50 INFO i.a.i.b.IntegrationRunner(runInternal):152 - Completed integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-07 13:11:50 destination > 2022-10-07 13:11:50 INFO i.a.i.d.r.RedshiftDestination(main):65 - completed destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-07 13:11:57 normalization > Running: transform-config --config destination_config.json --integration-type redshift --out /config 2022-10-07 13:11:57 normalization > Namespace(config='destination_config.json', integration_type=, out='/config') 2022-10-07 13:11:57 normalization > transform_redshift 2022-10-07 13:11:57 normalization > Running: transform-catalog --integration-type redshift --profile-config-dir /config --catalog destination_catalog.json --out /config/models/generated/ --json-column _airbyte_data 2022-10-07 13:11:57 normalization > Processing destination_catalog.json... 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_ab1.sql from contacts 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_ab2.sql from contacts 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_ab3.sql from contacts 2022-10-07 13:11:57 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts.sql from contacts 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_tags_ab1.sql from contacts/tags 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_tags_ab2.sql from contacts/tags 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_tags_ab3.sql from contacts/tags 2022-10-07 13:11:57 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts_tags.sql from contacts/tags 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_notes_ab1.sql from contacts/notes 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_notes_ab2.sql from contacts/notes 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_notes_ab3.sql from contacts/notes 2022-10-07 13:11:57 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts_notes.sql from contacts/notes 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_location_ab1.sql from contacts/location 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_location_ab2.sql from contacts/location 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_location_ab3.sql from contacts/location 2022-10-07 13:11:57 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts_location.sql from contacts/location 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_companies_ab1.sql from contacts/companies 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_companies_ab2.sql from contacts/companies 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_companies_ab3.sql from contacts/companies 2022-10-07 13:11:57 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts_companies.sql from contacts/companies 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_social_profiles_ab1.sql from contacts/social_profiles 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_social_profiles_ab2.sql from contacts/social_profiles 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_social_profiles_ab3.sql from contacts/social_profiles 2022-10-07 13:11:57 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts_social_profiles.sql from contacts/social_profiles 2022-10-07 13:11:57 normalization > Ignoring stream 'custom_attributes' from contacts/custom_attributes because properties list is empty 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_tags_data_ab1.sql from contacts/tags/data 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_tags_data_ab2.sql from contacts/tags/data 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_tags_data_ab3.sql from contacts/tags/data 2022-10-07 13:11:57 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts_tags_data.sql from contacts/tags/data 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_notes_data_ab1.sql from contacts/notes/data 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_notes_data_ab2.sql from contacts/notes/data 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_notes_data_ab3.sql from contacts/notes/data 2022-10-07 13:11:57 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts_notes_data.sql from contacts/notes/data 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_companies_data_ab1.sql from contacts/companies/data 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_companies_data_ab2.sql from contacts/companies/data 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_companies_data_ab3.sql from contacts/companies/data 2022-10-07 13:11:57 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts_companies_data.sql from contacts/companies/data 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_social_profiles_data_ab1.sql from contacts/social_profiles/data 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_social_profiles_data_ab2.sql from contacts/social_profiles/data 2022-10-07 13:11:57 normalization > Generating airbyte_ctes/airbyte_latest_data/contacts_social_profiles_data_ab3.sql from contacts/social_profiles/data 2022-10-07 13:11:57 normalization > Generating airbyte_incremental/airbyte_latest_data/contacts_social_profiles_data.sql from contacts/social_profiles/data 2022-10-07 13:11:57 normalization > detected no config file for ssh, assuming ssh is off. 2022-10-07 13:12:00 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2022-10-07 13:12:00 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2022-10-07 13:12:00 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2022-10-07 13:12:03 normalization > Running with dbt=1.0.0 2022-10-07 13:12:03 normalization > Partial parse save file not found. Starting full parse. 2022-10-07 13:12:06 normalization > [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. There are 2 unused configuration paths: - models.airbyte_utils.generated.airbyte_tables - models.airbyte_utils.generated.airbyte_views 2022-10-07 13:12:06 normalization > Found 40 models, 0 tests, 0 snapshots, 0 analyses, 605 macros, 0 operations, 0 seed files, 1 source, 0 exposures, 0 metrics 2022-10-07 13:12:06 normalization > Concurrency: 4 threads (target='prod') 2022-10-07 13:12:24 normalization > 1 of 10 START incremental model airbyte_latest_data.contacts............................................................ [RUN] 2022-10-07 13:12:27 normalization > 1 of 10 OK created incremental model airbyte_latest_data.contacts....................................................... [INSERT 0 2 in 3.05s] 2022-10-07 13:12:34 normalization > 2 of 10 START incremental model airbyte_latest_data.contacts_social_profiles............................................ [RUN] 2022-10-07 13:12:34 normalization > 3 of 10 START incremental model airbyte_latest_data.contacts_companies.................................................. [RUN] 2022-10-07 13:12:34 normalization > 4 of 10 START incremental model airbyte_latest_data.contacts_location................................................... [RUN] 2022-10-07 13:12:34 normalization > 5 of 10 START incremental model airbyte_latest_data.contacts_notes...................................................... [RUN] 2022-10-07 13:12:40 normalization > 3 of 10 OK created incremental model airbyte_latest_data.contacts_companies............................................. [INSERT 0 2 in 5.75s] 2022-10-07 13:12:40 normalization > 5 of 10 OK created incremental model airbyte_latest_data.contacts_notes................................................. [INSERT 0 2 in 5.84s] 2022-10-07 13:12:40 normalization > 4 of 10 OK created incremental model airbyte_latest_data.contacts_location.............................................. [INSERT 0 2 in 5.94s] 2022-10-07 13:12:40 normalization > 2 of 10 OK created incremental model airbyte_latest_data.contacts_social_profiles....................................... [INSERT 0 2 in 6.25s] 2022-10-07 13:12:42 normalization > 6 of 10 START incremental model airbyte_latest_data.contacts_tags....................................................... [RUN] 2022-10-07 13:12:46 normalization > 7 of 10 START incremental model airbyte_latest_data.contacts_companies_data............................................. [RUN] 2022-10-07 13:12:46 normalization > 8 of 10 START incremental model airbyte_latest_data.contacts_notes_data................................................. [RUN] 2022-10-07 13:12:46 normalization > 9 of 10 START incremental model airbyte_latest_data.contacts_social_profiles_data....................................... [RUN] 2022-10-07 13:12:47 normalization > 6 of 10 OK created incremental model airbyte_latest_data.contacts_tags.................................................. [INSERT 0 2 in 5.05s] 2022-10-07 13:12:55 INFO i.a.w.p.KubePodProcess(close):737 - (pod: dev / normalization-redshift-normalize-866-0-ilcwu) - Closed all resources for pod 2022-10-07 13:12:55 INFO i.a.w.g.DefaultNormalizationWorker(run):82 - Normalization executed in 1 minute 3 seconds. 2022-10-07 13:12:55 INFO i.a.w.g.DefaultNormalizationWorker(run):95 - Normalization summary: io.airbyte.config.NormalizationSummary@492dd2f1[startTime=1665148312018,endTime=1665148375923,failures=[]] 2022-10-07 13:12:55 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:12:55 INFO i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling... 2022-10-07 13:12:55 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END DEFAULT NORMALIZATION ----- 2022-10-07 13:12:55 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-07 13:12:55 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):312 - Stopping temporal heartbeating... 2022-10-07 13:12:51 normalization > 7 of 10 OK created incremental model airbyte_latest_data.contacts_companies_data........................................ [INSERT 0 3 in 5.61s] 2022-10-07 13:12:52 normalization > 10 of 10 START incremental model airbyte_latest_data.contacts_tags_data................................................. [RUN] 2022-10-07 13:12:52 normalization > 9 of 10 OK created incremental model airbyte_latest_data.contacts_social_profiles_data.................................. [INSERT 0 3 in 6.17s] 2022-10-07 13:12:52 normalization > 8 of 10 OK created incremental model airbyte_latest_data.contacts_notes_data............................................ [INSERT 0 3 in 6.82s] 2022-10-07 13:12:54 normalization > 10 of 10 OK created incremental model airbyte_latest_data.contacts_tags_data............................................ [INSERT 0 210 in 2.29s] 2022-10-07 13:12:54 normalization > Finished running 10 incremental models in 48.74s. 2022-10-07 13:12:55 normalization > Completed successfully 2022-10-07 13:12:55 normalization > Done. PASS=10 WARN=0 ERROR=0 SKIP=0 TOTAL=10