2022-10-10 18:30:30 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.client_id: is missing but it is required, $.client_secret: is missing but it is required, $.access_token: is missing but it is required, $.auth_type: must be a constant value OAuth2.0 2022-10-10 18:30:30 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.token: object found, string expected 2022-10-10 18:30:30 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.format_type: does not have a value in the enumeration [Avro], $.compression_codec: string found, object expected, $.compression_codec: should be valid to one and only one of the schemas 2022-10-10 18:30:30 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.flattening: is missing but it is required, $.format_type: does not have a value in the enumeration [CSV] 2022-10-10 18:30:30 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.format_type: does not have a value in the enumeration [JSONL] 2022-10-10 18:30:53 destination > 2022-10-10 18:30:50 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-10-10 18:30:30 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Cloud storage job log path: /workspace/931/0/logs.log 2022-10-10 18:30:30 INFO i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.6 2022-10-10 18:30:30 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = source-notion-check-931-0-igauk for airbyte/source-notion:0.1.10 with resources io.airbyte.config.ResourceRequirements@7a220907[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-10 18:30:30 INFO i.a.w.p.KubeProcessFactory(create):103 - source-notion-check-931-0-igauk stdoutLocalPort = 9014 2022-10-10 18:30:30 INFO i.a.w.p.KubeProcessFactory(create):106 - source-notion-check-931-0-igauk stderrLocalPort = 9015 2022-10-10 18:30:30 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 18:30:30 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-10-10 18:30:30 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 18:30:30 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):589 - Creating stdout socket server... 2022-10-10 18:30:30 INFO i.a.w.p.KubePodProcess():520 - Creating pod source-notion-check-931-0-igauk... 2022-10-10 18:30:30 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):607 - Creating stderr socket server... 2022-10-10 18:30:30 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):309 - Waiting for init container to be ready before copying files... 2022-10-10 18:30:30 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):313 - Init container present.. 2022-10-10 18:30:32 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):316 - Init container ready.. 2022-10-10 18:30:32 INFO i.a.w.p.KubePodProcess():551 - Copying files... 2022-10-10 18:30:32 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: source_config.json 2022-10-10 18:30:32 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/14f843e4-e0a2-4321-b355-b2ea3a7325c0/source_config.json dev/source-notion-check-931-0-igauk:/config/source_config.json -c init 2022-10-10 18:30:32 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-10 18:30:33 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-10 18:30:33 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: FINISHED_UPLOADING 2022-10-10 18:30:33 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/b6b7962d-396e-42c8-8764-aa0161947bb1/FINISHED_UPLOADING dev/source-notion-check-931-0-igauk:/config/FINISHED_UPLOADING -c init 2022-10-10 18:30:33 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-10 18:30:33 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-10 18:30:33 INFO i.a.w.p.KubePodProcess():554 - Waiting until pod is ready... 2022-10-10 18:30:34 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):598 - Setting stdout... 2022-10-10 18:30:34 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):610 - Setting stderr... 2022-10-10 18:30:34 INFO i.a.w.p.KubePodProcess():570 - Reading pod IP... 2022-10-10 18:30:34 INFO i.a.w.p.KubePodProcess():572 - Pod IP: 14.0.3.234 2022-10-10 18:30:34 INFO i.a.w.p.KubePodProcess():579 - Using null stdin output stream... 2022-10-10 18:30:35 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Check succeeded 2022-10-10 18:30:36 INFO i.a.w.p.KubePodProcess(close):737 - (pod: dev / source-notion-check-931-0-igauk) - Closed all resources for pod 2022-10-10 18:30:36 INFO i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling... 2022-10-10 18:30:36 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 18:30:36 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-10 18:30:36 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 18:30:36 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Cloud storage job log path: /workspace/931/0/logs.log 2022-10-10 18:30:36 INFO i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.6 2022-10-10 18:30:36 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 18:30:36 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-10-10 18:30:36 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 18:30:36 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = destination-s3-check-931-0-cajge for airbyte/destination-s3:0.3.15 with resources io.airbyte.config.ResourceRequirements@7a220907[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-10 18:30:36 INFO i.a.w.p.KubeProcessFactory(create):103 - destination-s3-check-931-0-cajge stdoutLocalPort = 9012 2022-10-10 18:30:36 INFO i.a.w.p.KubeProcessFactory(create):106 - destination-s3-check-931-0-cajge stderrLocalPort = 9013 2022-10-10 18:30:36 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):589 - Creating stdout socket server... 2022-10-10 18:30:36 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):607 - Creating stderr socket server... 2022-10-10 18:30:36 INFO i.a.w.p.KubePodProcess():520 - Creating pod destination-s3-check-931-0-cajge... 2022-10-10 18:30:36 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):309 - Waiting for init container to be ready before copying files... 2022-10-10 18:30:36 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):313 - Init container present.. 2022-10-10 18:30:38 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):316 - Init container ready.. 2022-10-10 18:30:38 INFO i.a.w.p.KubePodProcess():551 - Copying files... 2022-10-10 18:30:38 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: source_config.json 2022-10-10 18:30:38 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/633730ec-3dd4-46fa-a383-4581f0daa4b7/source_config.json dev/destination-s3-check-931-0-cajge:/config/source_config.json -c init 2022-10-10 18:30:38 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-10 18:30:38 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-10 18:30:38 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: FINISHED_UPLOADING 2022-10-10 18:30:38 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/e722495c-43e5-4e31-91d9-1c04a08d02aa/FINISHED_UPLOADING dev/destination-s3-check-931-0-cajge:/config/FINISHED_UPLOADING -c init 2022-10-10 18:30:38 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-10 18:30:38 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-10 18:30:38 INFO i.a.w.p.KubePodProcess():554 - Waiting until pod is ready... 2022-10-10 18:30:39 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):598 - Setting stdout... 2022-10-10 18:30:39 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):610 - Setting stderr... 2022-10-10 18:30:40 INFO i.a.w.p.KubePodProcess():570 - Reading pod IP... 2022-10-10 18:30:40 INFO i.a.w.p.KubePodProcess():572 - Pod IP: 14.0.3.224 2022-10-10 18:30:40 INFO i.a.w.p.KubePodProcess():579 - Using null stdin output stream... 2022-10-10 18:30:41 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:41 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-10-10 18:30:41 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:41 INFO i.a.i.b.IntegrationRunner(runInternal):104 - Running integration: io.airbyte.integrations.destination.s3.S3Destination 2022-10-10 18:30:41 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:41 INFO i.a.i.b.IntegrationRunner(runInternal):105 - Command: CHECK 2022-10-10 18:30:41 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:41 INFO i.a.i.b.IntegrationRunner(runInternal):106 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-10-10 18:30:41 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:41 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-10 18:30:41 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:41 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-10 18:30:41 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:41 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-10 18:30:41 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:41 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword requires - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-10 18:30:41 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:41 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"Parquet","page_size_kb":1024,"block_size_mb":128,"compression_codec":"UNCOMPRESSED","dictionary_encoding":true,"max_padding_size_mb":8,"dictionary_page_size_kb":1024} 2022-10-10 18:30:41 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:41 INFO i.a.i.d.s.S3DestinationConfig(createS3Client):190 - Creating S3 client... 2022-10-10 18:30:42 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:42 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):102 - Storage Object redshift-dev-s3-bucket/csv_path_dev_2 does not exist in bucket; creating... 2022-10-10 18:30:42 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:42 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):104 - Storage Object redshift-dev-s3-bucket/csv_path_dev_2 has been created in bucket. 2022-10-10 18:30:42 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:42 INFO i.a.i.d.s.S3Destination(testIAMUserHasListObjectPermission):156 - Started testing if IAM user can call listObjects on the destination bucket 2022-10-10 18:30:42 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:42 INFO i.a.i.d.s.S3Destination(testIAMUserHasListObjectPermission):159 - Finished checking for listObjects permission 2022-10-10 18:30:42 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:42 INFO i.a.i.d.s.S3Destination(testSingleUpload):81 - Started testing if all required credentials assigned to user for single file uploading 2022-10-10 18:30:42 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:42 INFO i.a.i.d.s.S3Destination(testSingleUpload):91 - Finished checking for normal upload mode 2022-10-10 18:30:42 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:42 INFO i.a.i.d.s.S3Destination(testMultipartUpload):95 - Started testing if all required credentials assigned to user for multipart upload 2022-10-10 18:30:42 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:42 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to redshift-dev-s3-bucket/csv_path_dev_2/test_1665426642922 with full ID sWAO6RZxZ7EtrIgmo1PBIektVVysoe6tGFkmi9.1kjqtsKngp.NyNh7.ZwrimtQBdrC_RVQZ5Le_pngSJ65d.Q8W.I3t2.QMGr6BLGhOl2SgI8Qtjb1AYGM4XHGvTAEj 2022-10-10 18:30:43 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:43 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-10-10 18:30:43 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:43 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-10-10 18:30:43 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:43 WARN a.m.s.MultiPartOutputStream(close):160 - [MultipartOutputStream for parts 1 - 10000] is already closed 2022-10-10 18:30:43 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:43 INFO a.m.s.StreamTransferManager(complete):367 - [Manager uploading to redshift-dev-s3-bucket/csv_path_dev_2/test_1665426642922 with id sWAO6RZxZ...4XHGvTAEj]: Uploading leftover stream [Part number 1 containing 3.34 MB] 2022-10-10 18:30:43 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:43 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to redshift-dev-s3-bucket/csv_path_dev_2/test_1665426642922 with id sWAO6RZxZ...4XHGvTAEj]: Finished uploading [Part number 1 containing 3.34 MB] 2022-10-10 18:30:43 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:43 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to redshift-dev-s3-bucket/csv_path_dev_2/test_1665426642922 with id sWAO6RZxZ...4XHGvTAEj]: Completed 2022-10-10 18:30:43 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:43 INFO i.a.i.d.s.S3Destination(testMultipartUpload):119 - Finished verification for multipart upload mode 2022-10-10 18:30:43 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-10-10 18:30:43 INFO i.a.i.b.IntegrationRunner(runInternal):152 - Completed integration: io.airbyte.integrations.destination.s3.S3Destination 2022-10-10 18:30:44 INFO i.a.w.p.KubePodProcess(close):737 - (pod: dev / destination-s3-check-931-0-cajge) - Closed all resources for pod 2022-10-10 18:30:44 INFO i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling... 2022-10-10 18:30:44 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 18:30:44 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-10 18:30:44 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 18:30:44 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Cloud storage job log path: /workspace/931/0/logs.log 2022-10-10 18:30:44 INFO i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.6 2022-10-10 18:30:45 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):49 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-10-10 18:30:45 INFO i.a.c.EnvConfigs(getEnvOrDefault):1096 - Using default value for environment variable METRIC_CLIENT: '' 2022-10-10 18:30:45 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2022-10-10 18:30:45 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):49 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-10-10 18:30:45 INFO i.a.w.g.DefaultReplicationWorker(run):122 - start sync worker. job id: 931 attempt id: 0 2022-10-10 18:30:45 INFO i.a.w.g.DefaultReplicationWorker(run):135 - configured sync modes: {null.databases=incremental - append} 2022-10-10 18:30:45 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-10-10 18:30:45 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = destination-s3-write-931-0-wasns for airbyte/destination-s3:0.3.15 with resources io.airbyte.config.ResourceRequirements@28f25f24[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-10 18:30:45 INFO i.a.w.p.KubeProcessFactory(create):103 - destination-s3-write-931-0-wasns stdoutLocalPort = 9022 2022-10-10 18:30:45 INFO i.a.w.p.KubeProcessFactory(create):106 - destination-s3-write-931-0-wasns stderrLocalPort = 9023 2022-10-10 18:30:45 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 18:30:45 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START REPLICATION ----- 2022-10-10 18:30:45 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 18:30:45 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):589 - Creating stdout socket server... 2022-10-10 18:30:45 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):607 - Creating stderr socket server... 2022-10-10 18:30:45 INFO i.a.w.p.KubePodProcess():520 - Creating pod destination-s3-write-931-0-wasns... 2022-10-10 18:30:45 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):309 - Waiting for init container to be ready before copying files... 2022-10-10 18:30:45 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):313 - Init container present.. 2022-10-10 18:30:46 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):316 - Init container ready.. 2022-10-10 18:30:46 INFO i.a.w.p.KubePodProcess():551 - Copying files... 2022-10-10 18:30:46 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: destination_config.json 2022-10-10 18:30:46 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/7d53fa17-4fe5-4df2-9b9f-84f2806c4488/destination_config.json dev/destination-s3-write-931-0-wasns:/config/destination_config.json -c init 2022-10-10 18:30:46 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-10 18:30:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-10 18:30:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: destination_catalog.json 2022-10-10 18:30:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/f9392c97-52f3-45c1-a51c-d15f1a87263e/destination_catalog.json dev/destination-s3-write-931-0-wasns:/config/destination_catalog.json -c init 2022-10-10 18:30:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-10 18:30:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-10 18:30:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: FINISHED_UPLOADING 2022-10-10 18:30:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/14c51fd3-d7f8-43c4-89de-45df299cf0ac/FINISHED_UPLOADING dev/destination-s3-write-931-0-wasns:/config/FINISHED_UPLOADING -c init 2022-10-10 18:30:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-10 18:30:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-10 18:30:47 INFO i.a.w.p.KubePodProcess():554 - Waiting until pod is ready... 2022-10-10 18:30:48 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):598 - Setting stdout... 2022-10-10 18:30:48 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):610 - Setting stderr... 2022-10-10 18:30:48 INFO i.a.w.p.KubePodProcess():570 - Reading pod IP... 2022-10-10 18:30:48 INFO i.a.w.p.KubePodProcess():572 - Pod IP: 14.0.3.225 2022-10-10 18:30:48 INFO i.a.w.p.KubePodProcess():575 - Creating stdin socket... 2022-10-10 18:30:48 INFO i.a.w.p.KubeProcessFactory(create):100 - Attempting to start pod = source-notion-read-931-0-xxjtm for airbyte/source-notion:0.1.10 with resources io.airbyte.config.ResourceRequirements@21775361[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-10 18:30:48 INFO i.a.w.p.KubeProcessFactory(create):103 - source-notion-read-931-0-xxjtm stdoutLocalPort = 9010 2022-10-10 18:30:48 INFO i.a.w.p.KubeProcessFactory(create):106 - source-notion-read-931-0-xxjtm stderrLocalPort = 9011 2022-10-10 18:30:48 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):589 - Creating stdout socket server... 2022-10-10 18:30:48 INFO i.a.w.p.KubePodProcess():520 - Creating pod source-notion-read-931-0-xxjtm... 2022-10-10 18:30:48 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):607 - Creating stderr socket server... 2022-10-10 18:30:48 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):309 - Waiting for init container to be ready before copying files... 2022-10-10 18:30:48 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):313 - Init container present.. 2022-10-10 18:30:51 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):316 - Init container ready.. 2022-10-10 18:30:51 INFO i.a.w.p.KubePodProcess():551 - Copying files... 2022-10-10 18:30:51 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: source_config.json 2022-10-10 18:30:51 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/1bfa96e6-ccad-4c12-b8c0-13e7d351d5de/source_config.json dev/source-notion-read-931-0-xxjtm:/config/source_config.json -c init 2022-10-10 18:30:51 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-10 18:30:51 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-10 18:30:51 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: source_catalog.json 2022-10-10 18:30:51 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/96ee7b3e-79a3-4ba4-b000-915c26482521/source_catalog.json dev/source-notion-read-931-0-xxjtm:/config/source_catalog.json -c init 2022-10-10 18:30:51 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-10 18:30:51 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-10 18:30:51 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Uploading file: FINISHED_UPLOADING 2022-10-10 18:30:51 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):266 - kubectl cp /tmp/29f0e762-8dba-4414-a430-14c7fb6bf70b/FINISHED_UPLOADING dev/source-notion-read-931-0-xxjtm:/config/FINISHED_UPLOADING -c init 2022-10-10 18:30:51 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):269 - Waiting for kubectl cp to complete 2022-10-10 18:30:52 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):283 - kubectl cp complete, closing process 2022-10-10 18:30:52 INFO i.a.w.p.KubePodProcess():554 - Waiting until pod is ready... 2022-10-10 18:30:52 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):598 - Setting stdout... 2022-10-10 18:30:52 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):610 - Setting stderr... 2022-10-10 18:30:53 INFO i.a.w.p.KubePodProcess():570 - Reading pod IP... 2022-10-10 18:30:53 INFO i.a.w.p.KubePodProcess():572 - Pod IP: 14.0.3.82 2022-10-10 18:30:53 INFO i.a.w.p.KubePodProcess():579 - Using null stdin output stream... 2022-10-10 18:30:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):435 - Destination output thread started. 2022-10-10 18:30:53 INFO i.a.w.g.DefaultReplicationWorker(run):177 - Waiting for source and destination threads to complete. 2022-10-10 18:30:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):322 - Replication thread started. 2022-10-10 18:30:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):355 - Source has no more messages, closing connection. 2022-10-10 18:30:55 INFO i.a.w.p.KubePodProcess(close):737 - (pod: dev / source-notion-read-931-0-xxjtm) - Closed all resources for pod 2022-10-10 18:30:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):363 - Total records read: 3 (2 KB) 2022-10-10 18:30:55 INFO i.a.w.g.DefaultReplicationWorker(run):182 - One of source or destination thread complete. Waiting on the other. 2022-10-10 18:30:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):445 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@598a81e9[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@7342b060[type=STREAM,stream=io.airbyte.protocol.models.AirbyteStreamState@106b2c1e[streamDescriptor=io.airbyte.protocol.models.StreamDescriptor@38dfd05e[name=databases,namespace=,additionalProperties={}],streamState={"last_edited_time":"2022-10-10T13:11:00.000Z"},additionalProperties={}],global=,data={"databases":{"last_edited_time":"2022-10-10T13:11:00.000Z"}},additionalProperties={}],trace=,additionalProperties={}] 2022-10-10 18:30:58 INFO i.a.w.p.KubePodProcess(close):737 - (pod: dev / destination-s3-write-931-0-wasns) - Closed all resources for pod 2022-10-10 18:30:58 INFO i.a.w.g.DefaultReplicationWorker(run):184 - Source and destination threads complete. 2022-10-10 18:30:58 INFO i.a.w.g.DefaultReplicationWorker(run):279 - Source output at least one state message 2022-10-10 18:30:58 INFO i.a.w.g.DefaultReplicationWorker(run):285 - State capture: Updated state to: Optional[io.airbyte.config.State@6f9b91db[state=[{"type":"STREAM","stream":{"stream_descriptor":{"name":"databases"},"stream_state":{"last_edited_time":"2022-10-10T13:11:00.000Z"}},"data":{"databases":{"last_edited_time":"2022-10-10T13:11:00.000Z"}}}]]] 2022-10-10 18:30:58 INFO i.a.w.g.DefaultReplicationWorker(run):300 - sync summary: { "status" : "completed", "recordsSynced" : 2, "bytesSynced" : 2914, "startTime" : 1665426645079, "endTime" : 1665426658883, "totalStats" : { "recordsEmitted" : 2, "bytesEmitted" : 2914, "sourceStateMessagesEmitted" : 1, "destinationStateMessagesEmitted" : 1, "recordsCommitted" : 2, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 4, "meanSecondsBetweenStateMessageEmittedandCommitted" : 4 }, "streamStats" : [ { "streamName" : "databases", "stats" : { "recordsEmitted" : 2, "bytesEmitted" : 2914, "recordsCommitted" : 2 } } ] } 2022-10-10 18:30:58 INFO i.a.w.g.DefaultReplicationWorker(run):301 - failures: [ ] 2022-10-10 18:30:58 INFO i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling... 2022-10-10 18:30:58 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 18:30:58 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END REPLICATION ----- 2022-10-10 18:30:58 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 18:30:58 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):166 - sync summary: io.airbyte.config.StandardSyncOutput@4f0d8d16[standardSyncSummary=io.airbyte.config.StandardSyncSummary@5b143ba2[status=completed,recordsSynced=2,bytesSynced=2914,startTime=1665426645079,endTime=1665426658883,totalStats=io.airbyte.config.SyncStats@7755eb09[recordsEmitted=2,bytesEmitted=2914,sourceStateMessagesEmitted=1,destinationStateMessagesEmitted=1,recordsCommitted=2,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=4,meanSecondsBetweenStateMessageEmittedandCommitted=4,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@9b955d6[streamName=databases,stats=io.airbyte.config.SyncStats@2a7f1cca[recordsEmitted=2,bytesEmitted=2914,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=2,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,additionalProperties={}]]]],normalizationSummary=,state=io.airbyte.config.State@6f9b91db[state=[{"type":"STREAM","stream":{"stream_descriptor":{"name":"databases"},"stream_state":{"last_edited_time":"2022-10-10T13:11:00.000Z"}},"data":{"databases":{"last_edited_time":"2022-10-10T13:11:00.000Z"}}}]],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@50ccfb0c[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@8195fbf[stream=io.airbyte.protocol.models.AirbyteStream@4b4dbc8f[name=databases,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"string"},"url":{"type":"string"},"icon":{"anyOf":[{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"file":{"type":["null","object"],"properties":{"url":{"type":"string"},"expiry_time":{"type":"string"}},"additionalProperties":true},"type":{"enum":["file","external"]},"caption":{"type":["null","array"],"items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"external":{"type":["null","object"],"properties":{"url":{"type":"string"}},"additionalProperties":true}},"additionalProperties":true},{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"type":{"type":"string"},"emoji":{"type":"string"}},"additionalProperties":true}],"$schema":"http://json-schema.org/draft-07/schema#"},"cover":{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"file":{"type":["null","object"],"properties":{"url":{"type":"string"},"expiry_time":{"type":"string"}},"additionalProperties":true},"type":{"enum":["file","external"]},"caption":{"type":["null","array"],"items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"external":{"type":["null","object"],"properties":{"url":{"type":"string"}},"additionalProperties":true}},"additionalProperties":true},"title":{"type":"array","items":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"href":{"type":["null","string"]},"text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"type":{"type":["null","string"]},"rich_text":{"type":["null","object"],"properties":{"link":{"type":["null","object"],"properties":{"url":{"type":["null","string"]},"type":{"enum":["url"]}},"additionalProperties":true},"content":{"type":["null","string"]}},"additionalProperties":true},"plain_text":{"type":["null","string"]},"annotations":{"type":["null","object"],"properties":{"bold":{"type":["null","boolean"]},"code":{"type":["null","boolean"]},"color":{"type":["null","string"]},"italic":{"type":["null","boolean"]},"underline":{"type":["null","boolean"]},"strikethrough":{"type":["null","boolean"]}},"additionalProperties":true}}}},"object":{"enum":["database"]},"parent":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"type":{"enum":["database_id","page_id","workspace"]},"page_id":{"type":"string"},"workspace":{"type":"boolean"},"database_id":{"type":"string"}},"additionalProperties":true},"archived":{"type":"boolean"},"is_inline":{"type":["null","boolean"]},"created_by":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"string"},"bot":{"type":["null","object"],"properties":{"owner":{"type":"object","properties":{"type":{"type":"string"},"workspace":{"type":["null","boolean"]}}}},"additionalProperties":true},"name":{"type":"string"},"type":{"enum":["person","bot"]},"object":{"enum":["user"]},"person":{"type":["null","object"],"properties":{"email":{"type":"string"}},"additionalProperties":true},"avatar_url":{"type":["null","string"]}},"additionalProperties":true},"properties":{"type":"array","items":{"type":["null","object"],"properties":{"name":{"type":["null","string"]},"value":{"type":"object","oneOf":[{"type":"object","properties":{"id":{"type":"string"},"name":{"type":"string"},"type":{"enum":["title","rich_text","date","people","files","checkbox","url","email","phone_number","created_time","created_by","last_edited_time","last_edited_by"]}},"additionalProperties":true},{"type":"object","properties":{"id":{"type":"string"},"name":{"type":"string"},"type":{"enum":["number"]},"format":{"enum":["number","number_with_commas","percent","dollar","canadian_dollar","euro","pound","yen","ruble","rupee","won","yuan","real","lira","rupiah","franc","hong_kong_dollar","new_zealand_dollar","krona","norwegian_krone","mexican_peso","rand","new_taiwan_dollar","danish_krone","zloty","baht","forint","koruna","shekel","chilean_peso","philippine_peso","dirham","colombian_peso","riyal","ringgit","leu"]}}},{"type":"object","properties":{"id":{"type":"string"},"name":{"type":"string"},"type":{"enum":["select","multi_select"]},"options":{"type":"array","items":{"type":["null","object"],"$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"string"},"name":{"type":"string"},"color":{"enum":["default","gray","brown","orange","yellow","green","blue","purple","pink","red"]}},"additionalProperties":true}}}},{"type":"object","properties":{"id":{"type":"string"},"name":{"type":"string"},"type":{"enum":["formula"]},"expression":{"type":"string"}}},{"type":"object","properties":{"id":{"type":"string"},"name":{"type":"string"},"type":{"enum":["relation"]},"database_id":{"type":"string"},"synced_property_id":{"type":["null","string"]},"synced_property_name":{"type":["null","string"]}}},{"type":"object","properties":{"id":{"type":"string"},"name":{"type":"string"},"type":{"enum":["rollup"]},"function":{"enum":["count_all","count_values","count_unique_values","count_empty","count_not_empty","percent_empty","percent_not_empty","sum","average","median","min","max","range","show_original"]},"rollup_property_id":{"type":"string"},"relation_property_id":{"type":"string"},"rollup_property_name":{"type":"string"},"relation_property_name":{"type":"string"}}}],"additionalProperties":true}},"additionalProperties":true}},"created_time":{"type":"string"},"last_edited_by":{"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"string"},"bot":{"type":["null","object"],"properties":{"owner":{"type":"object","properties":{"type":{"type":"string"},"workspace":{"type":["null","boolean"]}}}},"additionalProperties":true},"name":{"type":"string"},"type":{"enum":["person","bot"]},"object":{"enum":["user"]},"person":{"type":["null","object"],"properties":{"email":{"type":"string"}},"additionalProperties":true},"avatar_url":{"type":["null","string"]}},"additionalProperties":true},"last_edited_time":{"type":"string"}},"additionalProperties":true},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[last_edited_time],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[last_edited_time],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-10-10 18:30:58 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):312 - Stopping temporal heartbeating...