2022-08-17 15:57:27 INFO i.a.w.w.WorkerRun(call):49 - Executing worker wrapper. Airbyte version: 0.36.0-alpha 2022-08-17 15:57:27 INFO i.a.w.t.TemporalAttemptExecution(get):107 - Cloud storage job log path: /workspace/2917/0/logs.log 2022-08-17 15:58:02 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-08-17 15:57:27 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.36.0-alpha 2022-08-17 15:57:28 INFO i.a.w.DefaultReplicationWorker(run):104 - start sync worker. job id: 2917 attempt id: 0 2022-08-17 15:57:28 INFO i.a.w.DefaultReplicationWorker(run):116 - configured sync modes: {null.issues=incremental - append_dedup, null.projects=full_refresh - append} 2022-08-17 15:57:28 INFO i.a.w.p.a.DefaultAirbyteDestination(start):69 - Running destination... 2022-08-17 15:57:28 INFO i.a.w.p.KubeProcessFactory(create):113 - Attempting to start pod = destination-redshift-sync-2917-0-bojjk for airbyte/destination-redshift:0.3.29 2022-08-17 15:57:28 INFO i.a.w.p.KubeProcessFactory(create):116 - destination-redshift-sync-2917-0-bojjk stdoutLocalPort = 9036 2022-08-17 15:57:28 INFO i.a.w.p.KubeProcessFactory(create):119 - destination-redshift-sync-2917-0-bojjk stderrLocalPort = 9037 2022-08-17 15:57:28 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):583 - Creating stdout socket server... 2022-08-17 15:57:28 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):601 - Creating stderr socket server... 2022-08-17 15:57:28 INFO i.a.w.p.KubePodProcess():521 - Creating pod destination-redshift-sync-2917-0-bojjk... 2022-08-17 15:57:58 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):305 - Waiting for init container to be ready before copying files... 2022-08-17 15:57:58 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):318 - Init container present.. 2022-08-17 15:57:59 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):321 - Init container ready.. 2022-08-17 15:57:59 INFO i.a.w.p.KubePodProcess():546 - Copying files... 2022-08-17 15:57:59 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):254 - Uploading file: destination_config.json 2022-08-17 15:57:59 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):262 - kubectl cp /tmp/da1f5abd-12d7-4171-99b6-e9fa07ef3001/destination_config.json airbyte/destination-redshift-sync-2917-0-bojjk:/config/destination_config.json -c init 2022-08-17 15:57:59 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - Waiting for kubectl cp to complete 2022-08-17 15:58:00 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):279 - kubectl cp complete, closing process 2022-08-17 15:58:00 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):254 - Uploading file: destination_catalog.json 2022-08-17 15:58:00 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):262 - kubectl cp /tmp/1ff69e0c-353b-4a85-a955-b28935cf0e8d/destination_catalog.json airbyte/destination-redshift-sync-2917-0-bojjk:/config/destination_catalog.json -c init 2022-08-17 15:58:00 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - Waiting for kubectl cp to complete 2022-08-17 15:58:00 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):279 - kubectl cp complete, closing process 2022-08-17 15:58:00 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):254 - Uploading file: FINISHED_UPLOADING 2022-08-17 15:58:00 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):262 - kubectl cp /tmp/2fb2e378-ff4e-434f-be61-e3edbae3d19f/FINISHED_UPLOADING airbyte/destination-redshift-sync-2917-0-bojjk:/config/FINISHED_UPLOADING -c init 2022-08-17 15:58:00 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - Waiting for kubectl cp to complete 2022-08-17 15:58:00 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):279 - kubectl cp complete, closing process 2022-08-17 15:58:00 INFO i.a.w.p.KubePodProcess():549 - Waiting until pod is ready... 2022-08-17 15:58:01 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):592 - Setting stdout... 2022-08-17 15:58:01 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):604 - Setting stderr... 2022-08-17 15:58:02 INFO i.a.w.p.KubePodProcess():564 - Reading pod IP... 2022-08-17 15:58:02 INFO i.a.w.p.KubePodProcess():566 - Pod IP: 100.65.99.211 2022-08-17 15:58:02 INFO i.a.w.p.KubePodProcess():569 - Creating stdin socket... 2022-08-17 15:58:02 INFO i.a.w.p.KubeProcessFactory(create):113 - Attempting to start pod = source-jira-sync-2917-0-mwxqk for airbyte/source-jira:0.2.20 2022-08-17 15:58:02 INFO i.a.w.p.KubeProcessFactory(create):116 - source-jira-sync-2917-0-mwxqk stdoutLocalPort = 9014 2022-08-17 15:58:02 INFO i.a.w.p.KubeProcessFactory(create):119 - source-jira-sync-2917-0-mwxqk stderrLocalPort = 9015 2022-08-17 15:58:02 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):583 - Creating stdout socket server... 2022-08-17 15:58:02 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):601 - Creating stderr socket server... 2022-08-17 15:58:02 INFO i.a.w.p.KubePodProcess():521 - Creating pod source-jira-sync-2917-0-mwxqk... 2022-08-17 15:58:02 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-17 15:58:02 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-17 15:58:02 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-08-17 15:58:02 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-08-17 15:58:35 destination > 2022-08-17 15:58:04 INFO i.a.i.d.r.RedshiftDestination(main):77 - starting destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-08-17 15:58:35 destination > 2022-08-17 15:58:05 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-08-17 15:58:35 destination > 2022-08-17 15:58:05 INFO i.a.i.b.IntegrationRunner(runInternal):121 - Running integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-08-17 15:58:35 destination > 2022-08-17 15:58:05 INFO i.a.i.b.IntegrationRunner(runInternal):122 - Command: WRITE 2022-08-17 15:58:35 destination > 2022-08-17 15:58:05 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-08-17 15:58:35 source > Starting syncing SourceJira 2022-08-17 15:58:35 destination > 2022-08-17 15:58:05 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-17 15:58:35 destination > 2022-08-17 15:58:05 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-17 15:58:35 destination > 2022-08-17 15:58:05 INFO i.a.i.d.j.c.SwitchingDestination(getConsumer):65 - Using destination type: COPY_S3 2022-08-17 15:58:35 destination > 2022-08-17 15:58:06 INFO i.a.i.d.s.S3DestinationConfig(createS3Client):169 - Creating S3 client... 2022-08-17 15:58:35 destination > 2022-08-17 15:58:08 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2022-08-17 15:58:35 source > Syncing stream: issues 2022-08-17 15:58:39 source > Read 7 records from issues stream 2022-08-17 15:58:39 source > Finished syncing issues 2022-08-17 15:58:39 source > SourceJira runtimes: Syncing stream issues 0:00:03.654711 2022-08-17 15:58:39 source > Syncing stream: projects 2022-08-17 15:58:39 source > Read 13 records from projects stream 2022-08-17 15:58:39 source > Finished syncing projects 2022-08-17 15:58:39 source > SourceJira runtimes: Syncing stream issues 0:00:03.654711 Syncing stream projects 0:00:00.028575 2022-08-17 15:58:39 source > Finished syncing SourceJira 2022-08-17 15:58:40 destination > 2022-08-17 15:58:40 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2022-08-17 15:58:40 destination > 2022-08-17 15:58:40 INFO i.a.i.d.b.BufferedStreamConsumer(close):170 - executing on success close procedure. 2022-08-17 15:58:40 destination > 2022-08-17 15:58:40 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):84 - Flushing jira_info_issues: 7 records (143 KB) 2022-08-17 15:58:40 destination > 2022-08-17 15:58:40 INFO i.a.i.d.j.c.s.S3StreamCopier(prepareStagingFile):95 - S3 upload part size: 10 MB 2022-08-17 15:58:40 destination > 2022-08-17 15:58:40 INFO i.a.i.d.s.c.S3CsvWriter():58 - Full S3 path for stream 'jira_info_issues': s3://spark-prd-etl/google/analytics/jira_info_issues/2022_08_17_1660751888009_05fb2fed-f653-40c8-a22d-9b3b5414b8ce.csv 2022-08-17 15:58:40 destination > 2022-08-17 15:58:40 INFO i.a.i.d.s.u.StreamTransferManagerHelper(getDefault):55 - PartSize arg is set to 10 MB 2022-08-17 15:58:41 destination > 2022-08-17 15:58:41 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to spark-prd-etl/google/analytics/jira_info_issues/2022_08_17_1660751888009_05fb2fed-f653-40c8-a22d-9b3b5414b8ce.csv with full ID MsPopGMXbE6TSpp4TUZ36qldTUwENu5Ts3K.Ccxe9iienAitCnITB4avo_pz22UZ.Md4kGoWWeCPlxKYgsog7sS7UIneNQUsGuI_S4MxZOHQkoEbFv3LMJol9_Ri.lyu 2022-08-17 15:58:41 destination > 2022-08-17 15:58:41 INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):84 - Flushing jira_info_projects: 13 records (143 KB) 2022-08-17 15:58:41 destination > 2022-08-17 15:58:41 INFO i.a.i.d.j.c.s.S3StreamCopier(prepareStagingFile):95 - S3 upload part size: 10 MB 2022-08-17 15:58:41 destination > 2022-08-17 15:58:41 INFO i.a.i.d.s.c.S3CsvWriter():58 - Full S3 path for stream 'jira_info_projects': s3://spark-prd-etl/google/analytics/jira_info_projects/2022_08_17_1660751888011_04644809-3f64-4961-8a20-6d5b6588fb44.csv 2022-08-17 15:58:41 destination > 2022-08-17 15:58:41 INFO i.a.i.d.s.u.StreamTransferManagerHelper(getDefault):55 - PartSize arg is set to 10 MB 2022-08-17 15:58:41 destination > 2022-08-17 15:58:41 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to spark-prd-etl/google/analytics/jira_info_projects/2022_08_17_1660751888011_04644809-3f64-4961-8a20-6d5b6588fb44.csv with full ID 1P3QpZKcm69s9h2J2EnGUB5zfLWY9PRUqcfSycv9koOsknWKjgA_IeTbjBer3FyjLdFL4_ZmXOFtBLOizRoMeE4uGjWTPx8PKtYcrjzSalDRS65qGNk_BNxjIUDaQczu 2022-08-17 15:58:41 destination > 2022-08-17 15:58:41 INFO i.a.i.d.s.w.BaseS3Writer(close):113 - Uploading remaining data for stream 'jira_info_issues'. 2022-08-17 15:58:41 destination > 2022-08-17 15:58:41 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-08-17 15:58:41 destination > 2022-08-17 15:58:41 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-08-17 15:58:41 destination > 2022-08-17 15:58:41 WARN a.m.s.MultiPartOutputStream(close):160 - [MultipartOutputStream for parts 1 - 10000] is already closed 2022-08-17 15:58:41 destination > 2022-08-17 15:58:41 INFO a.m.s.StreamTransferManager(complete):367 - [Manager uploading to spark-prd-etl/google/analytics/jira_info_issues/2022_08_17_1660751888009_05fb2fed-f653-40c8-a22d-9b3b5414b8ce.csv with id MsPopGMXb...l9_Ri.lyu]: Uploading leftover stream [Part number 1 containing 0.04 MB] 2022-08-17 15:58:41 destination > 2022-08-17 15:58:41 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to spark-prd-etl/google/analytics/jira_info_issues/2022_08_17_1660751888009_05fb2fed-f653-40c8-a22d-9b3b5414b8ce.csv with id MsPopGMXb...l9_Ri.lyu]: Finished uploading [Part number 1 containing 0.04 MB] 2022-08-17 15:58:42 destination > 2022-08-17 15:58:42 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to spark-prd-etl/google/analytics/jira_info_issues/2022_08_17_1660751888009_05fb2fed-f653-40c8-a22d-9b3b5414b8ce.csv with id MsPopGMXb...l9_Ri.lyu]: Completed 2022-08-17 15:58:42 destination > 2022-08-17 15:58:42 INFO i.a.i.d.s.w.BaseS3Writer(close):115 - Upload completed for stream 'jira_info_issues'. 2022-08-17 15:58:42 destination > 2022-08-17 15:58:42 INFO i.a.i.d.j.c.s.S3StreamCopier(createDestinationSchema):152 - Creating schema in destination if it doesn't exist: wine_stg 2022-08-17 15:58:43 destination > 2022-08-17 15:58:43 INFO i.a.i.d.j.c.s.S3StreamCopier(createTemporaryTable):158 - Preparing tmp table in destination for stream: jira_info_issues, schema: wine_stg, tmp table name: _airbyte_tmp_wkm_jira_info_issues. 2022-08-17 15:58:44 destination > 2022-08-17 15:58:44 INFO i.a.i.d.r.RedshiftStreamCopier(copyStagingFileToTemporaryTable):85 - Starting copy to tmp table: _airbyte_tmp_wkm_jira_info_issues in destination for stream: jira_info_issues, schema: wine_stg, . 2022-08-17 15:58:46 destination > 2022-08-17 15:58:46 INFO i.a.i.d.r.RedshiftStreamCopier(copyStagingFileToTemporaryTable):89 - Copy to tmp table _airbyte_tmp_wkm_jira_info_issues in destination for stream jira_info_issues complete. 2022-08-17 15:58:46 destination > 2022-08-17 15:58:46 INFO i.a.i.d.j.c.s.S3StreamCopier(createDestinationTable):174 - Preparing table _airbyte_raw_jira_info_issues in destination. 2022-08-17 15:58:46 destination > 2022-08-17 15:58:46 INFO i.a.i.d.j.c.s.S3StreamCopier(createDestinationTable):176 - Table _airbyte_tmp_wkm_jira_info_issues in destination prepared. 2022-08-17 15:58:46 destination > 2022-08-17 15:58:46 INFO i.a.i.d.j.c.s.S3StreamCopier(generateMergeStatement):183 - Preparing to merge tmp table _airbyte_tmp_wkm_jira_info_issues to dest table: _airbyte_raw_jira_info_issues, schema: wine_stg, in destination. 2022-08-17 15:58:46 destination > 2022-08-17 15:58:46 INFO i.a.i.d.s.w.BaseS3Writer(close):113 - Uploading remaining data for stream 'jira_info_projects'. 2022-08-17 15:58:46 destination > 2022-08-17 15:58:46 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-08-17 15:58:46 destination > 2022-08-17 15:58:46 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-08-17 15:58:46 destination > 2022-08-17 15:58:46 WARN a.m.s.MultiPartOutputStream(close):160 - [MultipartOutputStream for parts 1 - 10000] is already closed 2022-08-17 15:58:46 destination > 2022-08-17 15:58:46 INFO a.m.s.StreamTransferManager(complete):367 - [Manager uploading to spark-prd-etl/google/analytics/jira_info_projects/2022_08_17_1660751888011_04644809-3f64-4961-8a20-6d5b6588fb44.csv with id 1P3QpZKcm...jIUDaQczu]: Uploading leftover stream [Part number 1 containing 0.01 MB] 2022-08-17 15:58:46 destination > 2022-08-17 15:58:46 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to spark-prd-etl/google/analytics/jira_info_projects/2022_08_17_1660751888011_04644809-3f64-4961-8a20-6d5b6588fb44.csv with id 1P3QpZKcm...jIUDaQczu]: Finished uploading [Part number 1 containing 0.01 MB] 2022-08-17 15:58:46 destination > 2022-08-17 15:58:46 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to spark-prd-etl/google/analytics/jira_info_projects/2022_08_17_1660751888011_04644809-3f64-4961-8a20-6d5b6588fb44.csv with id 1P3QpZKcm...jIUDaQczu]: Completed 2022-08-17 15:58:46 destination > 2022-08-17 15:58:46 INFO i.a.i.d.s.w.BaseS3Writer(close):115 - Upload completed for stream 'jira_info_projects'. 2022-08-17 15:58:46 destination > 2022-08-17 15:58:46 INFO i.a.i.d.j.c.s.S3StreamCopier(createDestinationSchema):152 - Creating schema in destination if it doesn't exist: wine_stg 2022-08-17 15:58:46 destination > 2022-08-17 15:58:46 INFO i.a.i.d.j.c.s.S3StreamCopier(createTemporaryTable):158 - Preparing tmp table in destination for stream: jira_info_projects, schema: wine_stg, tmp table name: _airbyte_tmp_nba_jira_info_projects. 2022-08-17 15:58:47 destination > 2022-08-17 15:58:47 INFO i.a.i.d.r.RedshiftStreamCopier(copyStagingFileToTemporaryTable):85 - Starting copy to tmp table: _airbyte_tmp_nba_jira_info_projects in destination for stream: jira_info_projects, schema: wine_stg, . 2022-08-17 15:58:48 destination > 2022-08-17 15:58:48 INFO i.a.i.d.r.RedshiftStreamCopier(copyStagingFileToTemporaryTable):89 - Copy to tmp table _airbyte_tmp_nba_jira_info_projects in destination for stream jira_info_projects complete. 2022-08-17 15:58:48 destination > 2022-08-17 15:58:48 INFO i.a.i.d.j.c.s.S3StreamCopier(createDestinationTable):174 - Preparing table _airbyte_raw_jira_info_projects in destination. 2022-08-17 15:58:49 destination > 2022-08-17 15:58:49 INFO i.a.i.d.j.c.s.S3StreamCopier(createDestinationTable):176 - Table _airbyte_tmp_nba_jira_info_projects in destination prepared. 2022-08-17 15:58:49 destination > 2022-08-17 15:58:49 INFO i.a.i.d.j.c.s.S3StreamCopier(generateMergeStatement):183 - Preparing to merge tmp table _airbyte_tmp_nba_jira_info_projects to dest table: _airbyte_raw_jira_info_projects, schema: wine_stg, in destination. 2022-08-17 15:58:51 destination > 2022-08-17 15:58:51 INFO i.a.i.d.j.c.s.S3StreamCopier(removeFileAndDropTmpTable):198 - S3 staging file google/analytics/jira_info_issues/2022_08_17_1660751888009_05fb2fed-f653-40c8-a22d-9b3b5414b8ce.csv cleaned. 2022-08-17 15:58:51 destination > 2022-08-17 15:58:51 INFO i.a.i.d.j.c.s.S3StreamCopier(removeFileAndDropTmpTable):202 - Begin cleaning _airbyte_tmp_wkm_jira_info_issues tmp table in destination. 2022-08-17 15:58:52 destination > 2022-08-17 15:58:52 INFO i.a.i.d.j.c.s.S3StreamCopier(removeFileAndDropTmpTable):204 - _airbyte_tmp_wkm_jira_info_issues tmp table in destination cleaned. 2022-08-17 15:58:52 destination > 2022-08-17 15:58:52 INFO i.a.i.d.r.RedshiftStreamCopier(removeFileAndDropTmpTable):105 - Begin cleaning s3 manifest file google/analytics//ca02e31e-5edd-4c51-938f-931b27a2c9e3/wine_stg/16e56d2e-2664-4198-8ba3-625127cd609f.manifest. 2022-08-17 15:58:52 destination > 2022-08-17 15:58:52 INFO i.a.i.d.r.RedshiftStreamCopier(removeFileAndDropTmpTable):109 - S3 manifest file google/analytics//ca02e31e-5edd-4c51-938f-931b27a2c9e3/wine_stg/16e56d2e-2664-4198-8ba3-625127cd609f.manifest cleaned. 2022-08-17 15:58:52 destination > 2022-08-17 15:58:52 INFO i.a.i.d.j.c.s.S3StreamCopier(removeFileAndDropTmpTable):198 - S3 staging file google/analytics/jira_info_projects/2022_08_17_1660751888011_04644809-3f64-4961-8a20-6d5b6588fb44.csv cleaned. 2022-08-17 15:58:52 destination > 2022-08-17 15:58:52 INFO i.a.i.d.j.c.s.S3StreamCopier(removeFileAndDropTmpTable):202 - Begin cleaning _airbyte_tmp_nba_jira_info_projects tmp table in destination. 2022-08-17 15:58:53 destination > 2022-08-17 15:58:53 INFO i.a.i.d.j.c.s.S3StreamCopier(removeFileAndDropTmpTable):204 - _airbyte_tmp_nba_jira_info_projects tmp table in destination cleaned. 2022-08-17 15:58:53 destination > 2022-08-17 15:58:53 INFO i.a.i.d.r.RedshiftStreamCopier(removeFileAndDropTmpTable):105 - Begin cleaning s3 manifest file google/analytics//ca02e31e-5edd-4c51-938f-931b27a2c9e3/wine_stg/af846170-ac45-4284-bd55-6f7a563103ea.manifest. 2022-08-17 15:58:53 destination > 2022-08-17 15:58:53 INFO i.a.i.d.r.RedshiftStreamCopier(removeFileAndDropTmpTable):109 - S3 manifest file google/analytics//ca02e31e-5edd-4c51-938f-931b27a2c9e3/wine_stg/af846170-ac45-4284-bd55-6f7a563103ea.manifest cleaned. 2022-08-17 15:58:53 destination > 2022-08-17 15:58:53 INFO i.a.i.b.IntegrationRunner(runInternal):169 - Completed integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-08-17 15:58:53 destination > 2022-08-17 15:58:53 INFO i.a.i.d.r.RedshiftDestination(main):79 - completed destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-08-17 15:58:32 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):305 - Waiting for init container to be ready before copying files... 2022-08-17 15:58:32 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):318 - Init container present.. 2022-08-17 15:58:33 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):321 - Init container ready.. 2022-08-17 15:58:33 INFO i.a.w.p.KubePodProcess():546 - Copying files... 2022-08-17 15:58:33 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):254 - Uploading file: input_state.json 2022-08-17 15:58:33 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):262 - kubectl cp /tmp/0cb1a7e8-ef1b-4cac-8d80-0c68ffeab154/input_state.json airbyte/source-jira-sync-2917-0-mwxqk:/config/input_state.json -c init 2022-08-17 15:58:33 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - Waiting for kubectl cp to complete 2022-08-17 15:58:34 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):279 - kubectl cp complete, closing process 2022-08-17 15:58:34 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):254 - Uploading file: source_config.json 2022-08-17 15:58:34 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):262 - kubectl cp /tmp/ba0dd473-51d7-4c8f-a731-4e5972ab2b41/source_config.json airbyte/source-jira-sync-2917-0-mwxqk:/config/source_config.json -c init 2022-08-17 15:58:34 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - Waiting for kubectl cp to complete 2022-08-17 15:58:34 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):279 - kubectl cp complete, closing process 2022-08-17 15:58:34 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):254 - Uploading file: source_catalog.json 2022-08-17 15:58:34 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):262 - kubectl cp /tmp/3db1623b-55f5-40d2-b49f-cba5daa38f68/source_catalog.json airbyte/source-jira-sync-2917-0-mwxqk:/config/source_catalog.json -c init 2022-08-17 15:58:34 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - Waiting for kubectl cp to complete 2022-08-17 15:58:34 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):279 - kubectl cp complete, closing process 2022-08-17 15:58:34 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):254 - Uploading file: FINISHED_UPLOADING 2022-08-17 15:58:34 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):262 - kubectl cp /tmp/eef4d73b-a886-452c-81f3-401d9e0fa876/FINISHED_UPLOADING airbyte/source-jira-sync-2917-0-mwxqk:/config/FINISHED_UPLOADING -c init 2022-08-17 15:58:34 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - Waiting for kubectl cp to complete 2022-08-17 15:58:34 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):279 - kubectl cp complete, closing process 2022-08-17 15:58:34 INFO i.a.w.p.KubePodProcess():549 - Waiting until pod is ready... 2022-08-17 15:58:35 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):592 - Setting stdout... 2022-08-17 15:58:35 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$10):604 - Setting stderr... 2022-08-17 15:58:35 INFO i.a.w.p.KubePodProcess():564 - Reading pod IP... 2022-08-17 15:58:35 INFO i.a.w.p.KubePodProcess():566 - Pod IP: 100.65.18.42 2022-08-17 15:58:35 INFO i.a.w.p.KubePodProcess():573 - Using null stdin output stream... 2022-08-17 15:58:35 INFO i.a.w.DefaultReplicationWorker(run):158 - Waiting for source and destination threads to complete. 2022-08-17 15:58:35 INFO i.a.w.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$6):339 - Destination output thread started. 2022-08-17 15:58:35 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):279 - Replication thread started. 2022-08-17 15:58:40 INFO i.a.w.p.KubePodProcess(close):713 - (pod: airbyte / source-jira-sync-2917-0-mwxqk) - Closed all resources for pod 2022-08-17 15:58:40 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):305 - Total records read: 21 (51 KB) 2022-08-17 15:58:40 INFO i.a.w.DefaultReplicationWorker(run):163 - One of source or destination thread complete. Waiting on the other. 2022-08-17 15:58:53 INFO i.a.w.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$6):349 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@13fe2e9c[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@6d0fcdb7[data={"issues":{"updated":"2022-08-17T12:09:57.854000-03:00"}},additionalProperties={}],additionalProperties={}] 2022-08-17 15:58:54 INFO i.a.w.p.KubePodProcess(close):713 - (pod: airbyte / destination-redshift-sync-2917-0-bojjk) - Closed all resources for pod 2022-08-17 15:58:54 INFO i.a.w.DefaultReplicationWorker(run):165 - Source and destination threads complete. 2022-08-17 15:58:54 INFO i.a.w.DefaultReplicationWorker(run):228 - sync summary: io.airbyte.config.ReplicationAttemptSummary@68cd0fe8[status=completed,recordsSynced=20,bytesSynced=53066,startTime=1660751848031,endTime=1660751934382,totalStats=io.airbyte.config.SyncStats@1c2b984c[recordsEmitted=20,bytesEmitted=53066,stateMessagesEmitted=1,recordsCommitted=20],streamStats=[io.airbyte.config.StreamSyncStats@4e595542[streamName=jira_info_projects,stats=io.airbyte.config.SyncStats@40319d43[recordsEmitted=13,bytesEmitted=10060,stateMessagesEmitted=,recordsCommitted=13]], io.airbyte.config.StreamSyncStats@408378e2[streamName=jira_info_issues,stats=io.airbyte.config.SyncStats@aa7146[recordsEmitted=7,bytesEmitted=43006,stateMessagesEmitted=,recordsCommitted=7]]]] 2022-08-17 15:58:54 INFO i.a.w.DefaultReplicationWorker(run):248 - Source output at least one state message 2022-08-17 15:58:54 INFO i.a.w.DefaultReplicationWorker(run):254 - State capture: Updated state to: Optional[io.airbyte.config.State@2aabd7d0[state={"issues":{"updated":"2022-08-17T12:09:57.854000-03:00"}}]] 2022-08-17 15:58:54 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-08-17 15:58:54 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$1):147 - sync summary: io.airbyte.config.StandardSyncOutput@5204d545[standardSyncSummary=io.airbyte.config.StandardSyncSummary@6fffa892[status=completed,recordsSynced=20,bytesSynced=53066,startTime=1660751848031,endTime=1660751934382,totalStats=io.airbyte.config.SyncStats@1c2b984c[recordsEmitted=20,bytesEmitted=53066,stateMessagesEmitted=1,recordsCommitted=20],streamStats=[io.airbyte.config.StreamSyncStats@4e595542[streamName=jira_info_projects,stats=io.airbyte.config.SyncStats@40319d43[recordsEmitted=13,bytesEmitted=10060,stateMessagesEmitted=,recordsCommitted=13]], io.airbyte.config.StreamSyncStats@408378e2[streamName=jira_info_issues,stats=io.airbyte.config.SyncStats@aa7146[recordsEmitted=7,bytesEmitted=43006,stateMessagesEmitted=,recordsCommitted=7]]]],normalizationSummary=,state=io.airbyte.config.State@2aabd7d0[state={"issues":{"updated":"2022-08-17T12:09:57.854000-03:00"}}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@50bd4ac[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@1caf6864[stream=io.airbyte.protocol.models.AirbyteStream@68753849[name=jira_info_issues,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"string","readOnly":true,"description":"The ID of the issue."},"key":{"type":"string","readOnly":true,"description":"The key of the issue."},"self":{"type":"string","format":"uri","readOnly":true,"description":"The URL of the issue details."},"names":{"type":"object","readOnly":true,"description":"The ID and name of each field present on the issue.","additionalProperties":{"type":"string","readOnly":true}},"expand":{"xml":{"attribute":true},"type":"string","readOnly":true,"description":"Expand options that include additional issue details in the response."},"fields":{"type":"object","properties":{"created":{"type":["string","null"],"format":"date-time","description":"This field is not shown in schema / swagger, but exists in records and we use it as cursor fiekd. Updated may be absent. Added to solve the #4341"},"updated":{"type":["string","null"],"format":"date-time","description":"This field is not shown in schema / swagger, but exists in records and we use it as cursor fiekd. Updated may be absent. Added to solve the #4341"}},"additionalProperties":{}},"schema":{"type":"object","readOnly":true,"description":"The schema describing each field present on the issue."},"editmeta":{"readOnly":true,"description":"The metadata for the fields on the issue that can be amended."},"changelog":{"readOnly":true,"description":"Details of changelogs associated with the issue."},"projectId":{"type":"string","readOnly":true,"description":"The ID of the project containing the issue."},"operations":{"readOnly":true,"description":"The operations that can be performed on the issue."},"projectKey":{"type":"string","readOnly":true,"description":"The key of the project containing the issue."},"properties":{"type":"object","readOnly":true,"description":"Details of the issue properties identified in the request.","additionalProperties":{"readOnly":true}},"transitions":{"type":"array","readOnly":true,"description":"The transitions that can be performed on the issue."},"renderedFields":{"type":"object","readOnly":true,"description":"The rendered value of each field present on the issue.","additionalProperties":{"readOnly":true}},"fieldsToInclude":{"type":"object"},"versionedRepresentations":{"type":"object","readOnly":true,"description":"The versions of each field on the issue.","additionalProperties":{"type":"object","readOnly":true,"additionalProperties":{"readOnly":true}}}},"additionalProperties":false},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[fields, updated],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[fields, updated],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@7a5cb6ed[stream=io.airbyte.protocol.models.AirbyteStream@21a9b3be[name=jira_info_projects,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"string","description":"The ID of the project."},"key":{"type":"string","readOnly":true,"description":"The key of the project."},"url":{"type":"string","readOnly":true,"description":"A link to information about this project, such as project documentation."},"lead":{"readOnly":true,"description":"The username of the project lead."},"name":{"type":"string","readOnly":true,"description":"The name of the project."},"self":{"type":"string","format":"uri","readOnly":true,"description":"The URL of the project details."},"uuid":{"type":"string","format":"uuid","readOnly":true,"description":"Unique ID for next-gen projects."},"email":{"type":"string","description":"An email address associated with the project."},"roles":{"type":"object","readOnly":true,"description":"The name and self URL for each role defined in the project. For more information, see [Create project role](#api-rest-api-3-role-post).","additionalProperties":{"type":"string","format":"uri","readOnly":true}},"style":{"enum":["classic","next-gen"],"type":"string","readOnly":true,"description":"The type of the project."},"expand":{"xml":{"attribute":true},"type":"string","readOnly":true,"description":"Expand options that include additional project details in the response."},"deleted":{"type":"boolean","readOnly":true,"description":"Whether the project is marked as deleted."},"insight":{"readOnly":true,"description":"Insights about the project."},"archived":{"type":"boolean","readOnly":true,"description":"Whether the project is archived."},"versions":{"type":"array","readOnly":true,"description":"The versions defined in the project. For more information, see [Create version](#api-rest-api-3-version-post)."},"deletedBy":{"readOnly":true,"description":"The user who marked the project as deleted."},"favourite":{"type":"boolean","description":"Whether the project is selected as a favorite."},"isPrivate":{"type":"boolean","readOnly":true,"description":"Whether the project is private."},"archivedBy":{"readOnly":true,"description":"The user who archived the project."},"avatarUrls":{"readOnly":true,"description":"The URLs of the project's avatars."},"components":{"type":"array","readOnly":true,"description":"List of the components contained in the project."},"issueTypes":{"type":"array","readOnly":true,"description":"List of the issue types available in the project."},"properties":{"type":"object","readOnly":true,"description":"Map of project properties","additionalProperties":{"readOnly":true}},"simplified":{"type":"boolean","readOnly":true,"description":"Whether the project is simplified."},"deletedDate":{"type":"string","format":"date-time","readOnly":true,"description":"The date when the project was marked as deleted."},"description":{"type":"string","readOnly":true,"description":"A brief description of the project."},"permissions":{"readOnly":true,"description":"User permissions on the project"},"archivedDate":{"type":"string","format":"date-time","readOnly":true,"description":"The date when the project was archived."},"assigneeType":{"enum":["PROJECT_LEAD","UNASSIGNED"],"type":"string","readOnly":true,"description":"The default assignee when creating issues for this project."},"projectTypeKey":{"enum":["software","service_desk","business"],"type":"string","readOnly":true,"description":"The [project type](https://confluence.atlassian.com/x/GwiiLQ#Jiraapplicationsoverview-Productfeaturesandprojecttypes) of the project."},"projectCategory":{"readOnly":true,"description":"The category the project belongs to."},"retentionTillDate":{"type":"string","format":"date-time","readOnly":true,"description":"The date when the project is deleted permanently."},"issueTypeHierarchy":{"readOnly":true,"description":"The issue type hierarchy for the project"}},"description":"Details about a project.","additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-08-17 15:58:54 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):235 - Stopping temporal heartbeating... 2022-08-17 15:58:54 INFO i.a.c.p.ConfigRepository(updateConnectionState):775 - Updating connection 50785558-a55b-4e88-abc4-c854347efb71 state: io.airbyte.config.State@1c75347f[state={"issues":{"updated":"2022-08-17T12:09:57.854000-03:00"}}]