2022-04-26 14:45:52 INFO i.a.w.w.WorkerRun(call):49 - Executing worker wrapper. Airbyte version: 0.35.47-alpha 2022-04-26 14:45:52 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/276/0/logs.log 2022-04-26 14:45:52 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.35.47-alpha 2022-04-26 14:45:52 INFO i.a.w.DefaultReplicationWorker(run):103 - start sync worker. job id: 276 attempt id: 0 2022-04-26 14:45:52 INFO i.a.w.DefaultReplicationWorker(run):115 - configured sync modes: {null.ticket_metrics=incremental - append} 2022-04-26 14:45:52 INFO i.a.w.p.a.DefaultAirbyteDestination(start):69 - Running destination... 2022-04-26 14:45:52 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-redshift:0.3.28 exists... 2022-04-26 14:45:52 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-redshift:0.3.28 was found locally. 2022-04-26 14:45:52 INFO i.a.w.p.DockerProcessFactory(create):104 - Creating docker job ID: 276 2022-04-26 14:45:52 INFO i.a.w.p.DockerProcessFactory(create):155 - Preparing command: docker run --rm --init -i -w /data/276/0 --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local airbyte/destination-redshift:0.3.28 write --config destination_config.json --catalog destination_catalog.json 2022-04-26 14:45:52 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-zendesk-support:0.2.6 exists... 2022-04-26 14:45:52 INFO i.a.w.p.DockerProcessFactory(create):104 - Creating docker job ID: 276 2022-04-26 14:45:52 INFO i.a.w.p.DockerProcessFactory(create):155 - Preparing command: docker run --rm --init -i -w /data/276/0 --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local airbyte/source-zendesk-support:0.2.6 read --config source_config.json --catalog source_catalog.json 2022-04-26 14:45:52 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-zendesk-support:0.2.6 was found locally. 2022-04-26 14:45:52 INFO i.a.w.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$6):338 - Destination output thread started. 2022-04-26 14:45:52 INFO i.a.w.DefaultReplicationWorker(run):157 - Waiting for source and destination threads to complete. 2022-04-26 14:45:52 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):278 - Replication thread started. 2022-04-26 14:45:53 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-04-26 14:45:53 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-04-26 14:45:53 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-04-26 14:45:53 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-04-26 14:45:54 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-04-26 14:45:55 source > Starting syncing SourceZendeskSupport 2022-04-26 14:45:55 source > Syncing stream: ticket_metrics 2022-04-26 14:45:55 destination > 2022-04-26 14:45:55 INFO i.a.i.d.r.RedshiftDestination(main):77 - starting destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-04-26 14:45:55 destination > 2022-04-26 14:45:55 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-04-26 14:45:55 destination > 2022-04-26 14:45:55 INFO i.a.i.b.IntegrationRunner(runInternal):121 - Running integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-04-26 14:45:55 destination > 2022-04-26 14:45:55 INFO i.a.i.b.IntegrationRunner(runInternal):122 - Command: WRITE 2022-04-26 14:45:55 destination > 2022-04-26 14:45:55 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-04-26 14:45:56 destination > 2022-04-26 14:45:56 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-04-26 14:45:56 destination > 2022-04-26 14:45:56 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-04-26 14:45:56 destination > 2022-04-26 14:45:56 INFO i.a.i.d.j.c.SwitchingDestination(getConsumer):65 - Using destination type: COPY_S3 2022-04-26 14:45:56 destination > 2022-04-26 14:45:56 INFO i.a.i.d.s.S3DestinationConfig(createS3Client):169 - Creating S3 client... 2022-04-26 14:45:57 destination > 2022-04-26 14:45:57 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):141 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2022-04-26 14:45:58 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 1000 2022-04-26 14:45:58 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 2000 2022-04-26 14:45:59 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 3000 2022-04-26 14:46:00 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 4000 2022-04-26 14:46:01 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 5000 2022-04-26 14:46:02 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 6000 2022-04-26 14:46:03 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 7000 2022-04-26 14:46:03 destination > 2022-04-26 14:46:03 INFO i.a.i.d.b.BufferedStreamConsumer(flushQueueToDestination):181 - Flushing buffer: 26210784 bytes 2022-04-26 14:46:03 destination > 2022-04-26 14:46:03 INFO i.a.i.d.b.BufferedStreamConsumer(lambda$flushQueueToDestination$1):185 - Flushing ticket_metrics: 7206 records 2022-04-26 14:46:03 destination > 2022-04-26 14:46:03 INFO i.a.i.d.j.c.s.S3StreamCopier(prepareStagingFile):95 - S3 upload part size: 10 MB 2022-04-26 14:46:04 destination > 2022-04-26 14:46:04 INFO i.a.i.d.s.c.S3CsvWriter():58 - Full S3 path for stream 'ticket_metrics': s3://bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_5e1d5552-09cc-40fb-9c7b-b782263457c4.csv 2022-04-26 14:46:04 destination > 2022-04-26 14:46:04 INFO i.a.i.d.s.u.S3StreamTransferManagerHelper(getDefault):55 - PartSize arg is set to 10 MB 2022-04-26 14:46:05 destination > 2022-04-26 14:46:05 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_5e1d5552-09cc-40fb-9c7b-b782263457c4.csv with full ID n_SbzvFzZOxyv7TrjSY.j66sXYoTFXMLYA.P138MXaSLaPO6opT3ExUfHre5P9cnX4PPl2EhvybwNfaSF.p8owkRUU1PWs30HLkg4C.rOb5V9QPoC6ueEdhf0MGuNodn 2022-04-26 14:46:07 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 8000 2022-04-26 14:46:07 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 9000 2022-04-26 14:46:09 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 10000 2022-04-26 14:46:10 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 11000 2022-04-26 14:46:11 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 12000 2022-04-26 14:46:12 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 13000 2022-04-26 14:46:13 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 14000 2022-04-26 14:46:14 destination > 2022-04-26 14:46:14 INFO i.a.i.d.b.BufferedStreamConsumer(flushQueueToDestination):181 - Flushing buffer: 26213660 bytes 2022-04-26 14:46:14 destination > 2022-04-26 14:46:14 INFO i.a.i.d.b.BufferedStreamConsumer(lambda$flushQueueToDestination$1):185 - Flushing ticket_metrics: 7170 records 2022-04-26 14:46:14 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 15000 2022-04-26 14:46:16 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 16000 2022-04-26 14:46:20 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 17000 2022-04-26 14:46:22 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 18000 2022-04-26 14:46:23 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 19000 2022-04-26 14:46:24 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 20000 2022-04-26 14:46:26 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 21000 2022-04-26 14:46:27 destination > 2022-04-26 14:46:27 INFO i.a.i.d.b.BufferedStreamConsumer(flushQueueToDestination):181 - Flushing buffer: 26213796 bytes 2022-04-26 14:46:27 destination > 2022-04-26 14:46:27 INFO i.a.i.d.b.BufferedStreamConsumer(lambda$flushQueueToDestination$1):185 - Flushing ticket_metrics: 7166 records 2022-04-26 14:46:28 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 22000 2022-04-26 14:46:29 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 23000 2022-04-26 14:46:30 destination > 2022-04-26 14:46:30 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_5e1d5552-09cc-40fb-9c7b-b782263457c4.csv with id n_SbzvFzZ...f0MGuNodn]: Finished uploading [Part number 1 containing 10.01 MB] 2022-04-26 14:46:31 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 24000 2022-04-26 14:46:32 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 25000 2022-04-26 14:46:34 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 26000 2022-04-26 14:46:34 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 27000 2022-04-26 14:46:35 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 28000 2022-04-26 14:46:36 destination > 2022-04-26 14:46:36 INFO i.a.i.d.b.BufferedStreamConsumer(flushQueueToDestination):181 - Flushing buffer: 26213400 bytes 2022-04-26 14:46:36 destination > 2022-04-26 14:46:36 INFO i.a.i.d.b.BufferedStreamConsumer(lambda$flushQueueToDestination$1):185 - Flushing ticket_metrics: 7158 records 2022-04-26 14:46:36 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 29000 2022-04-26 14:46:37 destination > 2022-04-26 14:46:37 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_5e1d5552-09cc-40fb-9c7b-b782263457c4.csv with id n_SbzvFzZ...f0MGuNodn]: Finished uploading [Part number 2 containing 10.01 MB] 2022-04-26 14:46:37 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 30000 2022-04-26 14:46:38 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 31000 2022-04-26 14:46:39 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 32000 2022-04-26 14:46:40 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 33000 2022-04-26 14:46:41 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 34000 2022-04-26 14:46:42 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 35000 2022-04-26 14:46:42 destination > 2022-04-26 14:46:42 INFO i.a.i.d.b.BufferedStreamConsumer(flushQueueToDestination):181 - Flushing buffer: 26211816 bytes 2022-04-26 14:46:42 destination > 2022-04-26 14:46:42 INFO i.a.i.d.b.BufferedStreamConsumer(lambda$flushQueueToDestination$1):185 - Flushing ticket_metrics: 7164 records 2022-04-26 14:46:42 destination > 2022-04-26 14:46:42 INFO i.a.i.d.j.c.s.S3StreamCopier(prepareStagingFile):95 - S3 upload part size: 10 MB 2022-04-26 14:46:42 destination > 2022-04-26 14:46:42 INFO i.a.i.d.s.c.S3CsvWriter():58 - Full S3 path for stream 'ticket_metrics': s3://bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_01468b8f-d505-4476-a8aa-3657e26a1da2.csv 2022-04-26 14:46:42 destination > 2022-04-26 14:46:42 INFO i.a.i.d.s.u.S3StreamTransferManagerHelper(getDefault):55 - PartSize arg is set to 10 MB 2022-04-26 14:46:43 destination > 2022-04-26 14:46:43 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_01468b8f-d505-4476-a8aa-3657e26a1da2.csv with full ID qMX8DkG_IQF2ogLGFw_mRz3pZXc_88BrmhbO1zsOCjZHIQSZZzv9OomNM6yMNbN3J5DG8ZWfSo.oIKKiLBLbkCiKj0s909qLid9ymeNwnJ5OUnPSiqVJBZIRcpTmSP67 2022-04-26 14:46:43 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 36000 2022-04-26 14:46:43 destination > 2022-04-26 14:46:43 INFO i.a.i.d.s.w.BaseS3Writer(close):113 - Uploading remaining data for stream 'ticket_metrics'. 2022-04-26 14:46:43 destination > 2022-04-26 14:46:43 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-04-26 14:46:43 destination > 2022-04-26 14:46:43 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-04-26 14:46:43 destination > 2022-04-26 14:46:43 WARN a.m.s.MultiPartOutputStream(close):160 - [MultipartOutputStream for parts 1 - 10000] is already closed 2022-04-26 14:46:43 destination > 2022-04-26 14:46:43 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_5e1d5552-09cc-40fb-9c7b-b782263457c4.csv with id n_SbzvFzZ...f0MGuNodn]: Finished uploading [Part number 3 containing 9.17 MB] 2022-04-26 14:46:43 destination > 2022-04-26 14:46:43 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_5e1d5552-09cc-40fb-9c7b-b782263457c4.csv with id n_SbzvFzZ...f0MGuNodn]: Completed 2022-04-26 14:46:43 destination > 2022-04-26 14:46:43 INFO i.a.i.d.s.w.BaseS3Writer(close):115 - Upload completed for stream 'ticket_metrics'. 2022-04-26 14:46:43 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 37000 2022-04-26 14:46:44 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 38000 2022-04-26 14:46:45 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 39000 2022-04-26 14:46:46 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 40000 2022-04-26 14:46:47 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 41000 2022-04-26 14:46:47 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 42000 2022-04-26 14:46:48 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 43000 2022-04-26 14:46:48 destination > 2022-04-26 14:46:48 INFO i.a.i.d.b.BufferedStreamConsumer(flushQueueToDestination):181 - Flushing buffer: 26213940 bytes 2022-04-26 14:46:48 destination > 2022-04-26 14:46:48 INFO i.a.i.d.b.BufferedStreamConsumer(lambda$flushQueueToDestination$1):185 - Flushing ticket_metrics: 7170 records 2022-04-26 14:46:49 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 44000 2022-04-26 14:46:50 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 45000 2022-04-26 14:46:51 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 46000 2022-04-26 14:46:51 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 47000 2022-04-26 14:46:52 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 48000 2022-04-26 14:46:53 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 49000 2022-04-26 14:46:54 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 50000 2022-04-26 14:46:54 destination > 2022-04-26 14:46:54 INFO i.a.i.d.b.BufferedStreamConsumer(flushQueueToDestination):181 - Flushing buffer: 26212804 bytes 2022-04-26 14:46:54 destination > 2022-04-26 14:46:54 INFO i.a.i.d.b.BufferedStreamConsumer(lambda$flushQueueToDestination$1):185 - Flushing ticket_metrics: 7156 records 2022-04-26 14:46:54 destination > 2022-04-26 14:46:54 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_01468b8f-d505-4476-a8aa-3657e26a1da2.csv with id qMX8DkG_I...RcpTmSP67]: Finished uploading [Part number 1 containing 10.01 MB] 2022-04-26 14:46:55 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 51000 2022-04-26 14:46:55 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 52000 2022-04-26 18:43:19 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 53000 2022-04-26 18:43:20 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 54000 2022-04-26 18:43:20 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 55000 2022-04-26 18:43:21 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 56000 2022-04-26 18:43:22 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 57000 2022-04-26 18:43:22 destination > 2022-04-26 18:43:22 INFO i.a.i.d.b.BufferedStreamConsumer(flushQueueToDestination):181 - Flushing buffer: 26210900 bytes 2022-04-26 18:43:22 destination > 2022-04-26 18:43:22 INFO i.a.i.d.b.BufferedStreamConsumer(lambda$flushQueueToDestination$1):185 - Flushing ticket_metrics: 7166 records 2022-04-26 18:43:23 destination > 2022-04-26 18:43:23 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_01468b8f-d505-4476-a8aa-3657e26a1da2.csv with id qMX8DkG_I...RcpTmSP67]: Finished uploading [Part number 2 containing 10.01 MB] 2022-04-26 18:43:23 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 58000 2022-04-26 18:43:24 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 59000 2022-04-26 18:43:24 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 60000 2022-04-26 18:43:25 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 61000 2022-04-26 18:43:26 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 62000 2022-04-26 18:43:27 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 63000 2022-04-26 18:43:28 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 64000 2022-04-26 18:43:28 destination > 2022-04-26 18:43:28 INFO i.a.i.d.b.BufferedStreamConsumer(flushQueueToDestination):181 - Flushing buffer: 26211624 bytes 2022-04-26 18:43:28 destination > 2022-04-26 18:43:28 INFO i.a.i.d.b.BufferedStreamConsumer(lambda$flushQueueToDestination$1):185 - Flushing ticket_metrics: 7160 records 2022-04-26 18:43:28 destination > 2022-04-26 18:43:28 INFO i.a.i.d.j.c.s.S3StreamCopier(prepareStagingFile):95 - S3 upload part size: 10 MB 2022-04-26 18:43:28 destination > 2022-04-26 18:43:28 INFO i.a.i.d.s.c.S3CsvWriter():58 - Full S3 path for stream 'ticket_metrics': s3://bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_60fdf822-5557-477b-9692-921ae1e86c2c.csv 2022-04-26 18:43:28 destination > 2022-04-26 18:43:28 INFO i.a.i.d.s.u.S3StreamTransferManagerHelper(getDefault):55 - PartSize arg is set to 10 MB 2022-04-26 18:43:28 destination > 2022-04-26 18:43:28 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_60fdf822-5557-477b-9692-921ae1e86c2c.csv with full ID BqaoJKBouOkihJhOMXvTK0TeZ3Q_uhIC0ddBIGAcaP1wCpdZ0AwdMbYpVZUoP6cIzkG7SfEFSINDxeRORp.SIUK3eOOIVGwLv5qzv3hDtkaVfUkWtTWrslUeMogOq1m7 2022-04-26 18:43:28 destination > 2022-04-26 18:43:28 INFO i.a.i.d.s.w.BaseS3Writer(close):113 - Uploading remaining data for stream 'ticket_metrics'. 2022-04-26 18:43:28 destination > 2022-04-26 18:43:28 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-04-26 18:43:28 destination > 2022-04-26 18:43:28 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-04-26 18:43:28 destination > 2022-04-26 18:43:28 WARN a.m.s.MultiPartOutputStream(close):160 - [MultipartOutputStream for parts 1 - 10000] is already closed 2022-04-26 18:43:28 destination > 2022-04-26 18:43:28 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_01468b8f-d505-4476-a8aa-3657e26a1da2.csv with id qMX8DkG_I...RcpTmSP67]: Finished uploading [Part number 3 containing 9.16 MB] 2022-04-26 18:43:29 destination > 2022-04-26 18:43:29 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_01468b8f-d505-4476-a8aa-3657e26a1da2.csv with id qMX8DkG_I...RcpTmSP67]: Completed 2022-04-26 18:43:29 destination > 2022-04-26 18:43:29 INFO i.a.i.d.s.w.BaseS3Writer(close):115 - Upload completed for stream 'ticket_metrics'. 2022-04-26 18:43:29 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 65000 2022-04-26 18:43:29 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 66000 2022-04-26 18:43:30 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 67000 2022-04-26 18:43:31 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 68000 2022-04-26 18:43:31 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 69000 2022-04-26 18:43:32 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 70000 2022-04-26 18:43:33 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 71000 2022-04-26 18:43:34 destination > 2022-04-26 18:43:34 INFO i.a.i.d.b.BufferedStreamConsumer(flushQueueToDestination):181 - Flushing buffer: 26214231 bytes 2022-04-26 18:43:34 destination > 2022-04-26 18:43:34 INFO i.a.i.d.b.BufferedStreamConsumer(lambda$flushQueueToDestination$1):185 - Flushing ticket_metrics: 7159 records 2022-04-26 18:43:34 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 72000 2022-04-26 18:43:35 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 73000 2022-04-26 18:43:35 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 74000 2022-04-26 18:43:36 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 75000 2022-04-26 18:43:37 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 76000 2022-04-26 18:43:38 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 77000 2022-04-26 18:43:38 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 78000 2022-04-26 18:43:39 destination > 2022-04-26 18:43:39 INFO i.a.i.d.b.BufferedStreamConsumer(flushQueueToDestination):181 - Flushing buffer: 26211617 bytes 2022-04-26 18:43:39 destination > 2022-04-26 18:43:39 INFO i.a.i.d.b.BufferedStreamConsumer(lambda$flushQueueToDestination$1):185 - Flushing ticket_metrics: 7164 records 2022-04-26 18:43:39 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 79000 2022-04-26 18:43:39 destination > 2022-04-26 18:43:39 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_60fdf822-5557-477b-9692-921ae1e86c2c.csv with id BqaoJKBou...eMogOq1m7]: Finished uploading [Part number 1 containing 10.01 MB] 2022-04-26 18:43:40 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 80000 2022-04-26 18:43:41 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 81000 2022-04-26 18:43:42 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 82000 2022-04-26 18:43:42 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 83000 2022-04-26 18:43:43 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 84000 2022-04-26 18:43:44 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 85000 2022-04-26 18:43:45 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 86000 2022-04-26 18:43:45 destination > 2022-04-26 18:43:45 INFO i.a.i.d.b.BufferedStreamConsumer(flushQueueToDestination):181 - Flushing buffer: 26213278 bytes 2022-04-26 18:43:45 destination > 2022-04-26 18:43:45 INFO i.a.i.d.b.BufferedStreamConsumer(lambda$flushQueueToDestination$1):185 - Flushing ticket_metrics: 7163 records 2022-04-26 18:43:45 destination > 2022-04-26 18:43:45 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_60fdf822-5557-477b-9692-921ae1e86c2c.csv with id BqaoJKBou...eMogOq1m7]: Finished uploading [Part number 2 containing 10.01 MB] 2022-04-26 18:43:45 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 87000 2022-04-26 18:43:46 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 88000 2022-04-26 18:43:47 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 89000 2022-04-26 18:43:48 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 90000 2022-04-26 18:43:48 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 91000 2022-04-26 18:43:49 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 92000 2022-04-26 18:43:50 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 93000 2022-04-26 18:43:50 destination > 2022-04-26 18:43:50 INFO i.a.i.d.b.BufferedStreamConsumer(flushQueueToDestination):181 - Flushing buffer: 26211744 bytes 2022-04-26 18:43:50 destination > 2022-04-26 18:43:50 INFO i.a.i.d.b.BufferedStreamConsumer(lambda$flushQueueToDestination$1):185 - Flushing ticket_metrics: 7156 records 2022-04-26 18:43:50 destination > 2022-04-26 18:43:50 INFO i.a.i.d.j.c.s.S3StreamCopier(prepareStagingFile):95 - S3 upload part size: 10 MB 2022-04-26 18:43:50 destination > 2022-04-26 18:43:50 INFO i.a.i.d.s.c.S3CsvWriter():58 - Full S3 path for stream 'ticket_metrics': s3://bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_280226bd-0476-4be3-a9a2-48c57cc41fa4.csv 2022-04-26 18:43:50 destination > 2022-04-26 18:43:50 INFO i.a.i.d.s.u.S3StreamTransferManagerHelper(getDefault):55 - PartSize arg is set to 10 MB 2022-04-26 18:43:50 destination > 2022-04-26 18:43:50 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_280226bd-0476-4be3-a9a2-48c57cc41fa4.csv with full ID QC7CFmSKcVJppxpflSSrlC7oQyVy4NLUKzVLctF4xz0aqYvKOEJtQkLSyQYEHOXmhiCSNMshNWW3vNdqGFmvRaDs62sF3ZnxdX6JifqKNZ3CMcjLSMYJBmrqphUZLhGI 2022-04-26 18:43:50 destination > 2022-04-26 18:43:50 INFO i.a.i.d.s.w.BaseS3Writer(close):113 - Uploading remaining data for stream 'ticket_metrics'. 2022-04-26 18:43:50 destination > 2022-04-26 18:43:50 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-04-26 18:43:50 destination > 2022-04-26 18:43:50 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-04-26 18:43:50 destination > 2022-04-26 18:43:50 WARN a.m.s.MultiPartOutputStream(close):160 - [MultipartOutputStream for parts 1 - 10000] is already closed 2022-04-26 18:43:50 destination > 2022-04-26 18:43:50 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_60fdf822-5557-477b-9692-921ae1e86c2c.csv with id BqaoJKBou...eMogOq1m7]: Finished uploading [Part number 3 containing 9.15 MB] 2022-04-26 18:43:51 destination > 2022-04-26 18:43:51 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_60fdf822-5557-477b-9692-921ae1e86c2c.csv with id BqaoJKBou...eMogOq1m7]: Completed 2022-04-26 18:43:51 destination > 2022-04-26 18:43:51 INFO i.a.i.d.s.w.BaseS3Writer(close):115 - Upload completed for stream 'ticket_metrics'. 2022-04-26 18:43:51 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 94000 2022-04-26 18:43:52 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 95000 2022-04-26 18:43:52 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 96000 2022-04-26 18:43:53 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 97000 2022-04-26 18:43:54 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 98000 2022-04-26 18:43:55 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 99000 2022-04-26 18:43:56 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):300 - Records read: 100000 2022-04-26 18:43:56 source > Read 100000 records from ticket_metrics stream 2022-04-26 18:43:56 source > Finished syncing ticket_metrics 2022-04-26 18:43:56 source > SourceZendeskSupport runtimes: Syncing stream ticket_metrics 3:58:00.982038 2022-04-26 18:43:56 source > Finished syncing SourceZendeskSupport 2022-04-26 18:43:56 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):304 - Total records read: 100001 2022-04-26 18:43:56 INFO i.a.w.DefaultReplicationWorker(run):162 - One of source or destination thread complete. Waiting on the other. 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 WARN i.a.i.b.IntegrationRunner(watchForOrphanThreads):229 - The main thread is exiting while children non-daemon threads from a connector are still active. 2022-04-26 18:43:56 destination > Ideally, this situation should not happen... 2022-04-26 18:43:56 destination > Please check with maintainers if the connector or library code should safely clean up its threads before quitting instead. 2022-04-26 18:43:56 destination > The main thread is: main (RUNNABLE) 2022-04-26 18:43:56 destination > Thread stacktrace: java.base/java.lang.Thread.getStackTrace(Thread.java:1610) 2022-04-26 18:43:56 destination > at io.airbyte.integrations.base.IntegrationRunner.dumpThread(IntegrationRunner.java:264) 2022-04-26 18:43:56 destination > at io.airbyte.integrations.base.IntegrationRunner.watchForOrphanThreads(IntegrationRunner.java:233) 2022-04-26 18:43:56 destination > at io.airbyte.integrations.base.IntegrationRunner.runConsumer(IntegrationRunner.java:190) 2022-04-26 18:43:56 destination > at io.airbyte.integrations.base.IntegrationRunner.lambda$runInternal$1(IntegrationRunner.java:163) 2022-04-26 18:43:56 destination > at io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:54) 2022-04-26 18:43:56 destination > at io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:38) 2022-04-26 18:43:56 destination > at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:163) 2022-04-26 18:43:56 destination > at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:105) 2022-04-26 18:43:56 destination > at io.airbyte.integrations.destination.redshift.RedshiftDestination.main(RedshiftDestination.java:78) 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 WARN i.a.i.b.IntegrationRunner(watchForOrphanThreads):243 - Active non-daemon thread: pool-5-thread-1 (WAITING) 2022-04-26 18:43:56 destination > Thread stacktrace: java.base@17.0.1/jdk.internal.misc.Unsafe.park(Native Method) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.locks.LockSupport.park(LockSupport.java:341) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(AbstractQueuedSynchronizer.java:506) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ForkJoinPool.unmanagedBlock(ForkJoinPool.java:3463) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ForkJoinPool.managedBlock(ForkJoinPool.java:3434) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1623) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:420) 2022-04-26 18:43:56 destination > at app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:484) 2022-04-26 18:43:56 destination > at app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:474) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 WARN i.a.i.b.IntegrationRunner(watchForOrphanThreads):243 - Active non-daemon thread: pool-5-thread-2 (BLOCKED) 2022-04-26 18:43:56 destination > Thread stacktrace: app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:483) 2022-04-26 18:43:56 destination > at app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:474) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 WARN i.a.i.b.IntegrationRunner(watchForOrphanThreads):243 - Active non-daemon thread: pool-5-thread-3 (BLOCKED) 2022-04-26 18:43:56 destination > Thread stacktrace: app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:483) 2022-04-26 18:43:56 destination > at app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:474) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 WARN i.a.i.b.IntegrationRunner(watchForOrphanThreads):243 - Active non-daemon thread: pool-5-thread-4 (BLOCKED) 2022-04-26 18:43:56 destination > Thread stacktrace: app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:483) 2022-04-26 18:43:56 destination > at app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:474) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 WARN i.a.i.b.IntegrationRunner(watchForOrphanThreads):243 - Active non-daemon thread: pool-5-thread-5 (BLOCKED) 2022-04-26 18:43:56 destination > Thread stacktrace: app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:483) 2022-04-26 18:43:56 destination > at app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:474) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 WARN i.a.i.b.IntegrationRunner(watchForOrphanThreads):243 - Active non-daemon thread: pool-5-thread-6 (BLOCKED) 2022-04-26 18:43:56 destination > Thread stacktrace: app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:483) 2022-04-26 18:43:56 destination > at app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:474) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 WARN i.a.i.b.IntegrationRunner(watchForOrphanThreads):243 - Active non-daemon thread: pool-5-thread-7 (BLOCKED) 2022-04-26 18:43:56 destination > Thread stacktrace: app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:483) 2022-04-26 18:43:56 destination > at app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:474) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 WARN i.a.i.b.IntegrationRunner(watchForOrphanThreads):243 - Active non-daemon thread: pool-5-thread-8 (BLOCKED) 2022-04-26 18:43:56 destination > Thread stacktrace: app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:483) 2022-04-26 18:43:56 destination > at app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:474) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 WARN i.a.i.b.IntegrationRunner(watchForOrphanThreads):243 - Active non-daemon thread: pool-5-thread-9 (BLOCKED) 2022-04-26 18:43:56 destination > Thread stacktrace: app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:483) 2022-04-26 18:43:56 destination > at app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:474) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 WARN i.a.i.b.IntegrationRunner(watchForOrphanThreads):243 - Active non-daemon thread: pool-5-thread-10 (BLOCKED) 2022-04-26 18:43:56 destination > Thread stacktrace: app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:483) 2022-04-26 18:43:56 destination > at app//alex.mojaki.s3upload.StreamTransferManager$UploadTask.call(StreamTransferManager.java:474) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.FutureTask.run(FutureTask.java:264) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) 2022-04-26 18:43:56 destination > at java.base@17.0.1/java.lang.Thread.run(Thread.java:833) 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 INFO i.a.i.d.b.BufferedStreamConsumer(close):217 - executing on success close procedure. 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 INFO i.a.i.d.b.BufferedStreamConsumer(flushQueueToDestination):181 - Flushing buffer: 25102846 bytes 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 INFO i.a.i.d.b.BufferedStreamConsumer(lambda$flushQueueToDestination$1):185 - Flushing ticket_metrics: 6842 records 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 INFO i.a.i.d.s.w.BaseS3Writer(close):113 - Uploading remaining data for stream 'ticket_metrics'. 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 WARN a.m.s.MultiPartOutputStream(close):160 - [MultipartOutputStream for parts 1 - 10000] is already closed 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_280226bd-0476-4be3-a9a2-48c57cc41fa4.csv with id QC7CFmSKc...qphUZLhGI]: Finished uploading [Part number 1 containing 14.28 MB] 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to bi-airbyte-import/zendesk_support/ticket_metrics/2022_04_26_1650984357547_280226bd-0476-4be3-a9a2-48c57cc41fa4.csv with id QC7CFmSKc...qphUZLhGI]: Completed 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 INFO i.a.i.d.s.w.BaseS3Writer(close):115 - Upload completed for stream 'ticket_metrics'. 2022-04-26 18:43:56 destination > 2022-04-26 18:43:56 INFO i.a.i.d.j.c.s.S3StreamCopier(createDestinationSchema):152 - Creating schema in destination if it doesn't exist: cc 2022-04-26 18:43:57 destination > 2022-04-26 18:43:57 INFO i.a.i.d.j.c.s.S3StreamCopier(createTemporaryTable):158 - Preparing tmp table in destination for stream: ticket_metrics, schema: cc, tmp table name: _airbyte_tmp_gvk_ticket_metrics. 2022-04-26 18:43:58 destination > 2022-04-26 18:43:58 INFO i.a.i.d.r.RedshiftStreamCopier(copyStagingFileToTemporaryTable):85 - Starting copy to tmp table: _airbyte_tmp_gvk_ticket_metrics in destination for stream: ticket_metrics, schema: cc, . 2022-04-26 18:44:01 destination > 2022-04-26 18:44:01 INFO i.a.i.d.r.RedshiftStreamCopier(copyStagingFileToTemporaryTable):89 - Copy to tmp table _airbyte_tmp_gvk_ticket_metrics in destination for stream ticket_metrics complete. 2022-04-26 18:44:01 destination > 2022-04-26 18:44:01 INFO i.a.i.d.j.c.s.S3StreamCopier(createDestinationTable):174 - Preparing table _airbyte_raw_ticket_metrics in destination. 2022-04-26 18:44:02 destination > 2022-04-26 18:44:02 INFO i.a.i.d.j.c.s.S3StreamCopier(createDestinationTable):176 - Table _airbyte_tmp_gvk_ticket_metrics in destination prepared. 2022-04-26 18:44:02 destination > 2022-04-26 18:44:02 INFO i.a.i.d.j.c.s.S3StreamCopier(generateMergeStatement):183 - Preparing to merge tmp table _airbyte_tmp_gvk_ticket_metrics to dest table: _airbyte_raw_ticket_metrics, schema: cc, in destination. 2022-04-26 18:44:03 destination > 2022-04-26 18:44:03 INFO i.a.i.d.j.c.s.S3StreamCopier(removeFileAndDropTmpTable):202 - Begin cleaning _airbyte_tmp_gvk_ticket_metrics tmp table in destination. 2022-04-26 18:44:03 destination > 2022-04-26 18:44:03 INFO i.a.i.d.j.c.s.S3StreamCopier(removeFileAndDropTmpTable):204 - _airbyte_tmp_gvk_ticket_metrics tmp table in destination cleaned. 2022-04-26 18:44:03 destination > 2022-04-26 18:44:03 INFO i.a.i.d.r.RedshiftStreamCopier(removeFileAndDropTmpTable):105 - Begin cleaning s3 manifest file zendesk_support/2127b1b8-069e-4ab5-95e3-8d7df6e8ec16/cc/9259c37a-61fe-4cca-9632-3431ed110620.manifest. 2022-04-26 18:44:03 destination > 2022-04-26 18:44:03 INFO i.a.i.d.r.RedshiftStreamCopier(removeFileAndDropTmpTable):109 - S3 manifest file zendesk_support/2127b1b8-069e-4ab5-95e3-8d7df6e8ec16/cc/9259c37a-61fe-4cca-9632-3431ed110620.manifest cleaned. 2022-04-26 18:44:03 INFO i.a.w.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$6):348 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@58ede533[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@562a105e[data={"ticket_metrics":{"updated_at":"2022-04-26T14:51:22Z"}},additionalProperties={}],additionalProperties={}] 2022-04-26 18:44:03 destination > 2022-04-26 18:44:03 INFO i.a.i.b.IntegrationRunner(runInternal):169 - Completed integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-04-26 18:44:03 destination > 2022-04-26 18:44:03 INFO i.a.i.d.r.RedshiftDestination(main):79 - completed destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-04-26 18:44:03 INFO i.a.w.DefaultReplicationWorker(run):164 - Source and destination threads complete. 2022-04-26 18:44:03 INFO i.a.w.DefaultReplicationWorker(run):227 - sync summary: io.airbyte.config.ReplicationAttemptSummary@77e91304[status=completed,recordsSynced=100000,bytesSynced=91478242,startTime=1650984352791,endTime=1650998643971,totalStats=io.airbyte.config.SyncStats@49303244[recordsEmitted=100000,bytesEmitted=91478242,stateMessagesEmitted=1,recordsCommitted=100000],streamStats=[io.airbyte.config.StreamSyncStats@69362551[streamName=ticket_metrics,stats=io.airbyte.config.SyncStats@7f3dda1e[recordsEmitted=100000,bytesEmitted=91478242,stateMessagesEmitted=,recordsCommitted=100000]]]] 2022-04-26 18:44:03 INFO i.a.w.DefaultReplicationWorker(run):247 - Source output at least one state message 2022-04-26 18:44:03 INFO i.a.w.DefaultReplicationWorker(run):253 - State capture: Updated state to: Optional[io.airbyte.config.State@40f387ce[state={"ticket_metrics":{"updated_at":"2022-04-26T14:51:22Z"}}]] 2022-04-26 18:44:03 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-04-26 18:44:03 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$1):147 - sync summary: io.airbyte.config.StandardSyncOutput@4c84df66[standardSyncSummary=io.airbyte.config.StandardSyncSummary@11903e83[status=completed,recordsSynced=100000,bytesSynced=91478242,startTime=1650984352791,endTime=1650998643971,totalStats=io.airbyte.config.SyncStats@49303244[recordsEmitted=100000,bytesEmitted=91478242,stateMessagesEmitted=1,recordsCommitted=100000],streamStats=[io.airbyte.config.StreamSyncStats@69362551[streamName=ticket_metrics,stats=io.airbyte.config.SyncStats@7f3dda1e[recordsEmitted=100000,bytesEmitted=91478242,stateMessagesEmitted=,recordsCommitted=100000]]]],state=io.airbyte.config.State@40f387ce[state={"ticket_metrics":{"updated_at":"2022-04-26T14:51:22Z"}}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@340424ac[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@40d564b0[stream=io.airbyte.protocol.models.AirbyteStream@2a40ec23[name=ticket_metrics,jsonSchema={"type":["null","object"],"properties":{"id":{"type":["null","integer"]},"url":{"type":["null","string"]},"time":{"type":["null","string"]},"type":{"type":["null","string"]},"metric":{"type":["null","string"]},"status":{"type":["null","object"],"properties":{"business":{"type":["null","integer"]},"calendar":{"type":["null","integer"]}}},"reopens":{"type":["null","integer"]},"replies":{"type":["null","integer"]},"solved_at":{"type":["null","string"],"format":"date-time"},"ticket_id":{"type":["null","integer"]},"created_at":{"type":["null","string"],"format":"date-time"},"updated_at":{"type":["null","string"],"format":"date-time"},"assigned_at":{"type":["null","string"],"format":"date-time"},"instance_id":{"type":["null","integer"]},"group_stations":{"type":["null","integer"]},"assignee_stations":{"type":["null","integer"]},"status_updated_at":{"type":["null","string"],"format":"date-time"},"assignee_updated_at":{"type":["null","string"],"format":"date-time"},"requester_updated_at":{"type":["null","string"],"format":"date-time"},"initially_assigned_at":{"type":["null","string"],"format":"date-time"},"reply_time_in_minutes":{"type":["null","object"],"properties":{"business":{"type":["null","integer"]},"calendar":{"type":["null","integer"]}}},"latest_comment_added_at":{"type":["null","string"],"format":"date-time"},"on_hold_time_in_minutes":{"type":["null","object"],"properties":{"business":{"type":["null","integer"]},"calendar":{"type":["null","integer"]}}},"agent_wait_time_in_minutes":{"type":["null","object"],"properties":{"business":{"type":["null","integer"]},"calendar":{"type":["null","integer"]}}},"requester_wait_time_in_minutes":{"type":["null","object"],"properties":{"business":{"type":["null","integer"]},"calendar":{"type":["null","integer"]}}},"full_resolution_time_in_minutes":{"type":["null","object"],"properties":{"business":{"type":["null","integer"]},"calendar":{"type":["null","integer"]}}},"first_resolution_time_in_minutes":{"type":["null","object"],"properties":{"business":{"type":["null","integer"]},"calendar":{"type":["null","integer"]}}}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[updated_at],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[updated_at],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-04-26 18:44:03 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):235 - Stopping temporal heartbeating... 2022-04-26 18:44:04 INFO i.a.c.p.ConfigRepository(updateConnectionState):594 - Updating connection 30a707c0-fd59-45a1-993b-973246a10f3b state: io.airbyte.config.State@449bd8d4[state={"ticket_metrics":{"updated_at":"2022-04-26T14:51:22Z"}}] 2022-04-26 18:44:04 INFO i.a.n.SlackNotificationClient(notify):89 - Successful notification (200): ok 2022-04-26 18:44:04 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. errors: $.access_token: is missing but it is required, $.credentials: must be a constant value oauth2.0