2022-10-31 05:11:51 INFO i.a.w.w.WorkerRun(call):49 - Executing worker wrapper. Airbyte version: 0.35.31-alpha 2022-10-31 05:11:51 INFO i.a.w.t.TemporalAttemptExecution(get):107 - Cloud storage job log path: /workspace/5892/2/logs.log 2022-10-31 05:11:54 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-10-31 05:12:49 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. errors: $.access_token: is missing but it is required, $.client_id: is missing but it is required, $.client_secret: is missing but it is required, $.option_title: must be a constant value Default OAuth2.0 authorization 2022-10-31 05:11:51 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.35.31-alpha 2022-10-31 05:11:51 INFO i.a.w.DefaultReplicationWorker(run):103 - start sync worker. job id: 5892 attempt id: 2 2022-10-31 05:11:51 INFO i.a.w.DefaultReplicationWorker(run):115 - configured sync modes: {null.channel_messages=full_refresh - append} 2022-10-31 05:11:51 INFO i.a.w.p.a.DefaultAirbyteDestination(start):69 - Running destination... 2022-10-31 05:11:51 INFO i.a.w.p.KubeProcessFactory(create):111 - Attempting to start pod = destination-s3-sync-5892-2-ufzkq 2022-10-31 05:11:51 INFO i.a.w.p.KubeProcessFactory(create):114 - destination-s3-sync-5892-2-ufzkq stdoutLocalPort = 9024 2022-10-31 05:11:51 INFO i.a.w.p.KubeProcessFactory(create):117 - destination-s3-sync-5892-2-ufzkq stderrLocalPort = 9025 2022-10-31 05:11:51 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):521 - Creating stdout socket server... 2022-10-31 05:11:51 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):532 - Creating stderr socket server... 2022-10-31 05:11:51 INFO i.a.w.p.KubePodProcess():480 - Creating pod... 2022-10-31 05:11:51 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):290 - Waiting for init container to be ready before copying files... 2022-10-31 05:11:52 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):293 - Init container present.. 2022-10-31 05:11:52 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):296 - Init container ready.. 2022-10-31 05:11:52 INFO i.a.w.p.KubePodProcess():485 - Copying files... 2022-10-31 05:11:52 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):240 - Uploading file: destination_config.json 2022-10-31 05:11:52 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):248 - kubectl cp /tmp/49ee7b8f-f380-413f-8b35-d49123c42be7/destination_config.json dev/destination-s3-sync-5892-2-ufzkq:/config/destination_config.json -c init 2022-10-31 05:11:52 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):251 - Waiting for kubectl cp to complete 2022-10-31 05:11:53 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp complete, closing process 2022-10-31 05:11:53 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):240 - Uploading file: destination_catalog.json 2022-10-31 05:11:53 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):248 - kubectl cp /tmp/e2dc90f5-2b07-40ef-b9fb-bd0067997dc7/destination_catalog.json dev/destination-s3-sync-5892-2-ufzkq:/config/destination_catalog.json -c init 2022-10-31 05:11:53 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):251 - Waiting for kubectl cp to complete 2022-10-31 05:11:53 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp complete, closing process 2022-10-31 05:11:53 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):240 - Uploading file: FINISHED_UPLOADING 2022-10-31 05:11:53 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):248 - kubectl cp /tmp/6755ecae-fb2d-4156-a6c4-b33cbd8db666/FINISHED_UPLOADING dev/destination-s3-sync-5892-2-ufzkq:/config/FINISHED_UPLOADING -c init 2022-10-31 05:11:53 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):251 - Waiting for kubectl cp to complete 2022-10-31 05:11:53 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp complete, closing process 2022-10-31 05:11:53 INFO i.a.w.p.KubePodProcess():488 - Waiting until pod is ready... 2022-10-31 05:11:54 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):523 - Setting stdout... 2022-10-31 05:11:54 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):534 - Setting stderr... 2022-10-31 05:11:54 INFO i.a.w.p.KubePodProcess():502 - Reading pod IP... 2022-10-31 05:11:54 INFO i.a.w.p.KubePodProcess():504 - Pod IP: 15.0.4.225 2022-10-31 05:11:54 INFO i.a.w.p.KubePodProcess():507 - Creating stdin socket... 2022-10-31 05:11:54 INFO i.a.w.p.KubeProcessFactory(create):111 - Attempting to start pod = source-slack-sync-5892-2-khclz 2022-10-31 05:11:54 INFO i.a.w.p.KubeProcessFactory(create):114 - source-slack-sync-5892-2-khclz stdoutLocalPort = 9002 2022-10-31 05:11:54 INFO i.a.w.p.KubeProcessFactory(create):117 - source-slack-sync-5892-2-khclz stderrLocalPort = 9003 2022-10-31 05:11:54 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):521 - Creating stdout socket server... 2022-10-31 05:11:54 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):532 - Creating stderr socket server... 2022-10-31 05:11:54 INFO i.a.w.p.KubePodProcess():480 - Creating pod... 2022-10-31 05:11:54 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):290 - Waiting for init container to be ready before copying files... 2022-10-31 05:11:55 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):293 - Init container present.. 2022-10-31 05:11:57 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):296 - Init container ready.. 2022-10-31 05:11:57 INFO i.a.w.p.KubePodProcess():485 - Copying files... 2022-10-31 05:11:57 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):240 - Uploading file: source_config.json 2022-10-31 05:11:57 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):248 - kubectl cp /tmp/ea9c370b-52e0-4725-9d6c-64829d645b68/source_config.json dev/source-slack-sync-5892-2-khclz:/config/source_config.json -c init 2022-10-31 05:11:57 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):251 - Waiting for kubectl cp to complete 2022-10-31 05:11:57 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp complete, closing process 2022-10-31 05:11:57 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):240 - Uploading file: source_catalog.json 2022-10-31 05:11:57 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):248 - kubectl cp /tmp/401eb8aa-f9c5-4534-bd39-7948e37aa5a9/source_catalog.json dev/source-slack-sync-5892-2-khclz:/config/source_catalog.json -c init 2022-10-31 05:11:57 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):251 - Waiting for kubectl cp to complete 2022-10-31 05:11:57 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp complete, closing process 2022-10-31 05:11:57 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):240 - Uploading file: FINISHED_UPLOADING 2022-10-31 05:11:57 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):248 - kubectl cp /tmp/29a95260-657f-4e1a-acb0-c97f076ce53d/FINISHED_UPLOADING dev/source-slack-sync-5892-2-khclz:/config/FINISHED_UPLOADING -c init 2022-10-31 05:11:57 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):251 - Waiting for kubectl cp to complete 2022-10-31 05:11:57 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):265 - kubectl cp complete, closing process 2022-10-31 05:11:57 INFO i.a.w.p.KubePodProcess():488 - Waiting until pod is ready... 2022-10-31 05:11:58 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):523 - Setting stdout... 2022-10-31 05:11:58 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):534 - Setting stderr... 2022-10-31 05:11:59 INFO i.a.w.p.KubePodProcess():502 - Reading pod IP... 2022-10-31 05:11:59 INFO i.a.w.p.KubePodProcess():504 - Pod IP: 15.0.4.53 2022-10-31 05:11:59 INFO i.a.w.p.KubePodProcess():511 - Using null stdin output stream... 2022-10-31 05:11:59 INFO i.a.w.DefaultReplicationWorker(run):157 - Waiting for source and destination threads to complete. 2022-10-31 05:11:59 INFO i.a.w.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$6):338 - Destination output thread started. 2022-10-31 05:11:59 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):278 - Replication thread started. 2022-10-31 05:12:48 INFO i.a.w.p.KubePodProcess(getReturnCode):696 - Exit code for pod destination-s3-sync-5892-2-ufzkq is 1 2022-10-31 05:12:48 INFO i.a.w.p.KubePodProcess(exitValue):711 - Closed all resources for pod destination-s3-sync-5892-2-ufzkq 2022-10-31 05:12:48 INFO i.a.w.p.KubePodProcess(exitValue):711 - Closed all resources for pod destination-s3-sync-5892-2-ufzkq 2022-10-31 05:12:48 INFO i.a.w.p.KubePodProcess(exitValue):711 - Closed all resources for pod destination-s3-sync-5892-2-ufzkq 2022-10-31 05:12:48 INFO i.a.w.p.KubePodProcess(exitValue):711 - Closed all resources for pod destination-s3-sync-5892-2-ufzkq 2022-10-31 05:12:49 INFO i.a.w.p.KubePodProcess(getReturnCode):696 - Exit code for pod source-slack-sync-5892-2-khclz is 0 2022-10-31 05:12:49 INFO i.a.w.p.KubePodProcess(exitValue):711 - Closed all resources for pod source-slack-sync-5892-2-khclz 2022-10-31 05:12:49 INFO i.a.w.p.KubePodProcess(exitValue):711 - Closed all resources for pod source-slack-sync-5892-2-khclz 2022-10-31 05:12:49 INFO i.a.w.p.KubePodProcess(exitValue):711 - Closed all resources for pod source-slack-sync-5892-2-khclz 2022-10-31 05:12:49 INFO i.a.w.p.KubePodProcess(exitValue):711 - Closed all resources for pod source-slack-sync-5892-2-khclz 2022-10-31 05:12:49 INFO i.a.w.p.KubePodProcess(exitValue):711 - Closed all resources for pod source-slack-sync-5892-2-khclz 2022-10-31 05:12:49 ERROR i.a.w.DefaultReplicationWorker(run):168 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process message delivery failed at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:161) ~[io.airbyte-airbyte-workers-0.35.31-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:56) ~[io.airbyte-airbyte-workers-0.35.31-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.35.31-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Suppressed: java.net.SocketException: Socket closed at sun.nio.ch.NioSocketImpl.ensureOpenAndConnected(NioSocketImpl.java:165) ~[?:?] at sun.nio.ch.NioSocketImpl.beginWrite(NioSocketImpl.java:366) ~[?:?] at sun.nio.ch.NioSocketImpl.implWrite(NioSocketImpl.java:411) ~[?:?] at sun.nio.ch.NioSocketImpl.write(NioSocketImpl.java:440) ~[?:?] at sun.nio.ch.NioSocketImpl$2.write(NioSocketImpl.java:826) ~[?:?] at java.net.Socket$SocketOutputStream.write(Socket.java:1035) ~[?:?] at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:234) ~[?:?] at sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:313) ~[?:?] at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:318) ~[?:?] at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:160) ~[?:?] at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:248) ~[?:?] at java.io.BufferedWriter.flush(BufferedWriter.java:257) ~[?:?] at io.airbyte.workers.protocols.airbyte.DefaultAirbyteDestination.notifyEndOfStream(DefaultAirbyteDestination.java:98) ~[io.airbyte-airbyte-workers-0.35.31-alpha.jar:?] at io.airbyte.workers.protocols.airbyte.DefaultAirbyteDestination.close(DefaultAirbyteDestination.java:111) ~[io.airbyte-airbyte-workers-0.35.31-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:125) ~[io.airbyte-airbyte-workers-0.35.31-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:56) ~[io.airbyte-airbyte-workers-0.35.31-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.35.31-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process message delivery failed at io.airbyte.workers.DefaultReplicationWorker.lambda$getReplicationRunnable$5(DefaultReplicationWorker.java:295) ~[io.airbyte-airbyte-workers-0.35.31-alpha.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] ... 1 more Caused by: java.net.SocketException: Broken pipe at sun.nio.ch.NioSocketImpl.implWrite(NioSocketImpl.java:420) ~[?:?] at sun.nio.ch.NioSocketImpl.write(NioSocketImpl.java:440) ~[?:?] at sun.nio.ch.NioSocketImpl$2.write(NioSocketImpl.java:826) ~[?:?] at java.net.Socket$SocketOutputStream.write(Socket.java:1035) ~[?:?] at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:234) ~[?:?] at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:304) ~[?:?] at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:282) ~[?:?] at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:132) ~[?:?] at java.io.OutputStreamWriter.write(OutputStreamWriter.java:205) ~[?:?] at java.io.BufferedWriter.flushBuffer(BufferedWriter.java:120) ~[?:?] at java.io.BufferedWriter.write(BufferedWriter.java:233) ~[?:?] at java.io.Writer.write(Writer.java:249) ~[?:?] at io.airbyte.workers.protocols.airbyte.DefaultAirbyteDestination.accept(DefaultAirbyteDestination.java:90) ~[io.airbyte-airbyte-workers-0.35.31-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.lambda$getReplicationRunnable$5(DefaultReplicationWorker.java:293) ~[io.airbyte-airbyte-workers-0.35.31-alpha.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] ... 1 more 2022-10-31 05:12:49 INFO i.a.w.DefaultReplicationWorker(run):227 - sync summary: io.airbyte.config.ReplicationAttemptSummary@40a78ee1[status=failed,recordsSynced=43,bytesSynced=28547,startTime=1667193111929,endTime=1667193169419,totalStats=io.airbyte.config.SyncStats@5451740b[recordsEmitted=43,bytesEmitted=28547,stateMessagesEmitted=0,recordsCommitted=0],streamStats=[io.airbyte.config.StreamSyncStats@14f52873[streamName=slackstreamtestchannel_messages,stats=io.airbyte.config.SyncStats@4f336275[recordsEmitted=43,bytesEmitted=28547,stateMessagesEmitted=,recordsCommitted=]]]] 2022-10-31 05:12:49 INFO i.a.w.DefaultReplicationWorker(run):249 - Source did not output any state messages 2022-10-31 05:12:49 WARN i.a.w.DefaultReplicationWorker(run):260 - State capture: No state retained. 2022-10-31 05:12:49 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-10-31 05:12:49 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$1):144 - sync summary: io.airbyte.config.StandardSyncOutput@39d7c720[standardSyncSummary=io.airbyte.config.StandardSyncSummary@60f284ac[status=failed,recordsSynced=43,bytesSynced=28547,startTime=1667193111929,endTime=1667193169419,totalStats=io.airbyte.config.SyncStats@5451740b[recordsEmitted=43,bytesEmitted=28547,stateMessagesEmitted=0,recordsCommitted=0],streamStats=[io.airbyte.config.StreamSyncStats@14f52873[streamName=slackstreamtestchannel_messages,stats=io.airbyte.config.SyncStats@4f336275[recordsEmitted=43,bytesEmitted=28547,stateMessagesEmitted=,recordsCommitted=]]]],state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@18695421[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@67aa8562[stream=io.airbyte.protocol.models.AirbyteStream@6043b070[name=slackstreamtestchannel_messages,jsonSchema={"type":["null","object"],"properties":{"ts":{"type":["null","string"]},"name":{"type":["null","string"]},"team":{"type":["null","string"]},"text":{"type":["null","string"]},"type":{"type":["null","string"]},"user":{"type":["null","string"]},"icons":{"type":["null","object"],"properties":{"emoji":{"type":["null","string"]}},"additionalProperties":false},"topic":{"type":["null","string"]},"blocks":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"type":{"type":["null","string"]}},"additionalProperties":true}},"bot_id":{"type":["null","string"]},"upload":{"type":["null","boolean"]},"file_id":{"type":["null","string"]},"inviter":{"type":["null","string"]},"purpose":{"type":["null","string"]},"subtype":{"type":["null","string"]},"file_ids":{"type":["null","array"],"items":{"type":["null","string"]}},"float_ts":{"type":["null","number"]},"is_intro":{"type":["null","boolean"]},"old_name":{"type":["null","string"]},"username":{"type":["null","string"]},"last_read":{"type":["null","string"],"format":"date-time"},"permalink":{"type":["null","string"],"format":"uri"},"pinned_to":{"type":["null","array"],"items":{"type":["null","string"]}},"reactions":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"name":{"type":["null","string"]},"count":{"type":["null","integer"]},"users":{"type":["null","array"],"items":{"type":["null","string"]}}},"additionalProperties":true}},"thread_ts":{"type":["null","string"]},"user_team":{"type":["null","string"]},"channel_id":{"type":["null","string"]},"is_starred":{"type":["null","boolean"]},"subscribed":{"type":["null","boolean"]},"attachments":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"id":{"type":["null","integer"]},"color":{"type":["null","string"]},"title":{"type":["null","string"]},"fallback":{"type":["null","string"]}}}},"bot_profile":{"type":["null","object"],"properties":{"id":{"type":["null","string"]},"name":{"type":["null","string"]},"app_id":{"type":["null","string"]},"deleted":{"type":["null","boolean"]},"team_id":{"type":["null","string"]},"updated":{"type":["null","string"]}},"additionalProperties":false},"reply_count":{"type":["null","integer"]},"reply_users":{"type":["null","array"],"items":{"type":["null","string"]}},"source_team":{"type":["null","string"]},"latest_reply":{"type":["null","string"]},"unread_count":{"type":["null","integer"]},"client_msg_id":{"type":["null","string"]},"display_as_bot":{"type":["null","boolean"]},"parent_user_id":{"type":["null","string"]},"reply_users_count":{"type":["null","integer"]},"is_delayed_message":{"type":["null","boolean"]}},"additionalProperties":false},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[float_ts],sourceDefinedPrimaryKey=[[channel_id], [ts]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[float_ts],destinationSyncMode=append,primaryKey=[[channel_id], [ts]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@14609f30[failureOrigin=destination,failureType=,internalMessage=io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process message delivery failed,externalMessage=Something went wrong within the destination connector,metadata=io.airbyte.config.Metadata@46fa09c1[additionalProperties={attemptNumber=2, jobId=5892}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process message delivery failed at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:833) Caused by: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process message delivery failed at io.airbyte.workers.DefaultReplicationWorker.lambda$getReplicationRunnable$5(DefaultReplicationWorker.java:295) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more Caused by: java.net.SocketException: Broken pipe at java.base/sun.nio.ch.NioSocketImpl.implWrite(NioSocketImpl.java:420) at java.base/sun.nio.ch.NioSocketImpl.write(NioSocketImpl.java:440) at java.base/sun.nio.ch.NioSocketImpl$2.write(NioSocketImpl.java:826) at java.base/java.net.Socket$SocketOutputStream.write(Socket.java:1035) at java.base/sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:234) at java.base/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:304) at java.base/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:282) at java.base/sun.nio.cs.StreamEncoder.write(StreamEncoder.java:132) at java.base/java.io.OutputStreamWriter.write(OutputStreamWriter.java:205) at java.base/java.io.BufferedWriter.flushBuffer(BufferedWriter.java:120) at java.base/java.io.BufferedWriter.write(BufferedWriter.java:233) at java.base/java.io.Writer.write(Writer.java:249) at io.airbyte.workers.protocols.airbyte.DefaultAirbyteDestination.accept(DefaultAirbyteDestination.java:90) at io.airbyte.workers.DefaultReplicationWorker.lambda$getReplicationRunnable$5(DefaultReplicationWorker.java:293) ... 4 more ,retryable=,timestamp=1667193139362], io.airbyte.config.FailureReason@75c815e9[failureOrigin=destination,failureType=,internalMessage=io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1,externalMessage=Something went wrong within the destination connector,metadata=io.airbyte.config.Metadata@8f5fb10[additionalProperties={attemptNumber=2, jobId=5892}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1 at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:833) Caused by: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1 at io.airbyte.workers.DefaultReplicationWorker.lambda$getDestinationOutputRunnable$6(DefaultReplicationWorker.java:353) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more ,retryable=,timestamp=1667193168688]]] 2022-10-31 05:12:49 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):235 - Stopping temporal heartbeating... 2022-10-31 05:11:54 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-10-31 05:11:54 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-10-31 05:11:54 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-10-31 05:11:54 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-10-31 05:11:59 destination > 2022-10-31 05:11:55 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-10-31 05:11:59 destination > 2022-10-31 05:11:55 INFO i.a.i.b.IntegrationRunner(runInternal):105 - Running integration: io.airbyte.integrations.destination.s3.S3Destination 2022-10-31 05:11:59 destination > 2022-10-31 05:11:55 INFO i.a.i.b.IntegrationRunner(runInternal):106 - Command: WRITE 2022-10-31 05:11:59 destination > 2022-10-31 05:11:55 INFO i.a.i.b.IntegrationRunner(runInternal):107 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-10-31 05:11:59 source > Starting syncing SourceSlack 2022-10-31 05:11:59 destination > 2022-10-31 05:11:55 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-31 05:11:59 destination > 2022-10-31 05:11:55 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-31 05:11:59 destination > 2022-10-31 05:11:55 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"Avro","part_size_mb":5,"compression_codec":{"codec":"no compression"}} 2022-10-31 05:11:59 destination > 2022-10-31 05:11:56 INFO i.a.i.d.s.w.ProductionWriterFactory(create):37 - Json schema for stream slackstreamtestchannel_messages: {"type":["null","object"],"properties":{"ts":{"type":["null","string"]},"name":{"type":["null","string"]},"team":{"type":["null","string"]},"text":{"type":["null","string"]},"type":{"type":["null","string"]},"user":{"type":["null","string"]},"icons":{"type":["null","object"],"properties":{"emoji":{"type":["null","string"]}},"additionalProperties":false},"topic":{"type":["null","string"]},"blocks":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"type":{"type":["null","string"]}},"additionalProperties":true}},"bot_id":{"type":["null","string"]},"upload":{"type":["null","boolean"]},"file_id":{"type":["null","string"]},"inviter":{"type":["null","string"]},"purpose":{"type":["null","string"]},"subtype":{"type":["null","string"]},"file_ids":{"type":["null","array"],"items":{"type":["null","string"]}},"float_ts":{"type":["null","number"]},"is_intro":{"type":["null","boolean"]},"old_name":{"type":["null","string"]},"username":{"type":["null","string"]},"last_read":{"type":["null","string"],"format":"date-time"},"permalink":{"type":["null","string"],"format":"uri"},"pinned_to":{"type":["null","array"],"items":{"type":["null","string"]}},"reactions":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"name":{"type":["null","string"]},"count":{"type":["null","integer"]},"users":{"type":["null","array"],"items":{"type":["null","string"]}}},"additionalProperties":true}},"thread_ts":{"type":["null","string"]},"user_team":{"type":["null","string"]},"channel_id":{"type":["null","string"]},"is_starred":{"type":["null","boolean"]},"subscribed":{"type":["null","boolean"]},"attachments":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"id":{"type":["null","integer"]},"color":{"type":["null","string"]},"title":{"type":["null","string"]},"fallback":{"type":["null","string"]}}}},"bot_profile":{"type":["null","object"],"properties":{"id":{"type":["null","string"]},"name":{"type":["null","string"]},"app_id":{"type":["null","string"]},"deleted":{"type":["null","boolean"]},"team_id":{"type":["null","string"]},"updated":{"type":["null","string"]}},"additionalProperties":false},"reply_count":{"type":["null","integer"]},"reply_users":{"type":["null","array"],"items":{"type":["null","string"]}},"source_team":{"type":["null","string"]},"latest_reply":{"type":["null","string"]},"unread_count":{"type":["null","integer"]},"client_msg_id":{"type":["null","string"]},"display_as_bot":{"type":["null","boolean"]},"parent_user_id":{"type":["null","string"]},"reply_users_count":{"type":["null","integer"]},"is_delayed_message":{"type":["null","boolean"]}},"additionalProperties":false} 2022-10-31 05:11:59 source > joining Slack channels 2022-10-31 05:11:59 destination > 2022-10-31 05:11:56 WARN i.a.i.d.s.a.JsonToAvroSchemaConverter(getAvroSchema):128 - Schema name "blocks.items" contains illegal character(s) and is standardized to "blocks_items" 2022-10-31 05:11:59 destination > 2022-10-31 05:11:56 WARN i.a.i.d.s.a.JsonToAvroSchemaConverter(getAvroSchema):128 - Schema name "reactions.items" contains illegal character(s) and is standardized to "reactions_items" 2022-10-31 05:11:59 source > Successfully joined channel: random 2022-10-31 05:11:59 destination > 2022-10-31 05:11:56 WARN i.a.i.d.s.a.JsonToAvroSchemaConverter(getAvroSchema):128 - Schema name "attachments.items" contains illegal character(s) and is standardized to "attachments_items" 2022-10-31 05:11:59 source > Successfully joined channel: general 2022-10-31 05:11:59 destination > 2022-10-31 05:11:56 INFO i.a.i.d.s.w.ProductionWriterFactory(create):42 - Avro schema for stream slackstreamtestchannel_messages: {"type":"record","name":"slackstreamtestchannel_messages","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"ts","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"team","type":["null","string"],"default":null},{"name":"text","type":["null","string"],"default":null},{"name":"type","type":["null","string"],"default":null},{"name":"user","type":["null","string"],"default":null},{"name":"icons","type":["null",{"type":"record","name":"icons","fields":[{"name":"emoji","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"topic","type":["null","string"],"default":null},{"name":"blocks","type":["null",{"type":"array","items":["null",{"type":"record","name":"blocks_items","doc":"_airbyte_original_name:blocks.items","fields":[{"name":"type","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}]}],"default":null},{"name":"bot_id","type":["null","string"],"default":null},{"name":"upload","type":["null","boolean"],"default":null},{"name":"file_id","type":["null","string"],"default":null},{"name":"inviter","type":["null","string"],"default":null},{"name":"purpose","type":["null","string"],"default":null},{"name":"subtype","type":["null","string"],"default":null},{"name":"file_ids","type":["null",{"type":"array","items":["null","string"]}],"default":null},{"name":"float_ts","type":["null","double"],"default":null},{"name":"is_intro","type":["null","boolean"],"default":null},{"name":"old_name","type":["null","string"],"default":null},{"name":"username","type":["null","string"],"default":null},{"name":"last_read","type":["null",{"type":"long","logicalType":"timestamp-micros"},"string"],"default":null},{"name":"permalink","type":["null","string"],"default":null},{"name":"pinned_to","type":["null",{"type":"array","items":["null","string"]}],"default":null},{"name":"reactions","type":["null",{"type":"array","items":["null",{"type":"record","name":"reactions_items","doc":"_airbyte_original_name:reactions.items","fields":[{"name":"name","type":["null","string"],"default":null},{"name":"count","type":["null","int"],"default":null},{"name":"users","type":["null",{"type":"array","items":["null","string"]}],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}]}],"default":null},{"name":"thread_ts","type":["null","string"],"default":null},{"name":"user_team","type":["null","string"],"default":null},{"name":"channel_id","type":["null","string"],"default":null},{"name":"is_starred","type":["null","boolean"],"default":null},{"name":"subscribed","type":["null","boolean"],"default":null},{"name":"attachments","type":["null",{"type":"array","items":["null",{"type":"record","name":"attachments_items","doc":"_airbyte_original_name:attachments.items","fields":[{"name":"id","type":["null","int"],"default":null},{"name":"color","type":["null","string"],"default":null},{"name":"title","type":["null","string"],"default":null},{"name":"fallback","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}]}],"default":null},{"name":"bot_profile","type":["null",{"type":"record","name":"bot_profile","fields":[{"name":"id","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"app_id","type":["null","string"],"default":null},{"name":"deleted","type":["null","boolean"],"default":null},{"name":"team_id","type":["null","string"],"default":null},{"name":"updated","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"reply_count","type":["null","int"],"default":null},{"name":"reply_users","type":["null",{"type":"array","items":["null","string"]}],"default":null},{"name":"source_team","type":["null","string"],"default":null},{"name":"latest_reply","type":["null","string"],"default":null},{"name":"unread_count","type":["null","int"],"default":null},{"name":"client_msg_id","type":["null","string"],"default":null},{"name":"display_as_bot","type":["null","boolean"],"default":null},{"name":"parent_user_id","type":["null","string"],"default":null},{"name":"reply_users_count","type":["null","int"],"default":null},{"name":"is_delayed_message","type":["null","boolean"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2022-10-31 05:11:59 destination > 2022-10-31 05:11:56 INFO i.a.i.d.s.a.S3AvroWriter():53 - Full S3 path for stream 'slackstreamtestchannel_messages': s3://redshift-dev-s3-bucket/testAutomation/slackstreamtestchannel_messages/2022_10_31_1667193116500_0.avro 2022-10-31 05:11:59 destination > 2022-10-31 05:11:56 INFO i.a.i.d.s.u.S3StreamTransferManagerHelper(getDefault):55 - PartSize arg is set to 5 MB 2022-10-31 05:11:59 source > Successfully joined channel: testing-slack-app 2022-10-31 05:11:59 destination > 2022-10-31 05:11:56 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to redshift-dev-s3-bucket/testAutomation/slackstreamtestchannel_messages/2022_10_31_1667193116500_0.avro with full ID p8EBLbGM8sVKraM_zz0EMuMOYVXgV2NX2xAo6l1kL5TQKdU1LRbCnvva6K3r2ds_ltnv8mqhHLmwdkWRdjXY6etIl9goBFvTvGcycfdMUZB3NJO6x7Bga29JBzizUfoi 2022-10-31 05:11:59 source > Syncing stream: channel_messages 2022-10-31 05:12:18 destination > 2022-10-31 05:12:18 WARN i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):61 - Airbyte message consumer: failed. 2022-10-31 05:12:18 destination > 2022-10-31 05:12:18 WARN i.a.i.d.s.w.BaseS3Writer(close):103 - Failure detected. Aborting upload of stream 'slackstreamtestchannel_messages'... 2022-10-31 05:12:18 destination > 2022-10-31 05:12:18 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-10-31 05:12:18 destination > 2022-10-31 05:12:18 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-10-31 05:12:18 destination > 2022-10-31 05:12:18 WARN a.m.s.MultiPartOutputStream(close):160 - [MultipartOutputStream for parts 1 - 10000] is already closed 2022-10-31 05:12:18 destination > 2022-10-31 05:12:18 INFO a.m.s.StreamTransferManager(abort):470 - [Manager uploading to redshift-dev-s3-bucket/testAutomation/slackstreamtestchannel_messages/2022_10_31_1667193116500_0.avro with id p8EBLbGM8...JBzizUfoi]: Aborted 2022-10-31 05:12:18 destination > 2022-10-31 05:12:18 WARN i.a.i.d.s.w.BaseS3Writer(close):105 - Upload of stream 'slackstreamtestchannel_messages' aborted.