Mongodb to s3 connection failing with same errors

  • Is this your first time deploying Airbyte?: Yes
  • OS Version / Instance: Ubuntu
  • Memory / Disk: Ec2 t3.medium
  • Deployment: Docker
  • Airbyte Version: 0.35.38-alpha
  • Source name/version: Mongodb atlas
  • Destination name/version: Aws s3
  • Step: The issue is happening during sync
  • Description: errors:

2022-04-25 13:44:44 destination > 	at tech.allegro.schema.json2avro.converter.JsonAvroConverter.convertToGenericDataRecord(JsonAvroConverter.java:95)
2022-04-25 13:44:44 destination > 	at io.airbyte.integrations.destination.s3.avro.AvroRecordFactory.getAvroRecord(AvroRecordFactory.java:39)
2022-04-25 13:44:44 destination > 	at io.airbyte.integrations.destination.s3.avro.AvroSerializedBuffer.writeRecord(AvroSerializedBuffer.java:51)
2022-04-25 13:44:44 destination > 	at io.airbyte.integrations.destination.record_buffer.BaseSerializedBuffer.accept(BaseSerializedBuffer.java:92)
2022-04-25 13:44:44 destination > 	at io.airbyte.integrations.destination.record_buffer.SerializedBufferingStrategy.addRecord(SerializedBufferingStrategy.java:69)
2022-04-25 13:44:44 destination > 	at io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer.acceptTracked(BufferedStreamConsumer.java:137)
2022-04-25 13:44:44 destination > 	at io.airbyte.integrations.base.FailureTrackingAirbyteMessageConsumer.accept(FailureTrackingAirbyteMessageConsumer.java:50)
2022-04-25 13:44:44 destination > 	at io.airbyte.integrations.base.IntegrationRunner.consumeWriteStream(IntegrationRunner.java:182)
2022-04-25 13:44:44 destination > 	at io.airbyte.integrations.base.IntegrationRunner.lambda$runConsumer$2(IntegrationRunner.java:191)
2022-04-25 13:44:44 destination > 	at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:105) [io.airbyte.airbyte-integrations.bases-base-java-0.35.64-alpha.jar:?]
2022-04-25 13:44:44 destination > 	at io.airbyte.integrations.base.IntegrationRunner.watchForOrphanThreads(IntegrationRunner.java:220)
2022-04-25 13:44:44 destination > 	at io.airbyte.integrations.base.IntegrationRunner.runConsumer(IntegrationRunner.java:190)
2022-04-25 13:44:44 destination > 	at io.airbyte.integrations.destination.s3.S3Destination.main(S3Destination.java:51) [io.airbyte.airbyte-integrations.connectors-destination-s3-0.35.64-alpha.jar:?]
2022-04-25 13:44:44 destination > 	at io.airbyte.integrations.base.IntegrationRunner.lambda$runInternal$1(IntegrationRunner.java:163)
2022-04-25 13:44:44 destination > 	at io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:54)
2022-04-25 13:44:44 destination > 	at io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:38)
2022-04-25 13:44:44 destination > 	at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:163)
2022-04-25 13:44:44 destination > 	at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:105)
2022-04-25 13:44:44 destination > 	at io.airbyte.integrations.destination.s3.S3Destination.main(S3Destination.java:51)
2022-04-25 13:44:44 destination > 	Suppressed: java.lang.RuntimeException: Exceptions thrown while closing buffers: java.lang.NullPointerException: Cannot invoke "java.io.InputStream.close()" because "this.inputStream" is null
2022-04-25 13:44:44 destination > 		at io.airbyte.integrations.destination.record_buffer.SerializedBufferingStrategy.close(SerializedBufferingStrategy.java:127)
2022-04-25 13:44:44 destination > 		at io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer.close(BufferedStreamConsumer.java:173)
2022-04-25 13:44:44 destination > 		at io.airbyte.integrations.base.FailureTrackingAirbyteMessageConsumer.lambda$close$0(FailureTrackingAirbyteMessageConsumer.java:67)
2022-04-25 13:44:44 destination > 		at io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:54)
2022-04-25 13:44:44 destination > 		at io.airbyte.integrations.base.FailureTrackingAirbyteMessageConsumer.close(FailureTrackingAirbyteMessageConsumer.java:67)
2022-04-25 13:44:44 destination > 		at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:162)
2022-04-25 13:44:44 destination > 		... 2 more
2022-04-25 13:44:44 destination > Caused by: org.apache.avro.AvroTypeException: Could not evaluate union, field organization is expected to be one of these: NULL, STRING. If this is a complex type, check if offending field: organization adheres to schema.
2022-04-25 13:44:44 destination > 	at tech.allegro.schema.json2avro.converter.AvroTypeExceptions.unionException(AvroTypeExceptions.java:28)
2022-04-25 13:44:44 destination > 	at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.readUnion(JsonGenericRecordReader.java:289)
2022-04-25 13:44:44 destination > 	at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.read(JsonGenericRecordReader.java:196)
2022-04-25 13:44:44 destination > 	at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.read(JsonGenericRecordReader.java:170)
2022-04-25 13:44:44 destination > 	at java.base/java.util.LinkedHashMap.forEach(LinkedHashMap.java:721)
2022-04-25 13:44:44 destination > 	at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.readRecord(JsonGenericRecordReader.java:141)
2022-04-25 13:44:44 destination > 	at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.read(JsonGenericRecordReader.java:127)
2022-04-25 13:44:44 destination > 	... 18 more
2022-04-25 13:44:44 source > 2022-04-25 13:44:44 INFO i.a.i.s.r.AbstractDbSource(lambda$read$2):124 - Closing database connection pool.
2022-04-25 13:44:44 source > 2022-04-25 13:44:44 INFO c.m.d.l.SLF4JLogger(info):71 - Cluster closed with id ClusterId{value='6266a5c819fa514a254b048d', description='null'}
2022-04-25 13:44:44 source > 2022-04-25 13:44:44 INFO i.a.i.s.r.AbstractDbSource(lambda$read$2):126 - Closed database connection pool.
2022-04-25 13:44:44 source > 2022-04-25 13:44:44 INFO i.a.i.b.IntegrationRunner(runInternal):154 - Completed integration: io.airbyte.integrations.source.mongodb.MongoDbSource
2022-04-25 13:44:44 source > 2022-04-25 13:44:44 INFO i.a.i.s.m.MongoDbSource(main):66 - completed source: class io.airbyte.integrations.source.mongodb.MongoDbSource
2022-04-25 13:44:44 ERROR i.a.w.DefaultReplicationWorker(run):168 - Sync worker failed.
java.util.concurrent.ExecutionException: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1
	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?]
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?]
	at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:161) ~[io.airbyte-airbyte-workers-0.35.38-alpha.jar:?]
	at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:56) ~[io.airbyte-airbyte-workers-0.35.38-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.35.38-alpha.jar:?]
	at java.lang.Thread.run(Thread.java:833) [?:?]
	Suppressed: java.io.IOException: Stream closed
		at java.lang.ProcessBuilder$NullOutputStream.write(ProcessBuilder.java:445) ~[?:?]
		at java.io.OutputStream.write(OutputStream.java:162) ~[?:?]
		at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:81) ~[?:?]
		at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:142) ~[?:?]
		at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:320) ~[?:?]
		at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:160) ~[?:?]
		at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:248) ~[?:?]
		at java.io.BufferedWriter.flush(BufferedWriter.java:257) ~[?:?]
		at io.airbyte.workers.protocols.airbyte.DefaultAirbyteDestination.notifyEndOfStream(DefaultAirbyteDestination.java:98) ~[io.airbyte-airbyte-workers-0.35.38-alpha.jar:?]
		at io.airbyte.workers.protocols.airbyte.DefaultAirbyteDestination.close(DefaultAirbyteDestination.java:111) ~[io.airbyte-airbyte-workers-0.35.38-alpha.jar:?]
		at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:125) ~[io.airbyte-airbyte-workers-0.35.38-alpha.jar:?]
		at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:56) ~[io.airbyte-airbyte-workers-0.35.38-alpha.jar:?]
		at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.35.38-alpha.jar:?]
		at java.lang.Thread.run(Thread.java:833) [?:?]
Caused by: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1
	at io.airbyte.workers.DefaultReplicationWorker.lambda$getDestinationOutputRunnable$6(DefaultReplicationWorker.java:353) ~[io.airbyte-airbyte-workers-0.35.38-alpha.jar:?]
	at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?]
	... 1 more
2022-04-25 13:44:44 INFO i.a.w.DefaultReplicationWorker(run):227 - sync summary: io.airbyte.config.ReplicationAttemptSummary@41a14e27[status=failed,recordsSynced=114,bytesSynced=76414,startTime=1650894276646,endTime=1650894284747,totalStats=io.airbyte.config.SyncStats@5fc68e04[recordsEmitted=114,bytesEmitted=76414,stateMessagesEmitted=0,recordsCommitted=0],streamStats=[io.airbyte.config.StreamSyncStats@7c2cc76[streamName=graph_meta_datas,stats=io.airbyte.config.SyncStats@525d3b48[recordsEmitted=10,bytesEmitted=8286,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@19468752[streamName=campaigns,stats=io.airbyte.config.SyncStats@721b9cd0[recordsEmitted=1,bytesEmitted=222,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@632b5f99[streamName=instagrams,stats=io.airbyte.config.SyncStats@5897afcf[recordsEmitted=4,bytesEmitted=15201,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@75c6cf98[streamName=organizations,stats=io.airbyte.config.SyncStats@5b1520ec[recordsEmitted=1,bytesEmitted=96,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@62fb6b80[streamName=youtube-channel-infos,stats=io.airbyte.config.SyncStats@7f759c7[recordsEmitted=3,bytesEmitted=10426,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@440efcae[streamName=feedbacks,stats=io.airbyte.config.SyncStats@36eeb683[recordsEmitted=9,bytesEmitted=2891,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@ff07cb5[streamName=platform-data-lynks,stats=io.airbyte.config.SyncStats@32f435ed[recordsEmitted=3,bytesEmitted=1252,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@1ac4491[streamName=platform-tokens,stats=io.airbyte.config.SyncStats@42b5b089[recordsEmitted=52,bytesEmitted=24718,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@4eac79be[streamName=youtube-channel-demographics,stats=io.airbyte.config.SyncStats@5de476db[recordsEmitted=3,bytesEmitted=1530,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@3e0f393a[streamName=youtube-channel-geographics,stats=io.airbyte.config.SyncStats@51d1f78a[recordsEmitted=3,bytesEmitted=2200,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@7c9d0587[streamName=users,stats=io.airbyte.config.SyncStats@2b1e661[recordsEmitted=25,bytesEmitted=9592,stateMessagesEmitted=<null>,recordsCommitted=<null>]]]]
2022-04-25 13:44:44 INFO i.a.w.DefaultReplicationWorker(run):249 - Source did not output any state messages
2022-04-25 13:44:44 WARN i.a.w.DefaultReplicationWorker(run):260 - State capture: No state retained.
2022-04-25 13:44:44 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling...
2022-04-25 13:44:44 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$1):147 - sync summary: io.airbyte.config.StandardSyncOutput@1c29ddc0[standardSyncSummary=io.airbyte.config.StandardSyncSummary@1cd76e61[status=failed,recordsSynced=114,bytesSynced=76414,startTime=1650894276646,endTime=1650894284747,totalStats=io.airbyte.config.SyncStats@5fc68e04[recordsEmitted=114,bytesEmitted=76414,stateMessagesEmitted=0,recordsCommitted=0],streamStats=[io.airbyte.config.StreamSyncStats@7c2cc76[streamName=graph_meta_datas,stats=io.airbyte.config.SyncStats@525d3b48[recordsEmitted=10,bytesEmitted=8286,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@19468752[streamName=campaigns,stats=io.airbyte.config.SyncStats@721b9cd0[recordsEmitted=1,bytesEmitted=222,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@632b5f99[streamName=instagrams,stats=io.airbyte.config.SyncStats@5897afcf[recordsEmitted=4,bytesEmitted=15201,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@75c6cf98[streamName=organizations,stats=io.airbyte.config.SyncStats@5b1520ec[recordsEmitted=1,bytesEmitted=96,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@62fb6b80[streamName=youtube-channel-infos,stats=io.airbyte.config.SyncStats@7f759c7[recordsEmitted=3,bytesEmitted=10426,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@440efcae[streamName=feedbacks,stats=io.airbyte.config.SyncStats@36eeb683[recordsEmitted=9,bytesEmitted=2891,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@ff07cb5[streamName=platform-data-lynks,stats=io.airbyte.config.SyncStats@32f435ed[recordsEmitted=3,bytesEmitted=1252,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@1ac4491[streamName=platform-tokens,stats=io.airbyte.config.SyncStats@42b5b089[recordsEmitted=52,bytesEmitted=24718,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@4eac79be[streamName=youtube-channel-demographics,stats=io.airbyte.config.SyncStats@5de476db[recordsEmitted=3,bytesEmitted=1530,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@3e0f393a[streamName=youtube-channel-geographics,stats=io.airbyte.config.SyncStats@51d1f78a[recordsEmitted=3,bytesEmitted=2200,stateMessagesEmitted=<null>,recordsCommitted=<null>]], io.airbyte.config.StreamSyncStats@7c9d0587[streamName=users,stats=io.airbyte.config.SyncStats@2b1e661[recordsEmitted=25,bytesEmitted=9592,stateMessagesEmitted=<null>,recordsCommitted=<null>]]]],state=<null>,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@64a46957[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@4d9f7b0e[stream=io.airbyte.protocol.models.AirbyteStream@1f8a78a0[name=campaigns,jsonSchema={"type":"object","properties":{"__v":{"type":"number"},"_id":{"type":"string"},"name":{"type":"string"},"hashtags":{"type":"array"},"createdAt":{"type":"string"},"influencers":{"type":"array"},"organization":{"type":"string"},"taggedAccounts":{"type":"array"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=<null>,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=lynksstudio,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@3809b956[stream=io.airbyte.protocol.models.AirbyteStream@7fa081d1[name=feedbacks,jsonSchema={"type":"object","properties":{"__v":{"type":"number"},"_id":{"type":"string"},"uid":{"type":"string"},"name":{"type":"string"},"email":{"type":"string"},"message":{"type":"string"},"createdAt":{"type":"string"},"mobile_no":{"type":"string"},"updatedAt":{"type":"string"},"ip_address":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=<null>,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=lynksstudio,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@49d1c220[stream=io.airbyte.protocol.models.AirbyteStream@5d2fcc2[name=graph_meta_datas,jsonSchema={"type":"object","properties":{"__v":{"type":"number"},"_id":{"type":"string"},"uid":{"type":"string"},"data":{"type":"string"},"insta_id":{"type":"string"},"createdAt":{"type":"string"},"updatedAt":{"type":"string"},"access_token":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=<null>,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=lynksstudio,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@70643627[stream=io.airbyte.protocol.models.AirbyteStream@bb19ff3[name=instagrams,jsonSchema={"type":"object","properties":{"__v":{"type":"number"},"_id":{"type":"string"},"top":{"type":"array"},"igId":{"type":"string"},"stats":{"type":"string"},"basicInfo":{"type":"string"},"createdAt":{"type":"string"},"postReach":{"type":"number"},"updatedAt":{"type":"string"},"totalLikes":{"type":"number"},"demographics":{"type":"string"},"totalComments":{"type":"number"},"postImpression":{"type":"number"},"totalEngagement":{"type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=<null>,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=lynksstudio,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@4cb69c67[stream=io.airbyte.protocol.models.AirbyteStream@5e105ddf[name=organizations,jsonSchema={"type":"object","properties":{"__v":{"type":"number"},"_id":{"type":"string"},"name":{"type":"string"},"joined":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=<null>,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=lynksstudio,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@f948d34[stream=io.airbyte.protocol.models.AirbyteStream@85dc532[name=platform-data-lynks,jsonSchema={"type":"object","properties":{"__v":{"type":"number"},"_id":{"type":"string"},"uid":{"type":"string"},"data":{"type":"string"},"info":{"type":"string"},"createdAt":{"type":"string"},"updatedAt":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=<null>,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=lynksstudio,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@707025fa[stream=io.airbyte.protocol.models.AirbyteStream@2c52608e[name=platform-tokens,jsonSchema={"type":"object","properties":{"__v":{"type":"number"},"_id":{"type":"string"},"uid":{"type":"string"},"youtube":{"type":"string"},"createdAt":{"type":"string"},"updatedAt":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=<null>,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=lynksstudio,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@704b51d[stream=io.airbyte.protocol.models.AirbyteStream@6116849a[name=users,jsonSchema={"type":"object","properties":{"__v":{"type":"number"},"_id":{"type":"string"},"uid":{"type":"string"},"social":{"type":"string"},"createdAt":{"type":"string"},"updatedAt":{"type":"string"},"identities":{"type":"string"},"category_list":{"type":"array"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=<null>,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=lynksstudio,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@103832b7[stream=io.airbyte.protocol.models.AirbyteStream@2fd1662e[name=youtube-channel-demographics,jsonSchema={"type":"object","properties":{"__v":{"type":"number"},"_id":{"type":"string"},"uid":{"type":"string"},"data":{"type":"string"},"createdAt":{"type":"string"},"updatedAt":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=<null>,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=lynksstudio,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@ddf9294[stream=io.airbyte.protocol.models.AirbyteStream@58b8e5e1[name=youtube-channel-geographics,jsonSchema={"type":"object","properties":{"__v":{"type":"number"},"_id":{"type":"string"},"uid":{"type":"string"},"data":{"type":"string"},"createdAt":{"type":"string"},"updatedAt":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=<null>,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=lynksstudio,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@944d9cb[stream=io.airbyte.protocol.models.AirbyteStream@2d003edb[name=youtube-channel-infos,jsonSchema={"type":"object","properties":{"__v":{"type":"number"},"_id":{"type":"string"},"uid":{"type":"string"},"data":{"type":"string"},"createdAt":{"type":"string"},"updatedAt":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=<null>,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=lynksstudio,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@5c3a42dd[failureOrigin=destination,failureType=<null>,internalMessage=io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1,externalMessage=Something went wrong within the destination connector,metadata=io.airbyte.config.Metadata@43b23356[additionalProperties={attemptNumber=0, jobId=9}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1
	at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)
	at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)
	at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)
	at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1
	at io.airbyte.workers.DefaultReplicationWorker.lambda$getDestinationOutputRunnable$6(DefaultReplicationWorker.java:353)
	at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
	... 3 more
,retryable=<null>,timestamp=1650894284653]]]
2022-04-25 13:44:44 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):235 - Stopping temporal heartbeating...
2022-04-25 13:44:44 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):304 - Total records read: 114
2022-04-25 13:44:44 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. 
errors: $.host: is missing but it is required, $.port: is missing but it is required, $.instance: does not have a value in the enumeration [standalone]
2022-04-25 13:44:44 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. 
errors: $.server_addresses: is missing but it is required, $.instance: does not have a value in the enumeration [replica]


Hey @s-bhagwat looks to me like an s3 error but to verify this can you try with a different destination and see if this works?

Hi there from the Community Assistance team.
We’re letting you know about an issue we discovered with the back-end process we use to handle topics and responses on the forum. If you experienced a situation where you posted the last message in a topic that did not receive any further replies, please open a new topic to continue the discussion. In addition, if you’re having a problem and find a closed topic on the subject, go ahead and open a new topic on it and we’ll follow up with you. We apologize for the inconvenience, and appreciate your willingness to work with us to provide a supportive community.