2022-04-06 09:16:48 INFO i.a.w.w.WorkerRun(call):49 - Executing worker wrapper. Airbyte version: 0.35.62-alpha 2022-04-06 09:16:48 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/1/2/logs.log 2022-04-06 09:16:48 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.35.62-alpha 2022-04-06 09:16:48 INFO i.a.w.DefaultReplicationWorker(run):104 - start sync worker. job id: 1 attempt id: 2 2022-04-06 09:16:48 INFO i.a.w.DefaultReplicationWorker(run):116 - configured sync modes: {metapolis.GuestModel=full_refresh - overwrite, metapolis.ClientVersion=full_refresh - overwrite, metapolis.InvitationModel=full_refresh - overwrite, metapolis.PlayerModel=full_refresh - overwrite, metapolis.BuildingModel=full_refresh - overwrite, metapolis.ClientVersionModel=full_refresh - overwrite, metapolis.ServerSettingModel=full_refresh - overwrite, metapolis.OfficeModel=full_refresh - overwrite} 2022-04-06 09:16:48 INFO i.a.w.p.a.DefaultAirbyteDestination(start):69 - Running destination... 2022-04-06 09:16:48 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-s3:0.2.12 exists... 2022-04-06 09:16:48 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-s3:0.2.12 was found locally. 2022-04-06 09:16:48 INFO i.a.w.p.DockerProcessFactory(create):106 - Creating docker job ID: 1 2022-04-06 09:16:48 INFO i.a.w.p.DockerProcessFactory(create):158 - Preparing command: docker run --rm --init -i -w /data/1/2 --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e WORKER_CONNECTOR_IMAGE=airbyte/destination-s3:0.2.12 -e WORKER_JOB_ATTEMPT=2 -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.35.62-alpha -e WORKER_JOB_ID=1 airbyte/destination-s3:0.2.12 write --config destination_config.json --catalog destination_catalog.json 2022-04-06 09:16:48 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-mongodb-v2:dev exists... 2022-04-06 09:16:48 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-mongodb-v2:dev was found locally. 2022-04-06 09:16:48 INFO i.a.w.p.DockerProcessFactory(create):106 - Creating docker job ID: 1 2022-04-06 09:16:48 INFO i.a.w.p.DockerProcessFactory(create):158 - Preparing command: docker run --rm --init -i -w /data/1/2 --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e WORKER_CONNECTOR_IMAGE=airbyte/source-mongodb-v2:dev -e WORKER_JOB_ATTEMPT=2 -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.35.62-alpha -e WORKER_JOB_ID=1 airbyte/source-mongodb-v2:dev read --config source_config.json --catalog source_catalog.json 2022-04-06 09:16:48 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):279 - Replication thread started. 2022-04-06 09:16:48 INFO i.a.w.DefaultReplicationWorker(run):158 - Waiting for source and destination threads to complete. 2022-04-06 09:16:48 INFO i.a.w.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$6):339 - Destination output thread started. 2022-04-06 09:16:48 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-04-06 09:16:48 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-04-06 09:16:48 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-04-06 09:16:48 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-04-06 09:16:48 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 INFO i.a.i.s.m.MongoDbSource(main):65 - starting source: class io.airbyte.integrations.source.mongodb.MongoDbSource 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {read=null, catalog=source_catalog.json, config=source_config.json} 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 INFO i.a.i.b.IntegrationRunner(runInternal):121 - Running integration: io.airbyte.integrations.source.mongodb.MongoDbSource 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 INFO i.a.i.b.IntegrationRunner(runInternal):122 - Command: READ 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='null'} 2022-04-06 09:16:50 destination > 2022-04-06 09:16:50 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-04-06 09:16:50 destination > 2022-04-06 09:16:50 INFO i.a.i.b.IntegrationRunner(runInternal):121 - Running integration: io.airbyte.integrations.destination.s3.S3Destination 2022-04-06 09:16:50 destination > 2022-04-06 09:16:50 INFO i.a.i.b.IntegrationRunner(runInternal):122 - Command: WRITE 2022-04-06 09:16:50 destination > 2022-04-06 09:16:50 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 INFO i.a.i.s.r.CdcStateManager():26 - Initialized CDC state with: null 2022-04-06 09:16:50 destination > 2022-04-06 09:16:50 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-04-06 09:16:50 destination > 2022-04-06 09:16:50 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-04-06 09:16:50 destination > 2022-04-06 09:16:50 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='BuildingModel', namespace='metapolis'}, New Cursor Field: null. Resetting cursor value 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='PlayerModel', namespace='metapolis'}, New Cursor Field: null. Resetting cursor value 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='ClientVersion', namespace='metapolis'}, New Cursor Field: null. Resetting cursor value 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='ClientVersionModel', namespace='metapolis'}, New Cursor Field: null. Resetting cursor value 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='ServerSettingModel', namespace='metapolis'}, New Cursor Field: null. Resetting cursor value 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='OfficeModel', namespace='metapolis'}, New Cursor Field: null. Resetting cursor value 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='InvitationModel', namespace='metapolis'}, New Cursor Field: null. Resetting cursor value 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='GuestModel', namespace='metapolis'}, New Cursor Field: null. Resetting cursor value 2022-04-06 09:16:50 destination > 2022-04-06 09:16:50 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"Parquet","page_size_kb":1024,"block_size_mb":128,"compression_codec":"SNAPPY","dictionary_encoding":true,"max_padding_size_mb":8,"dictionary_page_size_kb":1024} 2022-04-06 09:16:50 destination > 2022-04-06 09:16:50 INFO i.a.i.d.s.S3DestinationConfig(createS3Client):169 - Creating S3 client... 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 INFO c.m.d.l.SLF4JLogger(info):71 - Cluster created with settings {hosts=[metapolis-prod.c3svvjp5iqfn.ap-northeast-1.docdb.amazonaws.com:27017], mode=MULTIPLE, requiredClusterType=REPLICA_SET, serverSelectionTimeout='30000 ms', requiredReplicaSetName='rs0'} 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 INFO c.m.d.l.SLF4JLogger(info):71 - Adding discovered server metapolis-prod.c3svvjp5iqfn.ap-northeast-1.docdb.amazonaws.com:27017 to client view of cluster 2022-04-06 09:16:50 source > 2022-04-06 09:16:50 INFO c.m.d.l.SLF4JLogger(info):71 - No server chosen by com.mongodb.client.internal.MongoClientDelegate$1@62e8f862 from cluster description ClusterDescription{type=REPLICA_SET, connectionMode=MULTIPLE, serverDescriptions=[ServerDescription{address=metapolis-prod.c3svvjp5iqfn.ap-northeast-1.docdb.amazonaws.com:27017, type=UNKNOWN, state=CONNECTING}]}. Waiting for 30000 ms before timing out 2022-04-06 09:16:51 destination > 2022-04-06 09:16:51 INFO i.a.i.d.s.SerializedBufferFactory(getCreateFunction):50 - S3 format config: {"format_type":"Parquet","page_size_kb":1024,"block_size_mb":128,"compression_codec":"SNAPPY","dictionary_encoding":true,"max_padding_size_mb":8,"dictionary_page_size_kb":1024} 2022-04-06 09:16:51 destination > 2022-04-06 09:16:51 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"Parquet","page_size_kb":1024,"block_size_mb":128,"compression_codec":"SNAPPY","dictionary_encoding":true,"max_padding_size_mb":8,"dictionary_page_size_kb":1024} 2022-04-06 09:16:51 destination > 2022-04-06 09:16:51 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):90 - Write config: WriteConfig{streamName=BuildingModel, namespace=metapolis, outputNamespace=metapolis, outputBucketPath=metapolis/BuildingModel/, syncMode=overwrite} 2022-04-06 09:16:51 destination > 2022-04-06 09:16:51 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):90 - Write config: WriteConfig{streamName=ClientVersion, namespace=metapolis, outputNamespace=metapolis, outputBucketPath=metapolis/ClientVersion/, syncMode=overwrite} 2022-04-06 09:16:51 destination > 2022-04-06 09:16:51 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):90 - Write config: WriteConfig{streamName=ClientVersionModel, namespace=metapolis, outputNamespace=metapolis, outputBucketPath=metapolis/ClientVersionModel/, syncMode=overwrite} 2022-04-06 09:16:51 destination > 2022-04-06 09:16:51 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):90 - Write config: WriteConfig{streamName=GuestModel, namespace=metapolis, outputNamespace=metapolis, outputBucketPath=metapolis/GuestModel/, syncMode=overwrite} 2022-04-06 09:16:51 destination > 2022-04-06 09:16:51 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):90 - Write config: WriteConfig{streamName=InvitationModel, namespace=metapolis, outputNamespace=metapolis, outputBucketPath=metapolis/InvitationModel/, syncMode=overwrite} 2022-04-06 09:16:51 destination > 2022-04-06 09:16:51 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):90 - Write config: WriteConfig{streamName=OfficeModel, namespace=metapolis, outputNamespace=metapolis, outputBucketPath=metapolis/OfficeModel/, syncMode=overwrite} 2022-04-06 09:16:51 destination > 2022-04-06 09:16:51 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):90 - Write config: WriteConfig{streamName=PlayerModel, namespace=metapolis, outputNamespace=metapolis, outputBucketPath=metapolis/PlayerModel/, syncMode=overwrite} 2022-04-06 09:16:51 destination > 2022-04-06 09:16:51 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):90 - Write config: WriteConfig{streamName=ServerSettingModel, namespace=metapolis, outputNamespace=metapolis, outputBucketPath=metapolis/ServerSettingModel/, syncMode=overwrite} 2022-04-06 09:16:51 source > 2022-04-06 09:16:51 INFO c.m.d.l.SLF4JLogger(info):71 - Opened connection [connectionId{localValue:1}] to metapolis-prod.c3svvjp5iqfn.ap-northeast-1.docdb.amazonaws.com:27017 2022-04-06 09:16:51 source > 2022-04-06 09:16:51 INFO c.m.d.l.SLF4JLogger(info):71 - Opened connection [connectionId{localValue:2}] to metapolis-prod.c3svvjp5iqfn.ap-northeast-1.docdb.amazonaws.com:27017 2022-04-06 09:16:51 source > 2022-04-06 09:16:51 INFO c.m.d.l.SLF4JLogger(info):71 - Monitor thread successfully connected to server with description ServerDescription{address=metapolis-prod.c3svvjp5iqfn.ap-northeast-1.docdb.amazonaws.com:27017, type=REPLICA_SET_PRIMARY, state=CONNECTED, ok=true, minWireVersion=0, maxWireVersion=7, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=333032173, setName='rs0', canonicalAddress=metapolis-prod.c3svvjp5iqfn.ap-northeast-1.docdb.amazonaws.com:27017, hosts=[metapolis-prod.c3svvjp5iqfn.ap-northeast-1.docdb.amazonaws.com:27017], passives=[], arbiters=[], primary='metapolis-prod.c3svvjp5iqfn.ap-northeast-1.docdb.amazonaws.com:27017', tagSet=TagSet{[]}, electionId=7fffffff0000000000000005, setVersion=null, topologyVersion=null, lastWriteDate=Wed Apr 06 09:16:51 UTC 2022, lastUpdateTimeNanos=2751089241924} 2022-04-06 09:16:51 source > 2022-04-06 09:16:51 INFO c.m.d.l.SLF4JLogger(info):71 - Discovered replica set primary metapolis-prod.c3svvjp5iqfn.ap-northeast-1.docdb.amazonaws.com:27017 2022-04-06 09:16:51 destination > 2022-04-06 09:16:51 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2022-04-06 09:16:51 destination > 2022-04-06 09:16:51 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$2):105 - Preparing bucket in destination started for 8 streams 2022-04-06 09:16:51 destination > 2022-04-06 09:16:51 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$2):111 - Clearing storage area in destination started for namespace metapolis stream BuildingModel bucketObject metapolis/BuildingModel/ 2022-04-06 09:16:52 source > 2022-04-06 09:16:52 INFO c.m.d.l.SLF4JLogger(info):71 - Opened connection [connectionId{localValue:3}] to metapolis-prod.c3svvjp5iqfn.ap-northeast-1.docdb.amazonaws.com:27017 2022-04-06 09:16:52 destination > 2022-04-06 09:16:52 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$2):115 - Clearing storage area in destination completed for namespace metapolis stream BuildingModel bucketObject metapolis/BuildingModel/ 2022-04-06 09:16:52 destination > 2022-04-06 09:16:52 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$2):111 - Clearing storage area in destination started for namespace metapolis stream ClientVersion bucketObject metapolis/ClientVersion/ 2022-04-06 09:16:52 destination > 2022-04-06 09:16:52 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$2):115 - Clearing storage area in destination completed for namespace metapolis stream ClientVersion bucketObject metapolis/ClientVersion/ 2022-04-06 09:16:52 destination > 2022-04-06 09:16:52 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$2):111 - Clearing storage area in destination started for namespace metapolis stream ClientVersionModel bucketObject metapolis/ClientVersionModel/ 2022-04-06 09:16:52 destination > 2022-04-06 09:16:52 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$2):115 - Clearing storage area in destination completed for namespace metapolis stream ClientVersionModel bucketObject metapolis/ClientVersionModel/ 2022-04-06 09:16:52 destination > 2022-04-06 09:16:52 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$2):111 - Clearing storage area in destination started for namespace metapolis stream GuestModel bucketObject metapolis/GuestModel/ 2022-04-06 09:16:52 destination > 2022-04-06 09:16:52 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$2):115 - Clearing storage area in destination completed for namespace metapolis stream GuestModel bucketObject metapolis/GuestModel/ 2022-04-06 09:16:52 destination > 2022-04-06 09:16:52 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$2):111 - Clearing storage area in destination started for namespace metapolis stream InvitationModel bucketObject metapolis/InvitationModel/ 2022-04-06 09:16:52 destination > 2022-04-06 09:16:52 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$2):115 - Clearing storage area in destination completed for namespace metapolis stream InvitationModel bucketObject metapolis/InvitationModel/ 2022-04-06 09:16:52 destination > 2022-04-06 09:16:52 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$2):111 - Clearing storage area in destination started for namespace metapolis stream OfficeModel bucketObject metapolis/OfficeModel/ 2022-04-06 09:16:52 destination > 2022-04-06 09:16:52 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$2):115 - Clearing storage area in destination completed for namespace metapolis stream OfficeModel bucketObject metapolis/OfficeModel/ 2022-04-06 09:16:52 destination > 2022-04-06 09:16:52 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$2):111 - Clearing storage area in destination started for namespace metapolis stream PlayerModel bucketObject metapolis/PlayerModel/ 2022-04-06 09:16:52 destination > 2022-04-06 09:16:52 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$2):115 - Clearing storage area in destination completed for namespace metapolis stream PlayerModel bucketObject metapolis/PlayerModel/ 2022-04-06 09:16:52 destination > 2022-04-06 09:16:52 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$2):111 - Clearing storage area in destination started for namespace metapolis stream ServerSettingModel bucketObject metapolis/ServerSettingModel/ 2022-04-06 09:16:52 destination > 2022-04-06 09:16:52 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$2):115 - Clearing storage area in destination completed for namespace metapolis stream ServerSettingModel bucketObject metapolis/ServerSettingModel/ 2022-04-06 09:16:52 destination > 2022-04-06 09:16:52 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$2):119 - Preparing storage area in destination completed. 2022-04-06 09:16:55 destination > 2022-04-06 09:16:55 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):55 - Starting a new buffer for stream BuildingModel (current state: 0 bytes in 0 buffers) 2022-04-06 09:16:55 destination > 2022-04-06 09:16:55 WARN i.a.i.d.s.a.JsonToAvroSchemaConverter(parseSingleType):240 - Array field "floors" does not specify the items type. It will default to an array of strings 2022-04-06 09:16:55 destination > 2022-04-06 09:16:55 WARN o.a.h.u.NativeCodeLoader():60 - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2022-04-06 09:16:55 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 1000 (159 KB) 2022-04-06 09:16:57 destination > 2022-04-06 09:16:57 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):55 - Starting a new buffer for stream ClientVersion (current state: 3 KB in 1 buffers) 2022-04-06 09:16:57 destination > 2022-04-06 09:16:57 ERROR i.a.i.b.FailureTrackingAirbyteMessageConsumer(accept):52 - Exception while accepting message 2022-04-06 09:16:57 destination > tech.allegro.schema.json2avro.converter.AvroConversionException: Failed to convert JSON to Avro: Could not evaluate union, field win is expected to be one of these: NULL, STRING. If this is a complex type, check if offending field: win adheres to schema. 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.read(JsonGenericRecordReader.java:129) ~[converter-0.2.11-SNAPSHOT.jar:?] 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.read(JsonGenericRecordReader.java:118) ~[converter-0.2.11-SNAPSHOT.jar:?] 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.JsonAvroConverter.convertToGenericDataRecord(JsonAvroConverter.java:95) ~[converter-0.2.11-SNAPSHOT.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.s3.avro.AvroRecordFactory.getAvroRecord(AvroRecordFactory.java:39) ~[io.airbyte.airbyte-integrations.connectors-destination-s3-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.s3.parquet.ParquetSerializedBuffer.accept(ParquetSerializedBuffer.java:93) ~[io.airbyte.airbyte-integrations.connectors-destination-s3-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.record_buffer.SerializedBufferingStrategy.addRecord(SerializedBufferingStrategy.java:69) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer.acceptTracked(BufferedStreamConsumer.java:137) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.FailureTrackingAirbyteMessageConsumer.accept(FailureTrackingAirbyteMessageConsumer.java:50) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.IntegrationRunner.consumeWriteStream(IntegrationRunner.java:182) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.IntegrationRunner.lambda$runConsumer$2(IntegrationRunner.java:191) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.IntegrationRunner.watchForOrphanThreads(IntegrationRunner.java:220) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.IntegrationRunner.runConsumer(IntegrationRunner.java:190) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.IntegrationRunner.lambda$runInternal$1(IntegrationRunner.java:163) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:54) [io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:38) [io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:163) [io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:105) [io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.s3.S3Destination.main(S3Destination.java:51) [io.airbyte.airbyte-integrations.connectors-destination-s3-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > Caused by: org.apache.avro.AvroTypeException: Could not evaluate union, field win is expected to be one of these: NULL, STRING. If this is a complex type, check if offending field: win adheres to schema. 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.AvroTypeExceptions.unionException(AvroTypeExceptions.java:28) ~[converter-0.2.11-SNAPSHOT.jar:?] 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.readUnion(JsonGenericRecordReader.java:289) ~[converter-0.2.11-SNAPSHOT.jar:?] 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.read(JsonGenericRecordReader.java:196) ~[converter-0.2.11-SNAPSHOT.jar:?] 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.read(JsonGenericRecordReader.java:170) ~[converter-0.2.11-SNAPSHOT.jar:?] 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.lambda$readRecord$0(JsonGenericRecordReader.java:152) ~[converter-0.2.11-SNAPSHOT.jar:?] 2022-04-06 09:16:57 destination > at java.util.LinkedHashMap.forEach(LinkedHashMap.java:721) ~[?:?] 2022-04-06 09:16:57 destination > Exception in thread "main" tech.allegro.schema.json2avro.converter.AvroConversionException: Failed to convert JSON to Avro: Could not evaluate union, field win is expected to be one of these: NULL, STRING. If this is a complex type, check if offending field: win adheres to schema. 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.read(JsonGenericRecordReader.java:129) 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.read(JsonGenericRecordReader.java:118) 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.JsonAvroConverter.convertToGenericDataRecord(JsonAvroConverter.java:95) 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.s3.avro.AvroRecordFactory.getAvroRecord(AvroRecordFactory.java:39) 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.s3.parquet.ParquetSerializedBuffer.accept(ParquetSerializedBuffer.java:93) 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.record_buffer.SerializedBufferingStrategy.addRecord(SerializedBufferingStrategy.java:69) 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer.acceptTracked(BufferedStreamConsumer.java:137) 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.FailureTrackingAirbyteMessageConsumer.accept(FailureTrackingAirbyteMessageConsumer.java:50) 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.IntegrationRunner.consumeWriteStream(IntegrationRunner.java:182) 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.IntegrationRunner.lambda$runConsumer$2(IntegrationRunner.java:191) 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.IntegrationRunner.watchForOrphanThreads(IntegrationRunner.java:220) 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.IntegrationRunner.runConsumer(IntegrationRunner.java:190) 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.IntegrationRunner.lambda$runInternal$1(IntegrationRunner.java:163) 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:54) 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:38) 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:163) 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:105) 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.readRecord(JsonGenericRecordReader.java:141) ~[converter-0.2.11-SNAPSHOT.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.s3.S3Destination.main(S3Destination.java:51) 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.read(JsonGenericRecordReader.java:127) ~[converter-0.2.11-SNAPSHOT.jar:?] 2022-04-06 09:16:57 destination > ... 17 more 2022-04-06 09:16:57 destination > 2022-04-06 09:16:57 WARN i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):63 - Airbyte message consumer: failed. 2022-04-06 09:16:57 destination > 2022-04-06 09:16:57 ERROR i.a.i.d.b.BufferedStreamConsumer(close):168 - executing on failed close procedure. 2022-04-06 09:16:57 destination > 2022-04-06 09:16:57 INFO i.a.i.d.r.SerializedBufferingStrategy(close):119 - Closing buffer for stream BuildingModel 2022-04-06 09:16:57 destination > 2022-04-06 09:16:57 ERROR i.a.i.d.r.SerializedBufferingStrategy(close):123 - Exception while closing stream buffer 2022-04-06 09:16:57 destination > java.lang.NullPointerException: Cannot invoke "java.io.InputStream.close()" because "this.inputStream" is null 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.s3.parquet.ParquetSerializedBuffer.close(ParquetSerializedBuffer.java:154) ~[io.airbyte.airbyte-integrations.connectors-destination-s3-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.record_buffer.SerializedBufferingStrategy.close(SerializedBufferingStrategy.java:120) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer.close(BufferedStreamConsumer.java:173) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.FailureTrackingAirbyteMessageConsumer.lambda$close$0(FailureTrackingAirbyteMessageConsumer.java:67) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:54) [io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.FailureTrackingAirbyteMessageConsumer.close(FailureTrackingAirbyteMessageConsumer.java:67) [io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > Suppressed: java.lang.RuntimeException: Exceptions thrown while closing buffers: java.lang.NullPointerException: Cannot invoke "java.io.InputStream.close()" because "this.inputStream" is null 2022-04-06 09:16:57 destination > java.lang.NullPointerException: Cannot invoke "java.io.InputStream.close()" because "this.inputStream" is null 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.record_buffer.SerializedBufferingStrategy.close(SerializedBufferingStrategy.java:127) 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer.close(BufferedStreamConsumer.java:173) 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:162) [io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.FailureTrackingAirbyteMessageConsumer.lambda$close$0(FailureTrackingAirbyteMessageConsumer.java:67) 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:105) [io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.s3.S3Destination.main(S3Destination.java:51) [io.airbyte.airbyte-integrations.connectors-destination-s3-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:54) 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.FailureTrackingAirbyteMessageConsumer.close(FailureTrackingAirbyteMessageConsumer.java:67) 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:162) 2022-04-06 09:16:57 destination > ... 2 more 2022-04-06 09:16:57 destination > Caused by: org.apache.avro.AvroTypeException: Could not evaluate union, field win is expected to be one of these: NULL, STRING. If this is a complex type, check if offending field: win adheres to schema. 2022-04-06 09:16:57 destination > 2022-04-06 09:16:57 INFO i.a.i.d.r.SerializedBufferingStrategy(close):119 - Closing buffer for stream ClientVersion 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.AvroTypeExceptions.unionException(AvroTypeExceptions.java:28) 2022-04-06 09:16:57 destination > 2022-04-06 09:16:57 ERROR i.a.i.d.r.SerializedBufferingStrategy(close):123 - Exception while closing stream buffer 2022-04-06 09:16:57 destination > java.lang.NullPointerException: Cannot invoke "java.io.InputStream.close()" because "this.inputStream" is null 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.readUnion(JsonGenericRecordReader.java:289) 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.read(JsonGenericRecordReader.java:196) 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.read(JsonGenericRecordReader.java:170) 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.lambda$readRecord$0(JsonGenericRecordReader.java:152) 2022-04-06 09:16:57 destination > at java.base/java.util.LinkedHashMap.forEach(LinkedHashMap.java:721) 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.readRecord(JsonGenericRecordReader.java:141) 2022-04-06 09:16:57 destination > at tech.allegro.schema.json2avro.converter.JsonGenericRecordReader.read(JsonGenericRecordReader.java:127) 2022-04-06 09:16:57 destination > ... 17 more 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.s3.parquet.ParquetSerializedBuffer.close(ParquetSerializedBuffer.java:154) ~[io.airbyte.airbyte-integrations.connectors-destination-s3-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.record_buffer.SerializedBufferingStrategy.close(SerializedBufferingStrategy.java:120) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer.close(BufferedStreamConsumer.java:173) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.FailureTrackingAirbyteMessageConsumer.lambda$close$0(FailureTrackingAirbyteMessageConsumer.java:67) ~[io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.sentry.AirbyteSentry.executeWithTracing(AirbyteSentry.java:54) [io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.FailureTrackingAirbyteMessageConsumer.close(FailureTrackingAirbyteMessageConsumer.java:67) [io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:162) [io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:105) [io.airbyte.airbyte-integrations.bases-base-java-0.35.60-alpha.jar:?] 2022-04-06 09:16:57 destination > at io.airbyte.integrations.destination.s3.S3Destination.main(S3Destination.java:51) [io.airbyte.airbyte-integrations.connectors-destination-s3-0.35.60-alpha.jar:?] 2022-04-06 09:17:57 WARN i.a.c.i.LineGobbler(voidCall):86 - airbyte-source gobbler IOException: Stream closed. Typically happens when cancelling a job. 2022-04-06 09:17:57 ERROR i.a.w.DefaultReplicationWorker(run):169 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process message delivery failed at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:162) ~[io.airbyte-airbyte-workers-0.35.62-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:57) ~[io.airbyte-airbyte-workers-0.35.62-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.35.62-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Suppressed: io.airbyte.workers.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.protocols.airbyte.DefaultAirbyteSource.close(DefaultAirbyteSource.java:136) ~[io.airbyte-airbyte-workers-0.35.62-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:126) ~[io.airbyte-airbyte-workers-0.35.62-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:57) ~[io.airbyte-airbyte-workers-0.35.62-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.35.62-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Suppressed: java.io.IOException: Stream closed at java.lang.ProcessBuilder$NullOutputStream.write(ProcessBuilder.java:445) ~[?:?] at java.io.OutputStream.write(OutputStream.java:162) ~[?:?] at java.io.BufferedOutputStream.write(BufferedOutputStream.java:123) ~[?:?] at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:234) ~[?:?] at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:304) ~[?:?] at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:282) ~[?:?] at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:132) ~[?:?] at java.io.OutputStreamWriter.write(OutputStreamWriter.java:205) ~[?:?] at java.io.BufferedWriter.flushBuffer(BufferedWriter.java:120) ~[?:?] at java.io.BufferedWriter.flush(BufferedWriter.java:256) ~[?:?] at io.airbyte.workers.protocols.airbyte.DefaultAirbyteDestination.notifyEndOfStream(DefaultAirbyteDestination.java:98) ~[io.airbyte-airbyte-workers-0.35.62-alpha.jar:?] at io.airbyte.workers.protocols.airbyte.DefaultAirbyteDestination.close(DefaultAirbyteDestination.java:111) ~[io.airbyte-airbyte-workers-0.35.62-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:126) ~[io.airbyte-airbyte-workers-0.35.62-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.run(DefaultReplicationWorker.java:57) ~[io.airbyte-airbyte-workers-0.35.62-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.35.62-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process message delivery failed at io.airbyte.workers.DefaultReplicationWorker.lambda$getReplicationRunnable$5(DefaultReplicationWorker.java:296) ~[io.airbyte-airbyte-workers-0.35.62-alpha.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] ... 1 more Caused by: java.io.IOException: Broken pipe at java.io.FileOutputStream.writeBytes(Native Method) ~[?:?] at java.io.FileOutputStream.write(FileOutputStream.java:349) ~[?:?] at java.io.BufferedOutputStream.write(BufferedOutputStream.java:123) ~[?:?] at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:234) ~[?:?] at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:304) ~[?:?] at sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:282) ~[?:?] at sun.nio.cs.StreamEncoder.write(StreamEncoder.java:132) ~[?:?] at java.io.OutputStreamWriter.write(OutputStreamWriter.java:205) ~[?:?] at java.io.BufferedWriter.flushBuffer(BufferedWriter.java:120) ~[?:?] at java.io.BufferedWriter.write(BufferedWriter.java:233) ~[?:?] at java.io.Writer.write(Writer.java:249) ~[?:?] at io.airbyte.workers.protocols.airbyte.DefaultAirbyteDestination.accept(DefaultAirbyteDestination.java:90) ~[io.airbyte-airbyte-workers-0.35.62-alpha.jar:?] at io.airbyte.workers.DefaultReplicationWorker.lambda$getReplicationRunnable$5(DefaultReplicationWorker.java:294) ~[io.airbyte-airbyte-workers-0.35.62-alpha.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] ... 1 more 2022-04-06 09:17:57 INFO i.a.w.DefaultReplicationWorker(run):228 - sync summary: io.airbyte.config.ReplicationAttemptSummary@6931449e[status=failed,recordsSynced=1242,bytesSynced=315068,startTime=1649236608180,endTime=1649236677495,totalStats=io.airbyte.config.SyncStats@7743caf4[recordsEmitted=1242,bytesEmitted=315068,stateMessagesEmitted=0,recordsCommitted=0],streamStats=[io.airbyte.config.StreamSyncStats@69d5f9b2[streamName=OfficeModel,stats=io.airbyte.config.SyncStats@30a8cbc9[recordsEmitted=105,bytesEmitted=54503,stateMessagesEmitted=,recordsCommitted=]], io.airbyte.config.StreamSyncStats@535e6cf6[streamName=PlayerModel,stats=io.airbyte.config.SyncStats@3aa30803[recordsEmitted=152,bytesEmitted=101641,stateMessagesEmitted=,recordsCommitted=]], io.airbyte.config.StreamSyncStats@7cfd7e8c[streamName=GuestModel,stats=io.airbyte.config.SyncStats@a7d0459[recordsEmitted=927,bytesEmitted=143453,stateMessagesEmitted=,recordsCommitted=]], io.airbyte.config.StreamSyncStats@2a64e03c[streamName=ClientVersionModel,stats=io.airbyte.config.SyncStats@8a51663[recordsEmitted=50,bytesEmitted=11496,stateMessagesEmitted=,recordsCommitted=]], io.airbyte.config.StreamSyncStats@1f3b00e5[streamName=BuildingModel,stats=io.airbyte.config.SyncStats@7d868097[recordsEmitted=5,bytesEmitted=3251,stateMessagesEmitted=,recordsCommitted=]], io.airbyte.config.StreamSyncStats@70eeea1b[streamName=ClientVersion,stats=io.airbyte.config.SyncStats@50d8fc6b[recordsEmitted=1,bytesEmitted=326,stateMessagesEmitted=,recordsCommitted=]], io.airbyte.config.StreamSyncStats@17a3e2bd[streamName=InvitationModel,stats=io.airbyte.config.SyncStats@5e685ae6[recordsEmitted=2,bytesEmitted=398,stateMessagesEmitted=,recordsCommitted=]]]] 2022-04-06 09:17:57 INFO i.a.w.DefaultReplicationWorker(run):250 - Source did not output any state messages 2022-04-06 09:17:57 WARN i.a.w.DefaultReplicationWorker(run):261 - State capture: No state retained. 2022-04-06 09:17:57 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-04-06 09:17:57 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$1):147 - sync summary: io.airbyte.config.StandardSyncOutput@127fbc7b[standardSyncSummary=io.airbyte.config.StandardSyncSummary@5c06742c[status=failed,recordsSynced=1242,bytesSynced=315068,startTime=1649236608180,endTime=1649236677495,totalStats=io.airbyte.config.SyncStats@7743caf4[recordsEmitted=1242,bytesEmitted=315068,stateMessagesEmitted=0,recordsCommitted=0],streamStats=[io.airbyte.config.StreamSyncStats@69d5f9b2[streamName=OfficeModel,stats=io.airbyte.config.SyncStats@30a8cbc9[recordsEmitted=105,bytesEmitted=54503,stateMessagesEmitted=,recordsCommitted=]], io.airbyte.config.StreamSyncStats@535e6cf6[streamName=PlayerModel,stats=io.airbyte.config.SyncStats@3aa30803[recordsEmitted=152,bytesEmitted=101641,stateMessagesEmitted=,recordsCommitted=]], io.airbyte.config.StreamSyncStats@7cfd7e8c[streamName=GuestModel,stats=io.airbyte.config.SyncStats@a7d0459[recordsEmitted=927,bytesEmitted=143453,stateMessagesEmitted=,recordsCommitted=]], io.airbyte.config.StreamSyncStats@2a64e03c[streamName=ClientVersionModel,stats=io.airbyte.config.SyncStats@8a51663[recordsEmitted=50,bytesEmitted=11496,stateMessagesEmitted=,recordsCommitted=]], io.airbyte.config.StreamSyncStats@1f3b00e5[streamName=BuildingModel,stats=io.airbyte.config.SyncStats@7d868097[recordsEmitted=5,bytesEmitted=3251,stateMessagesEmitted=,recordsCommitted=]], io.airbyte.config.StreamSyncStats@70eeea1b[streamName=ClientVersion,stats=io.airbyte.config.SyncStats@50d8fc6b[recordsEmitted=1,bytesEmitted=326,stateMessagesEmitted=,recordsCommitted=]], io.airbyte.config.StreamSyncStats@17a3e2bd[streamName=InvitationModel,stats=io.airbyte.config.SyncStats@5e685ae6[recordsEmitted=2,bytesEmitted=398,stateMessagesEmitted=,recordsCommitted=]]]],state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@6ab2c9b6[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@d0ea011[stream=io.airbyte.protocol.models.AirbyteStream@627d49af[name=BuildingModel,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"key":{"type":"string"},"seq":{"type":"number"},"name":{"type":"string"},"floors":{"type":"array"},"defaultAreaSize":{"type":"number"},"_id_aibyte_transform":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=metapolis,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@d35f6d8[stream=io.airbyte.protocol.models.AirbyteStream@71b661b1[name=ClientVersion,jsonSchema={"type":"object","properties":{"_id":{"type":"string"},"ios":{"type":"string"},"key":{"type":"string"},"osx":{"type":"string"},"win":{"type":"string"},"android":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=metapolis,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@94059be[stream=io.airbyte.protocol.models.AirbyteStream@1f85908[name=ClientVersionModel,jsonSchema={"type":"object","properties":{"_id":{"type":"string"},"ios":{"type":"string"},"key":{"type":"string"},"osx":{"type":"string"},"win":{"type":"string"},"memo":{"type":"string"},"size":{"type":"number"},"android":{"type":"string"},"version":{"type":"string"},"disabled":{"type":"boolean"},"fileName":{"type":"string"},"platform":{"type":"string"},"createdAt":{"type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=metapolis,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@2359fcd9[stream=io.airbyte.protocol.models.AirbyteStream@61a0baea[name=GuestModel,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"key":{"type":"string"},"seq":{"type":"number"},"email":{"type":"string"},"_id_aibyte_transform":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=metapolis,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@6a2682c9[stream=io.airbyte.protocol.models.AirbyteStream@2955b69c[name=InvitationModel,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"key":{"type":"string"},"seq":{"type":"number"},"email":{"type":"string"},"status":{"type":"number"},"createdAt":{"type":"number"},"expiredAt":{"type":"number"},"updatedAt":{"type":"number"},"retryCount":{"type":"number"},"hostPlayerId":{"type":"number"},"invitationKey":{"type":"string"},"invitationPhrase":{"type":"string"},"statusDescription":{"type":"string"},"_id_aibyte_transform":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=metapolis,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@4586285b[stream=io.airbyte.protocol.models.AirbyteStream@2115adeb[name=OfficeModel,jsonSchema={"type":"object","properties":{"id":{"type":"number"},"key":{"type":"string"},"seq":{"type":"number"},"name":{"type":"string"},"ciUrl":{"type":"string"},"color":{"type":"string"},"floor":{"type":"number"},"events":{"type":"array"},"areaSize":{"type":"number"},"password":{"type":"string"},"sceneName":{"type":"string"},"buildingId":{"type":"number"},"allowedEmails":{"type":"array"},"organizationId":{"type":"number"},"_id_aibyte_transform":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=metapolis,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@7ffb53ca[stream=io.airbyte.protocol.models.AirbyteStream@7b1efbff[name=PlayerModel,jsonSchema={"type":"object","properties":{"key":{"type":"string"},"seq":{"type":"number"},"name":{"type":"string"},"email":{"type":"string"},"phone":{"type":"string"},"roles":{"type":"array"},"enabled":{"type":"boolean"},"isGuest":{"type":"boolean"},"password":{"type":"string"},"createdAt":{"type":"number"},"updatedAt":{"type":"number"},"isLoggedIn":{"type":"boolean"},"accessToken":{"type":"string"},"description":{"type":"string"},"characterKey":{"type":"number"},"joinedOffice":{"type":"array"},"allowNewGroup":{"type":"boolean"},"emailVerified":{"type":"boolean"},"passwordVersion":{"type":"number"},"passwordResetToken":{"type":"string"},"id_aibyte_transform":{"type":"string"},"_id_aibyte_transform":{"type":"string"},"emailVerificationToken":{"type":"string"},"latestOfficeId_aibyte_transform":{"type":"string"},"latestLeaveOfficeTime_aibyte_transform":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=metapolis,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@f2ed037[stream=io.airbyte.protocol.models.AirbyteStream@3d85ecc[name=ServerSettingModel,jsonSchema={"type":"object","properties":{"_id":{"type":"string"},"key":{"type":"string"},"cameraSettings":{"type":"array"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=metapolis,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@2698287e[failureOrigin=destination,failureType=,internalMessage=io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process message delivery failed,externalMessage=Something went wrong within the destination connector,metadata=io.airbyte.config.Metadata@2a55fe51[additionalProperties={attemptNumber=2, jobId=1}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process message delivery failed at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:833) Caused by: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process message delivery failed at io.airbyte.workers.DefaultReplicationWorker.lambda$getReplicationRunnable$5(DefaultReplicationWorker.java:296) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more Caused by: java.io.IOException: Broken pipe at java.base/java.io.FileOutputStream.writeBytes(Native Method) at java.base/java.io.FileOutputStream.write(FileOutputStream.java:349) at java.base/java.io.BufferedOutputStream.write(BufferedOutputStream.java:123) at java.base/sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:234) at java.base/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:304) at java.base/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:282) at java.base/sun.nio.cs.StreamEncoder.write(StreamEncoder.java:132) at java.base/java.io.OutputStreamWriter.write(OutputStreamWriter.java:205) at java.base/java.io.BufferedWriter.flushBuffer(BufferedWriter.java:120) at java.base/java.io.BufferedWriter.write(BufferedWriter.java:233) at java.base/java.io.Writer.write(Writer.java:249) at io.airbyte.workers.protocols.airbyte.DefaultAirbyteDestination.accept(DefaultAirbyteDestination.java:90) at io.airbyte.workers.DefaultReplicationWorker.lambda$getReplicationRunnable$5(DefaultReplicationWorker.java:294) ... 4 more ,retryable=,timestamp=1649236617482], io.airbyte.config.FailureReason@53832c44[failureOrigin=destination,failureType=,internalMessage=io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1,externalMessage=Something went wrong within the destination connector,metadata=io.airbyte.config.Metadata@12ec26c6[additionalProperties={attemptNumber=2, jobId=1}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1 at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:833) Caused by: io.airbyte.workers.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 1 at io.airbyte.workers.DefaultReplicationWorker.lambda$getDestinationOutputRunnable$6(DefaultReplicationWorker.java:354) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more ,retryable=,timestamp=1649236617482]]] 2022-04-06 09:17:57 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):235 - Stopping temporal heartbeating... 2022-04-06 09:17:57 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. errors: $.instance: does not have a value in the enumeration [standalone] 2022-04-06 09:17:57 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. errors: $.server_addresses: is missing but it is required, $.instance: does not have a value in the enumeration [replica] 2022-04-06 09:17:57 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. errors: $.cluster_url: is missing but it is required, $.tls: is not defined in the schema and the schema does not allow additional properties, $.host: is not defined in the schema and the schema does not allow additional properties, $.port: is not defined in the schema and the schema does not allow additional properties, $.instance: does not have a value in the enumeration [atlas] 2022-04-06 09:17:57 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. errors: $.format_type: does not have a value in the enumeration [Avro], $.compression_codec: string found, object expected, $.compression_codec: should be valid to one and only one of the schemas 2022-04-06 09:17:57 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. errors: $.flattening: is missing but it is required, $.format_type: does not have a value in the enumeration [CSV] 2022-04-06 09:17:57 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed. errors: $.format_type: does not have a value in the enumeration [JSONL]