2022-09-07 18:25:53 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.format_type: does not have a value in the enumeration [Avro], $.compression_codec: string found, object expected, $.compression_codec: should be valid to one and only one of the schemas 2022-09-07 18:25:53 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.flattening: is missing but it is required, $.format_type: does not have a value in the enumeration [CSV] 2022-09-07 18:25:53 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.format_type: does not have a value in the enumeration [JSONL] 2022-09-07 18:25:53 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/2459/0/logs.log 2022-09-07 18:25:53 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.40.3 2022-09-07 18:25:53 INFO i.a.c.i.LineGobbler(voidCall):83 - Checking if airbyte/source-twilio:0.1.8 exists... 2022-09-07 18:25:54 INFO i.a.c.i.LineGobbler(voidCall):83 - airbyte/source-twilio:0.1.8 was found locally. 2022-09-07 18:25:54 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 2459 2022-09-07 18:25:54 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/2459/0 --log-driver none --name source-twilio-check-2459-0-xvwfo --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/source-twilio:0.1.8 -e WORKER_JOB_ATTEMPT=0 -e AIRBYTE_VERSION=0.40.3 -e WORKER_JOB_ID=2459 airbyte/source-twilio:0.1.8 check --config source_config.json 2022-09-07 18:25:54 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):99 - Check succeeded 2022-09-07 18:25:55 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-09-07 18:25:55 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/2459/0/logs.log 2022-09-07 18:25:55 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.40.3 2022-09-07 18:25:55 INFO i.a.c.i.LineGobbler(voidCall):83 - Checking if airbyte/destination-s3:0.3.15 exists... 2022-09-07 18:25:55 INFO i.a.c.i.LineGobbler(voidCall):83 - airbyte/destination-s3:0.3.15 was found locally. 2022-09-07 18:25:55 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 2459 2022-09-07 18:25:55 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/2459/0 --log-driver none --name destination-s3-check-2459-0-isbck --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/destination-s3:0.3.15 -e WORKER_JOB_ATTEMPT=0 -e AIRBYTE_VERSION=0.40.3 -e WORKER_JOB_ID=2459 airbyte/destination-s3:0.3.15 check --config source_config.json 2022-09-07 18:25:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:57 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-09-07 18:25:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:57 INFO i.a.i.b.IntegrationRunner(runInternal):104 - Running integration: io.airbyte.integrations.destination.s3.S3Destination 2022-09-07 18:25:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:57 INFO i.a.i.b.IntegrationRunner(runInternal):105 - Command: CHECK 2022-09-07 18:25:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:57 INFO i.a.i.b.IntegrationRunner(runInternal):106 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-09-07 18:25:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:57 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:25:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:57 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:25:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:57 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:25:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:57 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword requires - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:25:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:57 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"Parquet","page_size_kb":1024,"block_size_mb":128,"compression_codec":"UNCOMPRESSED","dictionary_encoding":true,"max_padding_size_mb":8,"dictionary_page_size_kb":1024} 2022-09-07 18:25:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:57 INFO i.a.i.d.s.S3DestinationConfig(createS3Client):190 - Creating S3 client... 2022-09-07 18:25:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:58 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):102 - Storage Object hdp-integrations-929559537045/parquet/airbyte does not exist in bucket; creating... 2022-09-07 18:25:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:58 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):104 - Storage Object hdp-integrations-929559537045/parquet/airbyte has been created in bucket. 2022-09-07 18:25:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:58 INFO i.a.i.d.s.S3Destination(testIAMUserHasListObjectPermission):156 - Started testing if IAM user can call listObjects on the destination bucket 2022-09-07 18:25:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:58 INFO i.a.i.d.s.S3Destination(testIAMUserHasListObjectPermission):159 - Finished checking for listObjects permission 2022-09-07 18:25:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:58 INFO i.a.i.d.s.S3Destination(testSingleUpload):81 - Started testing if all required credentials assigned to user for single file uploading 2022-09-07 18:25:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:58 INFO i.a.i.d.s.S3Destination(testSingleUpload):91 - Finished checking for normal upload mode 2022-09-07 18:25:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:58 INFO i.a.i.d.s.S3Destination(testMultipartUpload):95 - Started testing if all required credentials assigned to user for multipart upload 2022-09-07 18:25:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:58 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to hdp-integrations-929559537045/parquet/airbyte/test_1662575158749 with full ID 9vUG1hzPNw0SJfqFXUENxEgRWv.0bnetX97Ud4sQOXql1crfK4A61lHH7YWVGrJ7VNRTuOwJnX_dpfQdVhJ1J3bH8PjioWRnJB2spOtqpIGgPxw.pfj1zz2pqj.9NbwW 2022-09-07 18:25:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:58 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-09-07 18:25:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:58 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-09-07 18:25:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:58 WARN a.m.s.MultiPartOutputStream(close):160 - [MultipartOutputStream for parts 1 - 10000] is already closed 2022-09-07 18:25:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:58 INFO a.m.s.StreamTransferManager(complete):367 - [Manager uploading to hdp-integrations-929559537045/parquet/airbyte/test_1662575158749 with id 9vUG1hzPN...pqj.9NbwW]: Uploading leftover stream [Part number 1 containing 3.34 MB] 2022-09-07 18:25:59 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:59 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to hdp-integrations-929559537045/parquet/airbyte/test_1662575158749 with id 9vUG1hzPN...pqj.9NbwW]: Finished uploading [Part number 1 containing 3.34 MB] 2022-09-07 18:25:59 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:59 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to hdp-integrations-929559537045/parquet/airbyte/test_1662575158749 with id 9vUG1hzPN...pqj.9NbwW]: Completed 2022-09-07 18:25:59 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:59 INFO i.a.i.d.s.S3Destination(testMultipartUpload):119 - Finished verification for multipart upload mode 2022-09-07 18:25:59 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:25:59 INFO i.a.i.b.IntegrationRunner(runInternal):152 - Completed integration: io.airbyte.integrations.destination.s3.S3Destination 2022-09-07 18:25:59 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-09-07 18:25:59 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/2459/0/logs.log 2022-09-07 18:25:59 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.40.3 2022-09-07 18:25:59 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):49 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-09-07 18:25:59 INFO i.a.c.EnvConfigs(getEnvOrDefault):1002 - Using default value for environment variable METRIC_CLIENT: '' 2022-09-07 18:25:59 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2022-09-07 18:25:59 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):49 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-09-07 18:25:59 INFO i.a.w.g.DefaultReplicationWorker(run):119 - start sync worker. job id: 2459 attempt id: 0 2022-09-07 18:25:59 INFO i.a.w.g.DefaultReplicationWorker(run):131 - configured sync modes: {null.dependent_phone_numbers=full_refresh - overwrite, null.available_phone_numbers_mobile=full_refresh - overwrite, null.outgoing_caller_ids=full_refresh - overwrite, null.available_phone_numbers_toll_free=full_refresh - overwrite, null.available_phone_number_countries=full_refresh - overwrite, null.messages=incremental - append, null.calls=incremental - append, null.keys=full_refresh - overwrite, null.message_media=incremental - append, null.available_phone_numbers_local=full_refresh - overwrite, null.incoming_phone_numbers=full_refresh - overwrite} 2022-09-07 18:25:59 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-09-07 18:25:59 INFO i.a.c.i.LineGobbler(voidCall):83 - Checking if airbyte/destination-s3:0.3.15 exists... 2022-09-07 18:25:59 INFO i.a.c.i.LineGobbler(voidCall):83 - airbyte/destination-s3:0.3.15 was found locally. 2022-09-07 18:25:59 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 2459 2022-09-07 18:25:59 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/2459/0 --log-driver none --name destination-s3-write-2459-0-njshx --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/destination-s3:0.3.15 -e WORKER_JOB_ATTEMPT=0 -e AIRBYTE_VERSION=0.40.3 -e WORKER_JOB_ID=2459 airbyte/destination-s3:0.3.15 write --config destination_config.json --catalog destination_catalog.json 2022-09-07 18:25:59 INFO i.a.c.i.LineGobbler(voidCall):83 - Checking if airbyte/source-twilio:0.1.8 exists... 2022-09-07 18:25:59 INFO i.a.c.i.LineGobbler(voidCall):83 - airbyte/source-twilio:0.1.8 was found locally. 2022-09-07 18:25:59 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 2459 2022-09-07 18:25:59 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/2459/0 --log-driver none --name source-twilio-read-2459-0-flcok --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/source-twilio:0.1.8 -e WORKER_JOB_ATTEMPT=0 -e AIRBYTE_VERSION=0.40.3 -e WORKER_JOB_ID=2459 airbyte/source-twilio:0.1.8 read --config source_config.json --catalog source_catalog.json --state input_state.json 2022-09-07 18:25:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):421 - Destination output thread started. 2022-09-07 18:25:59 INFO i.a.w.g.DefaultReplicationWorker(run):173 - Waiting for source and destination threads to complete. 2022-09-07 18:25:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):313 - Replication thread started. 2022-09-07 18:26:00 source > Starting syncing SourceTwilio 2022-09-07 18:26:00 source > 'lookback_window' Traceback (most recent call last): File "/airbyte/integration_code/main.py", line 13, in launch(source, sys.argv[1:]) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 123, in launch for message in source_entrypoint.run(parsed_args): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 114, in run for message in generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 102, in read stream_instances = {s.name: s for s in self.streams(config)} File "/airbyte/integration_code/source_twilio/source.py", line 71, in streams "lookback_window": config["lookback_window"], KeyError: 'lookback_window' 2022-09-07 18:26:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):342 - Source has no more messages, closing connection. 2022-09-07 18:26:02 destination > 2022-09-07 18:26:02 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-09-07 18:26:02 destination > 2022-09-07 18:26:02 INFO i.a.i.b.IntegrationRunner(runInternal):104 - Running integration: io.airbyte.integrations.destination.s3.S3Destination 2022-09-07 18:26:02 destination > 2022-09-07 18:26:02 INFO i.a.i.b.IntegrationRunner(runInternal):105 - Command: WRITE 2022-09-07 18:26:02 destination > 2022-09-07 18:26:02 INFO i.a.i.b.IntegrationRunner(runInternal):106 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-09-07 18:26:02 destination > 2022-09-07 18:26:02 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:02 destination > 2022-09-07 18:26:02 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:02 destination > 2022-09-07 18:26:02 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:02 destination > 2022-09-07 18:26:02 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword requires - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:02 destination > 2022-09-07 18:26:02 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"Parquet","page_size_kb":1024,"block_size_mb":128,"compression_codec":"UNCOMPRESSED","dictionary_encoding":true,"max_padding_size_mb":8,"dictionary_page_size_kb":1024} 2022-09-07 18:26:02 destination > 2022-09-07 18:26:02 INFO i.a.i.d.s.S3DestinationConfig(createS3Client):190 - Creating S3 client... 2022-09-07 18:26:02 destination > 2022-09-07 18:26:02 INFO i.a.i.d.s.SerializedBufferFactory(getCreateFunction):49 - S3 format config: S3ParquetFormatConfig{compressionCodec=UNCOMPRESSED, blockSize=134217728, maxPaddingSize=8388608, pageSize=1048576, dictionaryPageSize=1048576, dictionaryEncoding=true, } 2022-09-07 18:26:03 destination > 2022-09-07 18:26:03 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_available_phone_number_countries, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_available_phone_number_countries/2022_09_07_1662575162316_, syncMode=overwrite} 2022-09-07 18:26:03 destination > 2022-09-07 18:26:03 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_available_phone_numbers_local, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_available_phone_numbers_local/2022_09_07_1662575162316_, syncMode=overwrite} 2022-09-07 18:26:03 destination > 2022-09-07 18:26:03 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_available_phone_numbers_mobile, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_available_phone_numbers_mobile/2022_09_07_1662575162316_, syncMode=overwrite} 2022-09-07 18:26:03 destination > 2022-09-07 18:26:03 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_available_phone_numbers_toll_free, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_available_phone_numbers_toll_free/2022_09_07_1662575162316_, syncMode=overwrite} 2022-09-07 18:26:03 destination > 2022-09-07 18:26:03 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_calls, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_calls/2022_09_07_1662575162316_, syncMode=append} 2022-09-07 18:26:03 destination > 2022-09-07 18:26:03 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_dependent_phone_numbers, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_dependent_phone_numbers/2022_09_07_1662575162316_, syncMode=overwrite} 2022-09-07 18:26:03 destination > 2022-09-07 18:26:03 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_incoming_phone_numbers, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_incoming_phone_numbers/2022_09_07_1662575162316_, syncMode=overwrite} 2022-09-07 18:26:03 destination > 2022-09-07 18:26:03 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_keys, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_keys/2022_09_07_1662575162316_, syncMode=overwrite} 2022-09-07 18:26:03 destination > 2022-09-07 18:26:03 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_message_media, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_message_media/2022_09_07_1662575162316_, syncMode=append} 2022-09-07 18:26:03 destination > 2022-09-07 18:26:03 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_messages, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_messages/2022_09_07_1662575162316_, syncMode=append} 2022-09-07 18:26:03 destination > 2022-09-07 18:26:03 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_outgoing_caller_ids, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_outgoing_caller_ids/2022_09_07_1662575162316_, syncMode=overwrite} 2022-09-07 18:26:03 destination > 2022-09-07 18:26:03 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2022-09-07 18:26:03 destination > 2022-09-07 18:26:03 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):90 - Preparing bucket in destination started for 11 streams 2022-09-07 18:26:03 destination > 2022-09-07 18:26:03 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_available_phone_number_countries bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:04 destination > 2022-09-07 18:26:04 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:04 destination > 2022-09-07 18:26:04 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:05 destination > 2022-09-07 18:26:05 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:05 destination > 2022-09-07 18:26:05 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:05 destination > 2022-09-07 18:26:05 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:05 destination > 2022-09-07 18:26:05 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:06 destination > 2022-09-07 18:26:06 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:06 destination > 2022-09-07 18:26:06 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:06 destination > 2022-09-07 18:26:06 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:06 destination > 2022-09-07 18:26:06 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:06 destination > 2022-09-07 18:26:06 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_available_phone_number_countries bucketObject parquet/airbyte 2022-09-07 18:26:06 destination > 2022-09-07 18:26:06 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_available_phone_numbers_local bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:06 destination > 2022-09-07 18:26:06 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:07 destination > 2022-09-07 18:26:07 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:07 destination > 2022-09-07 18:26:07 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:07 destination > 2022-09-07 18:26:07 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:07 destination > 2022-09-07 18:26:07 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:07 destination > 2022-09-07 18:26:07 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:07 destination > 2022-09-07 18:26:07 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:08 destination > 2022-09-07 18:26:08 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:08 destination > 2022-09-07 18:26:08 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:08 destination > 2022-09-07 18:26:08 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:08 destination > 2022-09-07 18:26:08 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_available_phone_numbers_local bucketObject parquet/airbyte 2022-09-07 18:26:08 destination > 2022-09-07 18:26:08 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_available_phone_numbers_mobile bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:08 destination > 2022-09-07 18:26:08 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:08 destination > 2022-09-07 18:26:08 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:08 destination > 2022-09-07 18:26:08 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:09 destination > 2022-09-07 18:26:09 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:09 destination > 2022-09-07 18:26:09 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:09 destination > 2022-09-07 18:26:09 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:09 destination > 2022-09-07 18:26:09 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:09 destination > 2022-09-07 18:26:09 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:09 destination > 2022-09-07 18:26:09 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:09 destination > 2022-09-07 18:26:09 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:09 destination > 2022-09-07 18:26:09 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_available_phone_numbers_mobile bucketObject parquet/airbyte 2022-09-07 18:26:09 destination > 2022-09-07 18:26:09 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_available_phone_numbers_toll_free bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:10 destination > 2022-09-07 18:26:10 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:10 destination > 2022-09-07 18:26:10 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:10 destination > 2022-09-07 18:26:10 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:10 destination > 2022-09-07 18:26:10 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:10 destination > 2022-09-07 18:26:10 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:10 destination > 2022-09-07 18:26:10 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:11 destination > 2022-09-07 18:26:11 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:11 destination > 2022-09-07 18:26:11 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:11 destination > 2022-09-07 18:26:11 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:11 destination > 2022-09-07 18:26:11 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:11 destination > 2022-09-07 18:26:11 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_available_phone_numbers_toll_free bucketObject parquet/airbyte 2022-09-07 18:26:11 destination > 2022-09-07 18:26:11 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_dependent_phone_numbers bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:11 destination > 2022-09-07 18:26:11 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:11 destination > 2022-09-07 18:26:11 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:12 destination > 2022-09-07 18:26:12 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:12 destination > 2022-09-07 18:26:12 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:12 destination > 2022-09-07 18:26:12 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:12 destination > 2022-09-07 18:26:12 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:12 destination > 2022-09-07 18:26:12 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:12 destination > 2022-09-07 18:26:12 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:13 destination > 2022-09-07 18:26:13 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:13 destination > 2022-09-07 18:26:13 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:13 destination > 2022-09-07 18:26:13 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_dependent_phone_numbers bucketObject parquet/airbyte 2022-09-07 18:26:13 destination > 2022-09-07 18:26:13 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_incoming_phone_numbers bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:13 destination > 2022-09-07 18:26:13 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:13 destination > 2022-09-07 18:26:13 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:13 destination > 2022-09-07 18:26:13 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:13 destination > 2022-09-07 18:26:13 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:14 destination > 2022-09-07 18:26:14 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:14 destination > 2022-09-07 18:26:14 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:14 destination > 2022-09-07 18:26:14 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:14 destination > 2022-09-07 18:26:14 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:14 destination > 2022-09-07 18:26:14 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:14 destination > 2022-09-07 18:26:14 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:14 destination > 2022-09-07 18:26:14 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_incoming_phone_numbers bucketObject parquet/airbyte 2022-09-07 18:26:14 destination > 2022-09-07 18:26:14 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_keys bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:15 destination > 2022-09-07 18:26:15 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:15 destination > 2022-09-07 18:26:15 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:15 destination > 2022-09-07 18:26:15 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:15 destination > 2022-09-07 18:26:15 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:15 destination > 2022-09-07 18:26:15 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:15 destination > 2022-09-07 18:26:15 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:16 destination > 2022-09-07 18:26:16 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:16 destination > 2022-09-07 18:26:16 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:16 destination > 2022-09-07 18:26:16 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:16 destination > 2022-09-07 18:26:16 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:16 destination > 2022-09-07 18:26:16 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_keys bucketObject parquet/airbyte 2022-09-07 18:26:16 destination > 2022-09-07 18:26:16 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_outgoing_caller_ids bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:16 destination > 2022-09-07 18:26:16 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:16 destination > 2022-09-07 18:26:16 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:17 destination > 2022-09-07 18:26:17 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:17 destination > 2022-09-07 18:26:17 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:17 destination > 2022-09-07 18:26:17 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:17 destination > 2022-09-07 18:26:17 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:17 destination > 2022-09-07 18:26:17 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:17 destination > 2022-09-07 18:26:17 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:18 destination > 2022-09-07 18:26:18 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:18 destination > 2022-09-07 18:26:18 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:18 destination > 2022-09-07 18:26:18 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_outgoing_caller_ids bucketObject parquet/airbyte 2022-09-07 18:26:18 destination > 2022-09-07 18:26:18 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):104 - Preparing storage area in destination completed. 2022-09-07 18:26:18 destination > 2022-09-07 18:26:18 WARN i.a.i.d.b.BufferedStreamConsumer(acceptTracked):145 - Unexpected message: TRACE 2022-09-07 18:26:18 destination > 2022-09-07 18:26:18 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):62 - Airbyte message consumer: succeeded. 2022-09-07 18:26:18 destination > 2022-09-07 18:26:18 INFO i.a.i.d.b.BufferedStreamConsumer(close):171 - executing on success close procedure. 2022-09-07 18:26:18 destination > 2022-09-07 18:26:18 INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):100 - Flushing all 0 current buffers (0 bytes in total) 2022-09-07 18:26:18 destination > 2022-09-07 18:26:18 INFO i.a.i.b.IntegrationRunner(runInternal):152 - Completed integration: io.airbyte.integrations.destination.s3.S3Destination 2022-09-07 18:26:18 ERROR i.a.w.g.DefaultReplicationWorker(run):184 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:177) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:65) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at java.lang.Thread.run(Thread.java:1589) [?:?] Suppressed: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:141) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:65) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at java.lang.Thread.run(Thread.java:1589) [?:?] Caused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:346) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:344) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] ... 1 more 2022-09-07 18:26:18 INFO i.a.w.g.DefaultReplicationWorker(run):249 - sync summary: io.airbyte.config.ReplicationAttemptSummary@3ae0f507[status=failed,recordsSynced=0,bytesSynced=0,startTime=1662575159651,endTime=1662575178547,totalStats=io.airbyte.config.SyncStats@1112da12[recordsEmitted=0,bytesEmitted=0,sourceStateMessagesEmitted=0,destinationStateMessagesEmitted=0,recordsCommitted=0,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,additionalProperties={}],streamStats=[]] 2022-09-07 18:26:18 INFO i.a.w.g.DefaultReplicationWorker(run):278 - Source did not output any state messages 2022-09-07 18:26:18 WARN i.a.w.g.DefaultReplicationWorker(run):286 - State capture: No new state, falling back on input state: io.airbyte.config.State@64420abb[state={"calls":{"end_time":"2022-09-01T17:07:16Z"},"messages":{"date_sent":"2022-09-01T18:45:32Z"},"message_media":{"date_created":"2022-08-30T20:31:03Z"}}] 2022-09-07 18:26:18 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-09-07 18:26:18 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):165 - sync summary: io.airbyte.config.StandardSyncOutput@4fe95060[standardSyncSummary=io.airbyte.config.StandardSyncSummary@2d0edd6e[status=failed,recordsSynced=0,bytesSynced=0,startTime=1662575159651,endTime=1662575178547,totalStats=io.airbyte.config.SyncStats@1112da12[recordsEmitted=0,bytesEmitted=0,sourceStateMessagesEmitted=0,destinationStateMessagesEmitted=0,recordsCommitted=0,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,additionalProperties={}],streamStats=[]],normalizationSummary=,state=io.airbyte.config.State@64420abb[state={"calls":{"end_time":"2022-09-01T17:07:16Z"},"messages":{"date_sent":"2022-09-01T18:45:32Z"},"message_media":{"date_created":"2022-08-30T20:31:03Z"}}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@75db2e2d[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@3f13b675[stream=io.airbyte.protocol.models.AirbyteStream@3a7c9ba7[name=twilio_available_phone_number_countries,jsonSchema={"type":"object","properties":{"uri":{"type":["null","string"]},"beta":{"type":["null","boolean"]},"country":{"type":["null","string"]},"country_code":{"type":["null","string"]},"subresource_uris":{"type":["null","object"],"properties":{"local":{"type":["null","string"]},"mobile":{"type":["null","string"]},"toll_free":{"type":["null","string"]}},"additionalProperties":false}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@61c2c42b[stream=io.airbyte.protocol.models.AirbyteStream@4d443478[name=twilio_available_phone_numbers_local,jsonSchema={"type":"object","properties":{"beta":{"type":["null","boolean"]},"lata":{"type":["null","string"]},"region":{"type":["null","string"]},"latitude":{"type":["null","string"]},"locality":{"type":["null","string"]},"longitude":{"type":["null","string"]},"iso_country":{"type":["null","string"]},"postal_code":{"type":["null","string"]},"rate_center":{"type":["null","string"]},"capabilities":{"type":["null","object"],"properties":{"MMS":{"type":["null","boolean"]},"SMS":{"type":["null","boolean"]},"fax":{"type":["null","boolean"]},"voice":{"type":["null","boolean"]}},"additionalProperties":false},"phone_number":{"type":["null","string"]},"friendly_name":{"type":["null","string"]},"address_requirements":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@6fc693bb[stream=io.airbyte.protocol.models.AirbyteStream@31398c47[name=twilio_available_phone_numbers_mobile,jsonSchema={"type":"object","properties":{"beta":{"type":["null","boolean"]},"lata":{"type":["null","string"]},"region":{"type":["null","string"]},"latitude":{"type":["null","string"]},"locality":{"type":["null","string"]},"longitude":{"type":["null","string"]},"iso_country":{"type":["null","string"]},"postal_code":{"type":["null","string"]},"rate_center":{"type":["null","string"]},"capabilities":{"type":["null","object"],"properties":{"MMS":{"type":["null","boolean"]},"SMS":{"type":["null","boolean"]},"fax":{"type":["null","boolean"]},"voice":{"type":["null","boolean"]}},"additionalProperties":false},"phone_number":{"type":["null","string"]},"friendly_name":{"type":["null","string"]},"address_requirements":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@462de5d7[stream=io.airbyte.protocol.models.AirbyteStream@2a26fe9e[name=twilio_available_phone_numbers_toll_free,jsonSchema={"type":"object","properties":{"beta":{"type":["null","boolean"]},"lata":{"type":["null","string"]},"region":{"type":["null","string"]},"latitude":{"type":["null","string"]},"locality":{"type":["null","string"]},"longitude":{"type":["null","string"]},"iso_country":{"type":["null","string"]},"postal_code":{"type":["null","string"]},"rate_center":{"type":["null","string"]},"capabilities":{"type":["null","object"],"properties":{"MMS":{"type":["null","boolean"]},"SMS":{"type":["null","boolean"]},"fax":{"type":["null","boolean"]},"voice":{"type":["null","boolean"]}},"additionalProperties":false},"phone_number":{"type":["null","string"]},"friendly_name":{"type":["null","string"]},"address_requirements":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@71a6fb2a[stream=io.airbyte.protocol.models.AirbyteStream@c801aed[name=twilio_calls,jsonSchema={"type":"object","properties":{"to":{"type":["null","string"]},"sid":{"type":["null","string"]},"uri":{"type":["null","string"]},"from":{"type":["null","string"]},"price":{"type":["null","number"]},"status":{"type":["null","string"]},"duration":{"type":["null","integer"]},"end_time":{"type":["null","string"],"format":"date-time"},"direction":{"type":["null","string"]},"group_sid":{"type":["null","string"]},"trunk_sid":{"type":["null","string"]},"annotation":{"type":["null","string"]},"price_unit":{"type":["null","string"]},"queue_time":{"type":["null","integer"]},"start_time":{"type":["null","string"],"format":"date-time"},"account_sid":{"type":["null","string"]},"answered_by":{"type":["null","string"]},"api_version":{"type":["null","string"]},"caller_name":{"type":["null","string"]},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"},"to_formatted":{"type":["null","string"]},"forwarded_from":{"type":["null","string"]},"from_formatted":{"type":["null","string"]},"parent_call_sid":{"type":["null","string"]},"phone_number_sid":{"type":["null","string"]},"subresource_uris":{"type":["null","object"],"properties":{"events":{"type":["null","string"]},"siprec":{"type":["null","string"]},"feedback":{"type":["null","string"]},"payments":{"type":["null","string"]},"recordings":{"type":["null","string"]},"notifications":{"type":["null","string"]},"feedback_summaries":{"type":["null","string"]}},"additionalProperties":false}},"additionalProperties":false},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[end_time],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[end_time],destinationSyncMode=append,primaryKey=[[sid]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@25aa45f7[stream=io.airbyte.protocol.models.AirbyteStream@38e59dd2[name=twilio_dependent_phone_numbers,jsonSchema={"type":"object","properties":{"sid":{"type":["null","string"]},"uri":{"type":["null","string"]},"sms_url":{"type":["null","string"]},"trunk_sid":{"type":["null","string"]},"voice_url":{"type":["null","string"]},"sms_method":{"type":["null","string"]},"account_sid":{"type":["null","string"]},"api_version":{"type":["null","string"]},"capabilities":{"type":["null","object"],"properties":{"MMS":{"type":["null","boolean"]},"SMS":{"type":["null","boolean"]},"Voice":{"type":["null","boolean"]}},"additionalProperties":false},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"},"phone_number":{"type":["null","string"]},"voice_method":{"type":["null","string"]},"friendly_name":{"type":["null","string"]},"status_callback":{"type":["null","string"]},"emergency_status":{"type":["null","string"]},"sms_fallback_url":{"type":["null","string"]},"voice_fallback_url":{"type":["null","string"]},"sms_application_sid":{"type":["null","string"]},"sms_fallback_method":{"type":["null","string"]},"address_requirements":{"type":["null","string"]},"emergency_address_sid":{"type":["null","string"]},"voice_application_sid":{"type":["null","string"]},"voice_fallback_method":{"type":["null","string"]},"status_callback_method":{"type":["null","string"]},"voice_caller_id_lookup":{"type":["null","boolean"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[sid]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@7edc5e4f[stream=io.airbyte.protocol.models.AirbyteStream@7287640b[name=twilio_incoming_phone_numbers,jsonSchema={"type":"object","properties":{"sid":{"type":["null","string"]},"uri":{"type":["null","string"]},"beta":{"type":["null","boolean"]},"origin":{"type":["null","string"]},"status":{"type":["null","string"]},"sms_url":{"type":["null","string"]},"trunk_sid":{"type":["null","string"]},"voice_url":{"type":["null","string"]},"bundle_sid":{"type":["null","string"]},"sms_method":{"type":["null","string"]},"account_sid":{"type":["null","string"]},"address_sid":{"type":["null","string"]},"api_version":{"type":["null","string"]},"capabilities":{"type":["null","object"],"properties":{"fax":{"type":["null","boolean"]},"mms":{"type":["null","boolean"]},"sms":{"type":["null","boolean"]},"voice":{"type":["null","boolean"]}},"additionalProperties":false},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"},"identity_sid":{"type":["null","string"]},"phone_number":{"type":["null","string"]},"voice_method":{"type":["null","string"]},"friendly_name":{"type":["null","string"]},"status_callback":{"type":["null","string"]},"emergency_status":{"type":["null","string"]},"sms_fallback_url":{"type":["null","string"]},"voice_fallback_url":{"type":["null","string"]},"voice_receive_mode":{"type":["null","string"]},"sms_application_sid":{"type":["null","string"]},"sms_fallback_method":{"type":["null","string"]},"address_requirements":{"type":["null","string"]},"emergency_address_sid":{"type":["null","string"]},"voice_application_sid":{"type":["null","string"]},"voice_fallback_method":{"type":["null","string"]},"status_callback_method":{"type":["null","string"]},"voice_caller_id_lookup":{"type":["null","boolean"]},"emergency_address_status":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[sid]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5750251[stream=io.airbyte.protocol.models.AirbyteStream@11ea1420[name=twilio_keys,jsonSchema={"type":"object","properties":{"sid":{"type":["null","string"]},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"},"friendly_name":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[sid]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@dd81e74[stream=io.airbyte.protocol.models.AirbyteStream@44b684f8[name=twilio_message_media,jsonSchema={"type":"object","properties":{"sid":{"type":["null","string"]},"uri":{"type":["null","string"]},"parent_sid":{"type":["null","string"]},"account_sid":{"type":["null","string"]},"content_type":{"type":["null","string"]},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"}},"additionalProperties":false},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[date_created],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[date_created],destinationSyncMode=append,primaryKey=[[sid]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@69fc71b5[stream=io.airbyte.protocol.models.AirbyteStream@28f633be[name=twilio_messages,jsonSchema={"type":"object","properties":{"to":{"type":["null","string"]},"sid":{"type":["null","string"]},"uri":{"type":["null","string"]},"body":{"type":["null","string"]},"from":{"type":["null","string"]},"price":{"type":["null","number"]},"status":{"type":["null","string"]},"date_sent":{"type":["null","string"],"format":"date-time"},"direction":{"type":["null","string"]},"num_media":{"type":["null","integer"]},"error_code":{"type":["null","string"]},"price_unit":{"type":["null","string"]},"account_sid":{"type":["null","string"]},"api_version":{"type":["null","string"]},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"},"num_segments":{"type":["null","integer"]},"error_message":{"type":["null","string"]},"subresource_uris":{"type":["null","object"],"properties":{"media":{"type":["null","string"]},"feedback":{"type":["null","string"]}},"additionalProperties":false},"messaging_service_sid":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[date_sent],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[date_sent],destinationSyncMode=append,primaryKey=[[sid]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@6510b36a[stream=io.airbyte.protocol.models.AirbyteStream@15f16a74[name=twilio_outgoing_caller_ids,jsonSchema={"type":"object","properties":{"sid":{"type":["null","string"]},"uri":{"type":["null","string"]},"account_sid":{"type":["null","string"]},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"},"phone_number":{"type":["null","string"]},"friendly_name":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[sid]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@1f8ac0a6[failureOrigin=source,failureType=system_error,internalMessage='lookback_window',externalMessage=Something went wrong in the connector. See the logs for more details.,metadata=io.airbyte.config.Metadata@6f86b2a[additionalProperties={attemptNumber=0, jobId=2459, from_trace_message=true, connector_command=read}],stacktrace=Traceback (most recent call last): File "/airbyte/integration_code/main.py", line 13, in launch(source, sys.argv[1:]) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 123, in launch for message in source_entrypoint.run(parsed_args): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 114, in run for message in generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 102, in read stream_instances = {s.name: s for s in self.streams(config)} File "/airbyte/integration_code/source_twilio/source.py", line 71, in streams "lookback_window": config["lookback_window"], KeyError: 'lookback_window' ,retryable=,timestamp=1662575160880], io.airbyte.config.FailureReason@6693037c[failureOrigin=source,failureType=,internalMessage=io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped!,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@78af7710[additionalProperties={attemptNumber=0, jobId=2459, connector_command=read}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) at java.base/java.lang.Thread.run(Thread.java:1589) Caused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:346) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140) at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:344) ... 4 more ,retryable=,timestamp=1662575161126]]] 2022-09-07 18:26:18 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):312 - Stopping temporal heartbeating... 2022-09-07 18:26:19 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.format_type: does not have a value in the enumeration [Avro], $.compression_codec: string found, object expected, $.compression_codec: should be valid to one and only one of the schemas 2022-09-07 18:26:19 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.flattening: is missing but it is required, $.format_type: does not have a value in the enumeration [CSV] 2022-09-07 18:26:19 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.format_type: does not have a value in the enumeration [JSONL] 2022-09-07 18:26:19 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/2459/1/logs.log 2022-09-07 18:26:19 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.40.3 2022-09-07 18:26:19 INFO i.a.c.i.LineGobbler(voidCall):83 - Checking if airbyte/source-twilio:0.1.8 exists... 2022-09-07 18:26:19 INFO i.a.c.i.LineGobbler(voidCall):83 - airbyte/source-twilio:0.1.8 was found locally. 2022-09-07 18:26:19 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 2459 2022-09-07 18:26:19 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/2459/1 --log-driver none --name source-twilio-check-2459-1-vjuro --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/source-twilio:0.1.8 -e WORKER_JOB_ATTEMPT=1 -e AIRBYTE_VERSION=0.40.3 -e WORKER_JOB_ID=2459 airbyte/source-twilio:0.1.8 check --config source_config.json 2022-09-07 18:26:20 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):99 - Check succeeded 2022-09-07 18:26:20 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-09-07 18:26:20 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/2459/1/logs.log 2022-09-07 18:26:20 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.40.3 2022-09-07 18:26:20 INFO i.a.c.i.LineGobbler(voidCall):83 - Checking if airbyte/destination-s3:0.3.15 exists... 2022-09-07 18:26:20 INFO i.a.c.i.LineGobbler(voidCall):83 - airbyte/destination-s3:0.3.15 was found locally. 2022-09-07 18:26:20 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 2459 2022-09-07 18:26:20 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/2459/1 --log-driver none --name destination-s3-check-2459-1-tlsai --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/destination-s3:0.3.15 -e WORKER_JOB_ATTEMPT=1 -e AIRBYTE_VERSION=0.40.3 -e WORKER_JOB_ID=2459 airbyte/destination-s3:0.3.15 check --config source_config.json 2022-09-07 18:26:22 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:22 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-09-07 18:26:22 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:22 INFO i.a.i.b.IntegrationRunner(runInternal):104 - Running integration: io.airbyte.integrations.destination.s3.S3Destination 2022-09-07 18:26:22 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:22 INFO i.a.i.b.IntegrationRunner(runInternal):105 - Command: CHECK 2022-09-07 18:26:22 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:22 INFO i.a.i.b.IntegrationRunner(runInternal):106 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-09-07 18:26:22 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:22 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:22 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:22 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:22 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:22 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:22 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:22 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword requires - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:22 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:22 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"Parquet","page_size_kb":1024,"block_size_mb":128,"compression_codec":"UNCOMPRESSED","dictionary_encoding":true,"max_padding_size_mb":8,"dictionary_page_size_kb":1024} 2022-09-07 18:26:22 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:22 INFO i.a.i.d.s.S3DestinationConfig(createS3Client):190 - Creating S3 client... 2022-09-07 18:26:23 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:23 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):102 - Storage Object hdp-integrations-929559537045/parquet/airbyte does not exist in bucket; creating... 2022-09-07 18:26:23 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:23 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):104 - Storage Object hdp-integrations-929559537045/parquet/airbyte has been created in bucket. 2022-09-07 18:26:23 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:23 INFO i.a.i.d.s.S3Destination(testIAMUserHasListObjectPermission):156 - Started testing if IAM user can call listObjects on the destination bucket 2022-09-07 18:26:23 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:23 INFO i.a.i.d.s.S3Destination(testIAMUserHasListObjectPermission):159 - Finished checking for listObjects permission 2022-09-07 18:26:23 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:23 INFO i.a.i.d.s.S3Destination(testSingleUpload):81 - Started testing if all required credentials assigned to user for single file uploading 2022-09-07 18:26:24 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:24 INFO i.a.i.d.s.S3Destination(testSingleUpload):91 - Finished checking for normal upload mode 2022-09-07 18:26:24 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:24 INFO i.a.i.d.s.S3Destination(testMultipartUpload):95 - Started testing if all required credentials assigned to user for multipart upload 2022-09-07 18:26:24 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:24 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to hdp-integrations-929559537045/parquet/airbyte/test_1662575184036 with full ID gKWXmzdL8BOIFU3TJPktCm284OPOLigC.NBeav3NrL3oSVO642BO0KSE_5szoYCBH2Z5mGokqBJc3knkf6pWn37dtd6vUfEDyops5qz0SglBTX.PP4frPtyEcvMYgZNu 2022-09-07 18:26:24 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:24 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-09-07 18:26:24 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:24 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-09-07 18:26:24 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:24 WARN a.m.s.MultiPartOutputStream(close):160 - [MultipartOutputStream for parts 1 - 10000] is already closed 2022-09-07 18:26:24 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:24 INFO a.m.s.StreamTransferManager(complete):367 - [Manager uploading to hdp-integrations-929559537045/parquet/airbyte/test_1662575184036 with id gKWXmzdL8...EcvMYgZNu]: Uploading leftover stream [Part number 1 containing 3.34 MB] 2022-09-07 18:26:24 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:24 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to hdp-integrations-929559537045/parquet/airbyte/test_1662575184036 with id gKWXmzdL8...EcvMYgZNu]: Finished uploading [Part number 1 containing 3.34 MB] 2022-09-07 18:26:24 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:24 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to hdp-integrations-929559537045/parquet/airbyte/test_1662575184036 with id gKWXmzdL8...EcvMYgZNu]: Completed 2022-09-07 18:26:24 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:24 INFO i.a.i.d.s.S3Destination(testMultipartUpload):119 - Finished verification for multipart upload mode 2022-09-07 18:26:24 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:24 INFO i.a.i.b.IntegrationRunner(runInternal):152 - Completed integration: io.airbyte.integrations.destination.s3.S3Destination 2022-09-07 18:26:24 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-09-07 18:26:25 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/2459/1/logs.log 2022-09-07 18:26:25 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.40.3 2022-09-07 18:26:25 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):49 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-09-07 18:26:25 INFO i.a.c.EnvConfigs(getEnvOrDefault):1002 - Using default value for environment variable METRIC_CLIENT: '' 2022-09-07 18:26:25 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2022-09-07 18:26:25 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):49 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-09-07 18:26:25 INFO i.a.w.g.DefaultReplicationWorker(run):119 - start sync worker. job id: 2459 attempt id: 1 2022-09-07 18:26:25 INFO i.a.w.g.DefaultReplicationWorker(run):131 - configured sync modes: {null.dependent_phone_numbers=full_refresh - overwrite, null.available_phone_numbers_mobile=full_refresh - overwrite, null.outgoing_caller_ids=full_refresh - overwrite, null.available_phone_numbers_toll_free=full_refresh - overwrite, null.available_phone_number_countries=full_refresh - overwrite, null.messages=incremental - append, null.calls=incremental - append, null.keys=full_refresh - overwrite, null.message_media=incremental - append, null.available_phone_numbers_local=full_refresh - overwrite, null.incoming_phone_numbers=full_refresh - overwrite} 2022-09-07 18:26:25 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-09-07 18:26:25 INFO i.a.c.i.LineGobbler(voidCall):83 - Checking if airbyte/destination-s3:0.3.15 exists... 2022-09-07 18:26:25 INFO i.a.c.i.LineGobbler(voidCall):83 - airbyte/destination-s3:0.3.15 was found locally. 2022-09-07 18:26:25 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 2459 2022-09-07 18:26:25 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/2459/1 --log-driver none --name destination-s3-write-2459-1-bqyss --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/destination-s3:0.3.15 -e WORKER_JOB_ATTEMPT=1 -e AIRBYTE_VERSION=0.40.3 -e WORKER_JOB_ID=2459 airbyte/destination-s3:0.3.15 write --config destination_config.json --catalog destination_catalog.json 2022-09-07 18:26:25 INFO i.a.c.i.LineGobbler(voidCall):83 - Checking if airbyte/source-twilio:0.1.8 exists... 2022-09-07 18:26:25 INFO i.a.c.i.LineGobbler(voidCall):83 - airbyte/source-twilio:0.1.8 was found locally. 2022-09-07 18:26:25 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 2459 2022-09-07 18:26:25 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/2459/1 --log-driver none --name source-twilio-read-2459-1-lbqvl --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/source-twilio:0.1.8 -e WORKER_JOB_ATTEMPT=1 -e AIRBYTE_VERSION=0.40.3 -e WORKER_JOB_ID=2459 airbyte/source-twilio:0.1.8 read --config source_config.json --catalog source_catalog.json --state input_state.json 2022-09-07 18:26:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):421 - Destination output thread started. 2022-09-07 18:26:25 INFO i.a.w.g.DefaultReplicationWorker(run):173 - Waiting for source and destination threads to complete. 2022-09-07 18:26:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):313 - Replication thread started. 2022-09-07 18:26:26 source > Starting syncing SourceTwilio 2022-09-07 18:26:26 source > 'lookback_window' Traceback (most recent call last): File "/airbyte/integration_code/main.py", line 13, in launch(source, sys.argv[1:]) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 123, in launch for message in source_entrypoint.run(parsed_args): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 114, in run for message in generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 102, in read stream_instances = {s.name: s for s in self.streams(config)} File "/airbyte/integration_code/source_twilio/source.py", line 71, in streams "lookback_window": config["lookback_window"], KeyError: 'lookback_window' 2022-09-07 18:26:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):342 - Source has no more messages, closing connection. 2022-09-07 18:26:27 destination > 2022-09-07 18:26:27 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-09-07 18:26:27 destination > 2022-09-07 18:26:27 INFO i.a.i.b.IntegrationRunner(runInternal):104 - Running integration: io.airbyte.integrations.destination.s3.S3Destination 2022-09-07 18:26:27 destination > 2022-09-07 18:26:27 INFO i.a.i.b.IntegrationRunner(runInternal):105 - Command: WRITE 2022-09-07 18:26:27 destination > 2022-09-07 18:26:27 INFO i.a.i.b.IntegrationRunner(runInternal):106 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-09-07 18:26:27 destination > 2022-09-07 18:26:27 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:27 destination > 2022-09-07 18:26:27 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:27 destination > 2022-09-07 18:26:27 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:27 destination > 2022-09-07 18:26:27 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword requires - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:27 destination > 2022-09-07 18:26:27 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"Parquet","page_size_kb":1024,"block_size_mb":128,"compression_codec":"UNCOMPRESSED","dictionary_encoding":true,"max_padding_size_mb":8,"dictionary_page_size_kb":1024} 2022-09-07 18:26:27 destination > 2022-09-07 18:26:27 INFO i.a.i.d.s.S3DestinationConfig(createS3Client):190 - Creating S3 client... 2022-09-07 18:26:28 destination > 2022-09-07 18:26:28 INFO i.a.i.d.s.SerializedBufferFactory(getCreateFunction):49 - S3 format config: S3ParquetFormatConfig{compressionCodec=UNCOMPRESSED, blockSize=134217728, maxPaddingSize=8388608, pageSize=1048576, dictionaryPageSize=1048576, dictionaryEncoding=true, } 2022-09-07 18:26:28 destination > 2022-09-07 18:26:28 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_available_phone_number_countries, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_available_phone_number_countries/2022_09_07_1662575187875_, syncMode=overwrite} 2022-09-07 18:26:28 destination > 2022-09-07 18:26:28 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_available_phone_numbers_local, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_available_phone_numbers_local/2022_09_07_1662575187875_, syncMode=overwrite} 2022-09-07 18:26:28 destination > 2022-09-07 18:26:28 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_available_phone_numbers_mobile, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_available_phone_numbers_mobile/2022_09_07_1662575187875_, syncMode=overwrite} 2022-09-07 18:26:28 destination > 2022-09-07 18:26:28 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_available_phone_numbers_toll_free, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_available_phone_numbers_toll_free/2022_09_07_1662575187875_, syncMode=overwrite} 2022-09-07 18:26:28 destination > 2022-09-07 18:26:28 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_calls, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_calls/2022_09_07_1662575187875_, syncMode=append} 2022-09-07 18:26:28 destination > 2022-09-07 18:26:28 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_dependent_phone_numbers, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_dependent_phone_numbers/2022_09_07_1662575187875_, syncMode=overwrite} 2022-09-07 18:26:28 destination > 2022-09-07 18:26:28 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_incoming_phone_numbers, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_incoming_phone_numbers/2022_09_07_1662575187875_, syncMode=overwrite} 2022-09-07 18:26:28 destination > 2022-09-07 18:26:28 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_keys, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_keys/2022_09_07_1662575187875_, syncMode=overwrite} 2022-09-07 18:26:28 destination > 2022-09-07 18:26:28 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_message_media, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_message_media/2022_09_07_1662575187875_, syncMode=append} 2022-09-07 18:26:28 destination > 2022-09-07 18:26:28 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_messages, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_messages/2022_09_07_1662575187875_, syncMode=append} 2022-09-07 18:26:28 destination > 2022-09-07 18:26:28 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_outgoing_caller_ids, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_outgoing_caller_ids/2022_09_07_1662575187875_, syncMode=overwrite} 2022-09-07 18:26:28 destination > 2022-09-07 18:26:28 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2022-09-07 18:26:28 destination > 2022-09-07 18:26:28 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):90 - Preparing bucket in destination started for 11 streams 2022-09-07 18:26:28 destination > 2022-09-07 18:26:28 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_available_phone_number_countries bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:29 destination > 2022-09-07 18:26:29 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:29 destination > 2022-09-07 18:26:29 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:29 destination > 2022-09-07 18:26:29 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:30 destination > 2022-09-07 18:26:30 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:30 destination > 2022-09-07 18:26:30 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:30 destination > 2022-09-07 18:26:30 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:30 destination > 2022-09-07 18:26:30 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:30 destination > 2022-09-07 18:26:30 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:30 destination > 2022-09-07 18:26:30 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:31 destination > 2022-09-07 18:26:31 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:31 destination > 2022-09-07 18:26:31 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_available_phone_number_countries bucketObject parquet/airbyte 2022-09-07 18:26:31 destination > 2022-09-07 18:26:31 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_available_phone_numbers_local bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:31 destination > 2022-09-07 18:26:31 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:31 destination > 2022-09-07 18:26:31 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:31 destination > 2022-09-07 18:26:31 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:31 destination > 2022-09-07 18:26:31 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:31 destination > 2022-09-07 18:26:31 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:31 destination > 2022-09-07 18:26:31 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:32 destination > 2022-09-07 18:26:32 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:32 destination > 2022-09-07 18:26:32 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:32 destination > 2022-09-07 18:26:32 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:32 destination > 2022-09-07 18:26:32 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:32 destination > 2022-09-07 18:26:32 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_available_phone_numbers_local bucketObject parquet/airbyte 2022-09-07 18:26:32 destination > 2022-09-07 18:26:32 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_available_phone_numbers_mobile bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:32 destination > 2022-09-07 18:26:32 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:32 destination > 2022-09-07 18:26:32 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:32 destination > 2022-09-07 18:26:32 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:32 destination > 2022-09-07 18:26:32 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:33 destination > 2022-09-07 18:26:33 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:33 destination > 2022-09-07 18:26:33 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:33 destination > 2022-09-07 18:26:33 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:33 destination > 2022-09-07 18:26:33 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:33 destination > 2022-09-07 18:26:33 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:33 destination > 2022-09-07 18:26:33 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:33 destination > 2022-09-07 18:26:33 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_available_phone_numbers_mobile bucketObject parquet/airbyte 2022-09-07 18:26:33 destination > 2022-09-07 18:26:33 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_available_phone_numbers_toll_free bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:33 destination > 2022-09-07 18:26:33 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:33 destination > 2022-09-07 18:26:33 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:34 destination > 2022-09-07 18:26:34 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:34 destination > 2022-09-07 18:26:34 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:34 destination > 2022-09-07 18:26:34 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:34 destination > 2022-09-07 18:26:34 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:34 destination > 2022-09-07 18:26:34 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:34 destination > 2022-09-07 18:26:34 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:34 destination > 2022-09-07 18:26:34 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:34 destination > 2022-09-07 18:26:34 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:34 destination > 2022-09-07 18:26:34 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_available_phone_numbers_toll_free bucketObject parquet/airbyte 2022-09-07 18:26:34 destination > 2022-09-07 18:26:34 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_dependent_phone_numbers bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:35 destination > 2022-09-07 18:26:35 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:35 destination > 2022-09-07 18:26:35 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:35 destination > 2022-09-07 18:26:35 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:35 destination > 2022-09-07 18:26:35 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:35 destination > 2022-09-07 18:26:35 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:35 destination > 2022-09-07 18:26:35 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:35 destination > 2022-09-07 18:26:35 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:36 destination > 2022-09-07 18:26:36 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:36 destination > 2022-09-07 18:26:36 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:36 destination > 2022-09-07 18:26:36 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:36 destination > 2022-09-07 18:26:36 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_dependent_phone_numbers bucketObject parquet/airbyte 2022-09-07 18:26:36 destination > 2022-09-07 18:26:36 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_incoming_phone_numbers bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:36 destination > 2022-09-07 18:26:36 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:36 destination > 2022-09-07 18:26:36 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:36 destination > 2022-09-07 18:26:36 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:36 destination > 2022-09-07 18:26:36 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:36 destination > 2022-09-07 18:26:36 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:36 destination > 2022-09-07 18:26:36 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:37 destination > 2022-09-07 18:26:37 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:37 destination > 2022-09-07 18:26:37 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:37 destination > 2022-09-07 18:26:37 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:37 destination > 2022-09-07 18:26:37 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:37 destination > 2022-09-07 18:26:37 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_incoming_phone_numbers bucketObject parquet/airbyte 2022-09-07 18:26:37 destination > 2022-09-07 18:26:37 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_keys bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:37 destination > 2022-09-07 18:26:37 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:37 destination > 2022-09-07 18:26:37 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:37 destination > 2022-09-07 18:26:37 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:37 destination > 2022-09-07 18:26:37 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:38 destination > 2022-09-07 18:26:38 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:38 destination > 2022-09-07 18:26:38 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:38 destination > 2022-09-07 18:26:38 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:38 destination > 2022-09-07 18:26:38 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:38 destination > 2022-09-07 18:26:38 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:38 destination > 2022-09-07 18:26:38 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:38 destination > 2022-09-07 18:26:38 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_keys bucketObject parquet/airbyte 2022-09-07 18:26:38 destination > 2022-09-07 18:26:38 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_outgoing_caller_ids bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:38 destination > 2022-09-07 18:26:38 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:38 destination > 2022-09-07 18:26:38 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:38 destination > 2022-09-07 18:26:38 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:39 destination > 2022-09-07 18:26:39 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:39 destination > 2022-09-07 18:26:39 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:39 destination > 2022-09-07 18:26:39 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:39 destination > 2022-09-07 18:26:39 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:39 destination > 2022-09-07 18:26:39 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:39 destination > 2022-09-07 18:26:39 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:39 destination > 2022-09-07 18:26:39 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:39 destination > 2022-09-07 18:26:39 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_outgoing_caller_ids bucketObject parquet/airbyte 2022-09-07 18:26:39 destination > 2022-09-07 18:26:39 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):104 - Preparing storage area in destination completed. 2022-09-07 18:26:39 destination > 2022-09-07 18:26:39 WARN i.a.i.d.b.BufferedStreamConsumer(acceptTracked):145 - Unexpected message: TRACE 2022-09-07 18:26:39 destination > 2022-09-07 18:26:39 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):62 - Airbyte message consumer: succeeded. 2022-09-07 18:26:39 destination > 2022-09-07 18:26:39 INFO i.a.i.d.b.BufferedStreamConsumer(close):171 - executing on success close procedure. 2022-09-07 18:26:39 destination > 2022-09-07 18:26:39 INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):100 - Flushing all 0 current buffers (0 bytes in total) 2022-09-07 18:26:39 destination > 2022-09-07 18:26:39 INFO i.a.i.b.IntegrationRunner(runInternal):152 - Completed integration: io.airbyte.integrations.destination.s3.S3Destination 2022-09-07 18:26:40 ERROR i.a.w.g.DefaultReplicationWorker(run):184 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:177) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:65) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at java.lang.Thread.run(Thread.java:1589) [?:?] Suppressed: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:141) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:65) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at java.lang.Thread.run(Thread.java:1589) [?:?] Caused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:346) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:344) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] ... 1 more 2022-09-07 18:26:40 INFO i.a.w.g.DefaultReplicationWorker(run):249 - sync summary: io.airbyte.config.ReplicationAttemptSummary@583f4f5[status=failed,recordsSynced=0,bytesSynced=0,startTime=1662575185105,endTime=1662575200067,totalStats=io.airbyte.config.SyncStats@2f78af31[recordsEmitted=0,bytesEmitted=0,sourceStateMessagesEmitted=0,destinationStateMessagesEmitted=0,recordsCommitted=0,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,additionalProperties={}],streamStats=[]] 2022-09-07 18:26:40 INFO i.a.w.g.DefaultReplicationWorker(run):278 - Source did not output any state messages 2022-09-07 18:26:40 WARN i.a.w.g.DefaultReplicationWorker(run):286 - State capture: No new state, falling back on input state: io.airbyte.config.State@253fc16b[state={"calls":{"end_time":"2022-09-01T17:07:16Z"},"messages":{"date_sent":"2022-09-01T18:45:32Z"},"message_media":{"date_created":"2022-08-30T20:31:03Z"}}] 2022-09-07 18:26:40 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-09-07 18:26:40 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):165 - sync summary: io.airbyte.config.StandardSyncOutput@64bd67b8[standardSyncSummary=io.airbyte.config.StandardSyncSummary@3c269a6[status=failed,recordsSynced=0,bytesSynced=0,startTime=1662575185105,endTime=1662575200067,totalStats=io.airbyte.config.SyncStats@2f78af31[recordsEmitted=0,bytesEmitted=0,sourceStateMessagesEmitted=0,destinationStateMessagesEmitted=0,recordsCommitted=0,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,additionalProperties={}],streamStats=[]],normalizationSummary=,state=io.airbyte.config.State@253fc16b[state={"calls":{"end_time":"2022-09-01T17:07:16Z"},"messages":{"date_sent":"2022-09-01T18:45:32Z"},"message_media":{"date_created":"2022-08-30T20:31:03Z"}}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@62f7e75e[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@71fea113[stream=io.airbyte.protocol.models.AirbyteStream@7e718833[name=twilio_available_phone_number_countries,jsonSchema={"type":"object","properties":{"uri":{"type":["null","string"]},"beta":{"type":["null","boolean"]},"country":{"type":["null","string"]},"country_code":{"type":["null","string"]},"subresource_uris":{"type":["null","object"],"properties":{"local":{"type":["null","string"]},"mobile":{"type":["null","string"]},"toll_free":{"type":["null","string"]}},"additionalProperties":false}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@6e6e5102[stream=io.airbyte.protocol.models.AirbyteStream@337e9686[name=twilio_available_phone_numbers_local,jsonSchema={"type":"object","properties":{"beta":{"type":["null","boolean"]},"lata":{"type":["null","string"]},"region":{"type":["null","string"]},"latitude":{"type":["null","string"]},"locality":{"type":["null","string"]},"longitude":{"type":["null","string"]},"iso_country":{"type":["null","string"]},"postal_code":{"type":["null","string"]},"rate_center":{"type":["null","string"]},"capabilities":{"type":["null","object"],"properties":{"MMS":{"type":["null","boolean"]},"SMS":{"type":["null","boolean"]},"fax":{"type":["null","boolean"]},"voice":{"type":["null","boolean"]}},"additionalProperties":false},"phone_number":{"type":["null","string"]},"friendly_name":{"type":["null","string"]},"address_requirements":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@370c5fc3[stream=io.airbyte.protocol.models.AirbyteStream@45ce6901[name=twilio_available_phone_numbers_mobile,jsonSchema={"type":"object","properties":{"beta":{"type":["null","boolean"]},"lata":{"type":["null","string"]},"region":{"type":["null","string"]},"latitude":{"type":["null","string"]},"locality":{"type":["null","string"]},"longitude":{"type":["null","string"]},"iso_country":{"type":["null","string"]},"postal_code":{"type":["null","string"]},"rate_center":{"type":["null","string"]},"capabilities":{"type":["null","object"],"properties":{"MMS":{"type":["null","boolean"]},"SMS":{"type":["null","boolean"]},"fax":{"type":["null","boolean"]},"voice":{"type":["null","boolean"]}},"additionalProperties":false},"phone_number":{"type":["null","string"]},"friendly_name":{"type":["null","string"]},"address_requirements":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@59b4c6fb[stream=io.airbyte.protocol.models.AirbyteStream@1eb9b1ed[name=twilio_available_phone_numbers_toll_free,jsonSchema={"type":"object","properties":{"beta":{"type":["null","boolean"]},"lata":{"type":["null","string"]},"region":{"type":["null","string"]},"latitude":{"type":["null","string"]},"locality":{"type":["null","string"]},"longitude":{"type":["null","string"]},"iso_country":{"type":["null","string"]},"postal_code":{"type":["null","string"]},"rate_center":{"type":["null","string"]},"capabilities":{"type":["null","object"],"properties":{"MMS":{"type":["null","boolean"]},"SMS":{"type":["null","boolean"]},"fax":{"type":["null","boolean"]},"voice":{"type":["null","boolean"]}},"additionalProperties":false},"phone_number":{"type":["null","string"]},"friendly_name":{"type":["null","string"]},"address_requirements":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@4b9e07be[stream=io.airbyte.protocol.models.AirbyteStream@7d2ef9ad[name=twilio_calls,jsonSchema={"type":"object","properties":{"to":{"type":["null","string"]},"sid":{"type":["null","string"]},"uri":{"type":["null","string"]},"from":{"type":["null","string"]},"price":{"type":["null","number"]},"status":{"type":["null","string"]},"duration":{"type":["null","integer"]},"end_time":{"type":["null","string"],"format":"date-time"},"direction":{"type":["null","string"]},"group_sid":{"type":["null","string"]},"trunk_sid":{"type":["null","string"]},"annotation":{"type":["null","string"]},"price_unit":{"type":["null","string"]},"queue_time":{"type":["null","integer"]},"start_time":{"type":["null","string"],"format":"date-time"},"account_sid":{"type":["null","string"]},"answered_by":{"type":["null","string"]},"api_version":{"type":["null","string"]},"caller_name":{"type":["null","string"]},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"},"to_formatted":{"type":["null","string"]},"forwarded_from":{"type":["null","string"]},"from_formatted":{"type":["null","string"]},"parent_call_sid":{"type":["null","string"]},"phone_number_sid":{"type":["null","string"]},"subresource_uris":{"type":["null","object"],"properties":{"events":{"type":["null","string"]},"siprec":{"type":["null","string"]},"feedback":{"type":["null","string"]},"payments":{"type":["null","string"]},"recordings":{"type":["null","string"]},"notifications":{"type":["null","string"]},"feedback_summaries":{"type":["null","string"]}},"additionalProperties":false}},"additionalProperties":false},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[end_time],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[end_time],destinationSyncMode=append,primaryKey=[[sid]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@2d27bed[stream=io.airbyte.protocol.models.AirbyteStream@51378483[name=twilio_dependent_phone_numbers,jsonSchema={"type":"object","properties":{"sid":{"type":["null","string"]},"uri":{"type":["null","string"]},"sms_url":{"type":["null","string"]},"trunk_sid":{"type":["null","string"]},"voice_url":{"type":["null","string"]},"sms_method":{"type":["null","string"]},"account_sid":{"type":["null","string"]},"api_version":{"type":["null","string"]},"capabilities":{"type":["null","object"],"properties":{"MMS":{"type":["null","boolean"]},"SMS":{"type":["null","boolean"]},"Voice":{"type":["null","boolean"]}},"additionalProperties":false},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"},"phone_number":{"type":["null","string"]},"voice_method":{"type":["null","string"]},"friendly_name":{"type":["null","string"]},"status_callback":{"type":["null","string"]},"emergency_status":{"type":["null","string"]},"sms_fallback_url":{"type":["null","string"]},"voice_fallback_url":{"type":["null","string"]},"sms_application_sid":{"type":["null","string"]},"sms_fallback_method":{"type":["null","string"]},"address_requirements":{"type":["null","string"]},"emergency_address_sid":{"type":["null","string"]},"voice_application_sid":{"type":["null","string"]},"voice_fallback_method":{"type":["null","string"]},"status_callback_method":{"type":["null","string"]},"voice_caller_id_lookup":{"type":["null","boolean"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[sid]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@6aafdaec[stream=io.airbyte.protocol.models.AirbyteStream@60c6a585[name=twilio_incoming_phone_numbers,jsonSchema={"type":"object","properties":{"sid":{"type":["null","string"]},"uri":{"type":["null","string"]},"beta":{"type":["null","boolean"]},"origin":{"type":["null","string"]},"status":{"type":["null","string"]},"sms_url":{"type":["null","string"]},"trunk_sid":{"type":["null","string"]},"voice_url":{"type":["null","string"]},"bundle_sid":{"type":["null","string"]},"sms_method":{"type":["null","string"]},"account_sid":{"type":["null","string"]},"address_sid":{"type":["null","string"]},"api_version":{"type":["null","string"]},"capabilities":{"type":["null","object"],"properties":{"fax":{"type":["null","boolean"]},"mms":{"type":["null","boolean"]},"sms":{"type":["null","boolean"]},"voice":{"type":["null","boolean"]}},"additionalProperties":false},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"},"identity_sid":{"type":["null","string"]},"phone_number":{"type":["null","string"]},"voice_method":{"type":["null","string"]},"friendly_name":{"type":["null","string"]},"status_callback":{"type":["null","string"]},"emergency_status":{"type":["null","string"]},"sms_fallback_url":{"type":["null","string"]},"voice_fallback_url":{"type":["null","string"]},"voice_receive_mode":{"type":["null","string"]},"sms_application_sid":{"type":["null","string"]},"sms_fallback_method":{"type":["null","string"]},"address_requirements":{"type":["null","string"]},"emergency_address_sid":{"type":["null","string"]},"voice_application_sid":{"type":["null","string"]},"voice_fallback_method":{"type":["null","string"]},"status_callback_method":{"type":["null","string"]},"voice_caller_id_lookup":{"type":["null","boolean"]},"emergency_address_status":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[sid]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@71daa763[stream=io.airbyte.protocol.models.AirbyteStream@1c243647[name=twilio_keys,jsonSchema={"type":"object","properties":{"sid":{"type":["null","string"]},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"},"friendly_name":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[sid]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@848f795[stream=io.airbyte.protocol.models.AirbyteStream@5d779194[name=twilio_message_media,jsonSchema={"type":"object","properties":{"sid":{"type":["null","string"]},"uri":{"type":["null","string"]},"parent_sid":{"type":["null","string"]},"account_sid":{"type":["null","string"]},"content_type":{"type":["null","string"]},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"}},"additionalProperties":false},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[date_created],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[date_created],destinationSyncMode=append,primaryKey=[[sid]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@79b2d4e6[stream=io.airbyte.protocol.models.AirbyteStream@44195399[name=twilio_messages,jsonSchema={"type":"object","properties":{"to":{"type":["null","string"]},"sid":{"type":["null","string"]},"uri":{"type":["null","string"]},"body":{"type":["null","string"]},"from":{"type":["null","string"]},"price":{"type":["null","number"]},"status":{"type":["null","string"]},"date_sent":{"type":["null","string"],"format":"date-time"},"direction":{"type":["null","string"]},"num_media":{"type":["null","integer"]},"error_code":{"type":["null","string"]},"price_unit":{"type":["null","string"]},"account_sid":{"type":["null","string"]},"api_version":{"type":["null","string"]},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"},"num_segments":{"type":["null","integer"]},"error_message":{"type":["null","string"]},"subresource_uris":{"type":["null","object"],"properties":{"media":{"type":["null","string"]},"feedback":{"type":["null","string"]}},"additionalProperties":false},"messaging_service_sid":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[date_sent],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[date_sent],destinationSyncMode=append,primaryKey=[[sid]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@ba2e0d0[stream=io.airbyte.protocol.models.AirbyteStream@6a383b01[name=twilio_outgoing_caller_ids,jsonSchema={"type":"object","properties":{"sid":{"type":["null","string"]},"uri":{"type":["null","string"]},"account_sid":{"type":["null","string"]},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"},"phone_number":{"type":["null","string"]},"friendly_name":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[sid]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@542d744[failureOrigin=source,failureType=system_error,internalMessage='lookback_window',externalMessage=Something went wrong in the connector. See the logs for more details.,metadata=io.airbyte.config.Metadata@bc9d9ee[additionalProperties={attemptNumber=1, jobId=2459, from_trace_message=true, connector_command=read}],stacktrace=Traceback (most recent call last): File "/airbyte/integration_code/main.py", line 13, in launch(source, sys.argv[1:]) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 123, in launch for message in source_entrypoint.run(parsed_args): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 114, in run for message in generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 102, in read stream_instances = {s.name: s for s in self.streams(config)} File "/airbyte/integration_code/source_twilio/source.py", line 71, in streams "lookback_window": config["lookback_window"], KeyError: 'lookback_window' ,retryable=,timestamp=1662575186361], io.airbyte.config.FailureReason@17f10c27[failureOrigin=source,failureType=,internalMessage=io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped!,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@3c3addeb[additionalProperties={attemptNumber=1, jobId=2459, connector_command=read}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) at java.base/java.lang.Thread.run(Thread.java:1589) Caused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:346) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140) at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:344) ... 4 more ,retryable=,timestamp=1662575186589]]] 2022-09-07 18:26:40 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):312 - Stopping temporal heartbeating... 2022-09-07 18:26:40 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.format_type: does not have a value in the enumeration [Avro], $.compression_codec: string found, object expected, $.compression_codec: should be valid to one and only one of the schemas 2022-09-07 18:26:40 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.flattening: is missing but it is required, $.format_type: does not have a value in the enumeration [CSV] 2022-09-07 18:26:40 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.format_type: does not have a value in the enumeration [JSONL] 2022-09-07 18:26:40 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/2459/2/logs.log 2022-09-07 18:26:40 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.40.3 2022-09-07 18:26:40 INFO i.a.c.i.LineGobbler(voidCall):83 - Checking if airbyte/source-twilio:0.1.8 exists... 2022-09-07 18:26:41 INFO i.a.c.i.LineGobbler(voidCall):83 - airbyte/source-twilio:0.1.8 was found locally. 2022-09-07 18:26:41 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 2459 2022-09-07 18:26:41 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/2459/2 --log-driver none --name source-twilio-check-2459-2-kauve --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/source-twilio:0.1.8 -e WORKER_JOB_ATTEMPT=2 -e AIRBYTE_VERSION=0.40.3 -e WORKER_JOB_ID=2459 airbyte/source-twilio:0.1.8 check --config source_config.json 2022-09-07 18:26:41 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):99 - Check succeeded 2022-09-07 18:26:42 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-09-07 18:26:42 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/2459/2/logs.log 2022-09-07 18:26:42 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.40.3 2022-09-07 18:26:42 INFO i.a.c.i.LineGobbler(voidCall):83 - Checking if airbyte/destination-s3:0.3.15 exists... 2022-09-07 18:26:42 INFO i.a.c.i.LineGobbler(voidCall):83 - airbyte/destination-s3:0.3.15 was found locally. 2022-09-07 18:26:42 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 2459 2022-09-07 18:26:42 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/2459/2 --log-driver none --name destination-s3-check-2459-2-zvjfs --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/destination-s3:0.3.15 -e WORKER_JOB_ATTEMPT=2 -e AIRBYTE_VERSION=0.40.3 -e WORKER_JOB_ID=2459 airbyte/destination-s3:0.3.15 check --config source_config.json 2022-09-07 18:26:44 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:44 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-09-07 18:26:44 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:44 INFO i.a.i.b.IntegrationRunner(runInternal):104 - Running integration: io.airbyte.integrations.destination.s3.S3Destination 2022-09-07 18:26:44 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:44 INFO i.a.i.b.IntegrationRunner(runInternal):105 - Command: CHECK 2022-09-07 18:26:44 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:44 INFO i.a.i.b.IntegrationRunner(runInternal):106 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-09-07 18:26:44 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:44 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:44 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:44 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:44 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:44 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:44 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:44 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword requires - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:44 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:44 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"Parquet","page_size_kb":1024,"block_size_mb":128,"compression_codec":"UNCOMPRESSED","dictionary_encoding":true,"max_padding_size_mb":8,"dictionary_page_size_kb":1024} 2022-09-07 18:26:44 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:44 INFO i.a.i.d.s.S3DestinationConfig(createS3Client):190 - Creating S3 client... 2022-09-07 18:26:45 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:45 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):102 - Storage Object hdp-integrations-929559537045/parquet/airbyte does not exist in bucket; creating... 2022-09-07 18:26:45 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:45 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):104 - Storage Object hdp-integrations-929559537045/parquet/airbyte has been created in bucket. 2022-09-07 18:26:45 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:45 INFO i.a.i.d.s.S3Destination(testIAMUserHasListObjectPermission):156 - Started testing if IAM user can call listObjects on the destination bucket 2022-09-07 18:26:45 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:45 INFO i.a.i.d.s.S3Destination(testIAMUserHasListObjectPermission):159 - Finished checking for listObjects permission 2022-09-07 18:26:45 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:45 INFO i.a.i.d.s.S3Destination(testSingleUpload):81 - Started testing if all required credentials assigned to user for single file uploading 2022-09-07 18:26:45 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:45 INFO i.a.i.d.s.S3Destination(testSingleUpload):91 - Finished checking for normal upload mode 2022-09-07 18:26:45 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:45 INFO i.a.i.d.s.S3Destination(testMultipartUpload):95 - Started testing if all required credentials assigned to user for multipart upload 2022-09-07 18:26:45 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:45 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to hdp-integrations-929559537045/parquet/airbyte/test_1662575205750 with full ID Fx_gkhZA.8FMDLI1Nph1.HgZPQEck.Kesu5mZrDztaqGfDIYA0UnUYdhWEgKDd1dkOnaGsQGH9Bako6LW4zGvzfuA24ekqn.N7q786LelCKWDazn_1BJpE5nWKUaCyq_ 2022-09-07 18:26:45 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:45 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-09-07 18:26:45 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:45 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-09-07 18:26:45 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:45 WARN a.m.s.MultiPartOutputStream(close):160 - [MultipartOutputStream for parts 1 - 10000] is already closed 2022-09-07 18:26:45 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:45 INFO a.m.s.StreamTransferManager(complete):367 - [Manager uploading to hdp-integrations-929559537045/parquet/airbyte/test_1662575205750 with id Fx_gkhZA....nWKUaCyq_]: Uploading leftover stream [Part number 1 containing 3.34 MB] 2022-09-07 18:26:46 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:46 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to hdp-integrations-929559537045/parquet/airbyte/test_1662575205750 with id Fx_gkhZA....nWKUaCyq_]: Finished uploading [Part number 1 containing 3.34 MB] 2022-09-07 18:26:46 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:46 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to hdp-integrations-929559537045/parquet/airbyte/test_1662575205750 with id Fx_gkhZA....nWKUaCyq_]: Completed 2022-09-07 18:26:46 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:46 INFO i.a.i.d.s.S3Destination(testMultipartUpload):119 - Finished verification for multipart upload mode 2022-09-07 18:26:46 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-09-07 18:26:46 INFO i.a.i.b.IntegrationRunner(runInternal):152 - Completed integration: io.airbyte.integrations.destination.s3.S3Destination 2022-09-07 18:26:46 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-09-07 18:26:46 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/2459/2/logs.log 2022-09-07 18:26:46 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.40.3 2022-09-07 18:26:46 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):49 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-09-07 18:26:46 INFO i.a.c.EnvConfigs(getEnvOrDefault):1002 - Using default value for environment variable METRIC_CLIENT: '' 2022-09-07 18:26:46 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2022-09-07 18:26:46 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):49 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-09-07 18:26:46 INFO i.a.w.g.DefaultReplicationWorker(run):119 - start sync worker. job id: 2459 attempt id: 2 2022-09-07 18:26:46 INFO i.a.w.g.DefaultReplicationWorker(run):131 - configured sync modes: {null.dependent_phone_numbers=full_refresh - overwrite, null.available_phone_numbers_mobile=full_refresh - overwrite, null.outgoing_caller_ids=full_refresh - overwrite, null.available_phone_numbers_toll_free=full_refresh - overwrite, null.available_phone_number_countries=full_refresh - overwrite, null.messages=incremental - append, null.calls=incremental - append, null.keys=full_refresh - overwrite, null.message_media=incremental - append, null.available_phone_numbers_local=full_refresh - overwrite, null.incoming_phone_numbers=full_refresh - overwrite} 2022-09-07 18:26:46 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-09-07 18:26:46 INFO i.a.c.i.LineGobbler(voidCall):83 - Checking if airbyte/destination-s3:0.3.15 exists... 2022-09-07 18:26:46 INFO i.a.c.i.LineGobbler(voidCall):83 - airbyte/destination-s3:0.3.15 was found locally. 2022-09-07 18:26:46 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 2459 2022-09-07 18:26:46 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/2459/2 --log-driver none --name destination-s3-write-2459-2-vaimq --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/destination-s3:0.3.15 -e WORKER_JOB_ATTEMPT=2 -e AIRBYTE_VERSION=0.40.3 -e WORKER_JOB_ID=2459 airbyte/destination-s3:0.3.15 write --config destination_config.json --catalog destination_catalog.json 2022-09-07 18:26:46 INFO i.a.c.i.LineGobbler(voidCall):83 - Checking if airbyte/source-twilio:0.1.8 exists... 2022-09-07 18:26:46 INFO i.a.c.i.LineGobbler(voidCall):83 - airbyte/source-twilio:0.1.8 was found locally. 2022-09-07 18:26:46 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 2459 2022-09-07 18:26:46 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/2459/2 --log-driver none --name source-twilio-read-2459-2-twudu --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/source-twilio:0.1.8 -e WORKER_JOB_ATTEMPT=2 -e AIRBYTE_VERSION=0.40.3 -e WORKER_JOB_ID=2459 airbyte/source-twilio:0.1.8 read --config source_config.json --catalog source_catalog.json --state input_state.json 2022-09-07 18:26:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):421 - Destination output thread started. 2022-09-07 18:26:46 INFO i.a.w.g.DefaultReplicationWorker(run):173 - Waiting for source and destination threads to complete. 2022-09-07 18:26:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):313 - Replication thread started. 2022-09-07 18:26:47 source > Starting syncing SourceTwilio 2022-09-07 18:26:47 source > 'lookback_window' Traceback (most recent call last): File "/airbyte/integration_code/main.py", line 13, in launch(source, sys.argv[1:]) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 123, in launch for message in source_entrypoint.run(parsed_args): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 114, in run for message in generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 102, in read stream_instances = {s.name: s for s in self.streams(config)} File "/airbyte/integration_code/source_twilio/source.py", line 71, in streams "lookback_window": config["lookback_window"], KeyError: 'lookback_window' 2022-09-07 18:26:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):342 - Source has no more messages, closing connection. 2022-09-07 18:26:49 destination > 2022-09-07 18:26:49 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-09-07 18:26:49 destination > 2022-09-07 18:26:49 INFO i.a.i.b.IntegrationRunner(runInternal):104 - Running integration: io.airbyte.integrations.destination.s3.S3Destination 2022-09-07 18:26:49 destination > 2022-09-07 18:26:49 INFO i.a.i.b.IntegrationRunner(runInternal):105 - Command: WRITE 2022-09-07 18:26:49 destination > 2022-09-07 18:26:49 INFO i.a.i.b.IntegrationRunner(runInternal):106 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-09-07 18:26:49 destination > 2022-09-07 18:26:49 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:49 destination > 2022-09-07 18:26:49 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:49 destination > 2022-09-07 18:26:49 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:49 destination > 2022-09-07 18:26:49 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword requires - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-07 18:26:49 destination > 2022-09-07 18:26:49 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"Parquet","page_size_kb":1024,"block_size_mb":128,"compression_codec":"UNCOMPRESSED","dictionary_encoding":true,"max_padding_size_mb":8,"dictionary_page_size_kb":1024} 2022-09-07 18:26:49 destination > 2022-09-07 18:26:49 INFO i.a.i.d.s.S3DestinationConfig(createS3Client):190 - Creating S3 client... 2022-09-07 18:26:50 destination > 2022-09-07 18:26:50 INFO i.a.i.d.s.SerializedBufferFactory(getCreateFunction):49 - S3 format config: S3ParquetFormatConfig{compressionCodec=UNCOMPRESSED, blockSize=134217728, maxPaddingSize=8388608, pageSize=1048576, dictionaryPageSize=1048576, dictionaryEncoding=true, } 2022-09-07 18:26:50 destination > 2022-09-07 18:26:50 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_available_phone_number_countries, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_available_phone_number_countries/2022_09_07_1662575209525_, syncMode=overwrite} 2022-09-07 18:26:50 destination > 2022-09-07 18:26:50 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_available_phone_numbers_local, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_available_phone_numbers_local/2022_09_07_1662575209525_, syncMode=overwrite} 2022-09-07 18:26:50 destination > 2022-09-07 18:26:50 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_available_phone_numbers_mobile, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_available_phone_numbers_mobile/2022_09_07_1662575209525_, syncMode=overwrite} 2022-09-07 18:26:50 destination > 2022-09-07 18:26:50 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_available_phone_numbers_toll_free, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_available_phone_numbers_toll_free/2022_09_07_1662575209525_, syncMode=overwrite} 2022-09-07 18:26:50 destination > 2022-09-07 18:26:50 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_calls, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_calls/2022_09_07_1662575209525_, syncMode=append} 2022-09-07 18:26:50 destination > 2022-09-07 18:26:50 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_dependent_phone_numbers, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_dependent_phone_numbers/2022_09_07_1662575209525_, syncMode=overwrite} 2022-09-07 18:26:50 destination > 2022-09-07 18:26:50 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_incoming_phone_numbers, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_incoming_phone_numbers/2022_09_07_1662575209525_, syncMode=overwrite} 2022-09-07 18:26:50 destination > 2022-09-07 18:26:50 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_keys, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_keys/2022_09_07_1662575209525_, syncMode=overwrite} 2022-09-07 18:26:50 destination > 2022-09-07 18:26:50 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_message_media, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_message_media/2022_09_07_1662575209525_, syncMode=append} 2022-09-07 18:26:50 destination > 2022-09-07 18:26:50 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_messages, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_messages/2022_09_07_1662575209525_, syncMode=append} 2022-09-07 18:26:50 destination > 2022-09-07 18:26:50 INFO i.a.i.d.s.S3ConsumerFactory(lambda$toWriteConfig$0):83 - Write config: WriteConfig{streamName=twilio_outgoing_caller_ids, namespace=null, outputBucketPath=parquet/airbyte, pathFormat=parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=parquet/airbyte/twilio_outgoing_caller_ids/2022_09_07_1662575209525_, syncMode=overwrite} 2022-09-07 18:26:50 destination > 2022-09-07 18:26:50 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2022-09-07 18:26:50 destination > 2022-09-07 18:26:50 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):90 - Preparing bucket in destination started for 11 streams 2022-09-07 18:26:50 destination > 2022-09-07 18:26:50 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_available_phone_number_countries bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:50 destination > 2022-09-07 18:26:50 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:51 destination > 2022-09-07 18:26:51 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:51 destination > 2022-09-07 18:26:51 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:51 destination > 2022-09-07 18:26:51 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:51 destination > 2022-09-07 18:26:51 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:51 destination > 2022-09-07 18:26:51 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:52 destination > 2022-09-07 18:26:52 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:52 destination > 2022-09-07 18:26:52 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:52 destination > 2022-09-07 18:26:52 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:52 destination > 2022-09-07 18:26:52 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_number_countries/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:52 destination > 2022-09-07 18:26:52 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_available_phone_number_countries bucketObject parquet/airbyte 2022-09-07 18:26:52 destination > 2022-09-07 18:26:52 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_available_phone_numbers_local bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:52 destination > 2022-09-07 18:26:52 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:52 destination > 2022-09-07 18:26:52 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:52 destination > 2022-09-07 18:26:52 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:53 destination > 2022-09-07 18:26:53 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:53 destination > 2022-09-07 18:26:53 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:53 destination > 2022-09-07 18:26:53 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:53 destination > 2022-09-07 18:26:53 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:53 destination > 2022-09-07 18:26:53 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:53 destination > 2022-09-07 18:26:53 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:53 destination > 2022-09-07 18:26:53 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_local/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:53 destination > 2022-09-07 18:26:53 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_available_phone_numbers_local bucketObject parquet/airbyte 2022-09-07 18:26:53 destination > 2022-09-07 18:26:53 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_available_phone_numbers_mobile bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:53 destination > 2022-09-07 18:26:53 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:54 destination > 2022-09-07 18:26:54 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:54 destination > 2022-09-07 18:26:54 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:54 destination > 2022-09-07 18:26:54 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:54 destination > 2022-09-07 18:26:54 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:54 destination > 2022-09-07 18:26:54 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:54 destination > 2022-09-07 18:26:54 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:54 destination > 2022-09-07 18:26:54 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:55 destination > 2022-09-07 18:26:55 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:55 destination > 2022-09-07 18:26:55 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_mobile/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:55 destination > 2022-09-07 18:26:55 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_available_phone_numbers_mobile bucketObject parquet/airbyte 2022-09-07 18:26:55 destination > 2022-09-07 18:26:55 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_available_phone_numbers_toll_free bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:55 destination > 2022-09-07 18:26:55 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:55 destination > 2022-09-07 18:26:55 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:55 destination > 2022-09-07 18:26:55 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:55 destination > 2022-09-07 18:26:55 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:55 destination > 2022-09-07 18:26:55 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:55 destination > 2022-09-07 18:26:55 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:56 destination > 2022-09-07 18:26:56 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:56 destination > 2022-09-07 18:26:56 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:56 destination > 2022-09-07 18:26:56 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:56 destination > 2022-09-07 18:26:56 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_available_phone_numbers_toll_free/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:56 destination > 2022-09-07 18:26:56 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_available_phone_numbers_toll_free bucketObject parquet/airbyte 2022-09-07 18:26:56 destination > 2022-09-07 18:26:56 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_dependent_phone_numbers bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:56 destination > 2022-09-07 18:26:56 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:56 destination > 2022-09-07 18:26:56 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:56 destination > 2022-09-07 18:26:56 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:56 destination > 2022-09-07 18:26:56 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:56 destination > 2022-09-07 18:26:56 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:57 destination > 2022-09-07 18:26:57 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:57 destination > 2022-09-07 18:26:57 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:57 destination > 2022-09-07 18:26:57 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:57 destination > 2022-09-07 18:26:57 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:57 destination > 2022-09-07 18:26:57 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_dependent_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:57 destination > 2022-09-07 18:26:57 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_dependent_phone_numbers bucketObject parquet/airbyte 2022-09-07 18:26:57 destination > 2022-09-07 18:26:57 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_incoming_phone_numbers bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:57 destination > 2022-09-07 18:26:57 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:57 destination > 2022-09-07 18:26:57 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:57 destination > 2022-09-07 18:26:57 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:58 destination > 2022-09-07 18:26:58 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:58 destination > 2022-09-07 18:26:58 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:58 destination > 2022-09-07 18:26:58 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:58 destination > 2022-09-07 18:26:58 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:58 destination > 2022-09-07 18:26:58 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:58 destination > 2022-09-07 18:26:58 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:58 destination > 2022-09-07 18:26:58 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_incoming_phone_numbers/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:58 destination > 2022-09-07 18:26:58 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_incoming_phone_numbers bucketObject parquet/airbyte 2022-09-07 18:26:58 destination > 2022-09-07 18:26:58 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_keys bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:26:58 destination > 2022-09-07 18:26:58 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:59 destination > 2022-09-07 18:26:59 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:59 destination > 2022-09-07 18:26:59 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:59 destination > 2022-09-07 18:26:59 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:59 destination > 2022-09-07 18:26:59 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:59 destination > 2022-09-07 18:26:59 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:59 destination > 2022-09-07 18:26:59 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:59 destination > 2022-09-07 18:26:59 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:59 destination > 2022-09-07 18:26:59 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:59 destination > 2022-09-07 18:26:59 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_keys/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:26:59 destination > 2022-09-07 18:26:59 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_keys bucketObject parquet/airbyte 2022-09-07 18:26:59 destination > 2022-09-07 18:26:59 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):97 - Clearing storage area in destination started for namespace null stream twilio_outgoing_caller_ids bucketObject parquet/airbyte pathFormat parquet/airbyte/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2022-09-07 18:27:00 destination > 2022-09-07 18:27:00 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:27:00 destination > 2022-09-07 18:27:00 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:27:00 destination > 2022-09-07 18:27:00 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:27:00 destination > 2022-09-07 18:27:00 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:27:00 destination > 2022-09-07 18:27:00 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:27:00 destination > 2022-09-07 18:27:00 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:27:00 destination > 2022-09-07 18:27:00 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:27:00 destination > 2022-09-07 18:27:00 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:27:01 destination > 2022-09-07 18:27:01 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:27:01 destination > 2022-09-07 18:27:01 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):250 - Storage bucket parquet/airbyte has been cleaned-up (0 objects matching parquet/airbyte/twilio_outgoing_caller_ids/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2022-09-07 18:27:01 destination > 2022-09-07 18:27:01 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):100 - Clearing storage area in destination completed for namespace null stream twilio_outgoing_caller_ids bucketObject parquet/airbyte 2022-09-07 18:27:01 destination > 2022-09-07 18:27:01 INFO i.a.i.d.s.S3ConsumerFactory(lambda$onStartFunction$1):104 - Preparing storage area in destination completed. 2022-09-07 18:27:01 destination > 2022-09-07 18:27:01 WARN i.a.i.d.b.BufferedStreamConsumer(acceptTracked):145 - Unexpected message: TRACE 2022-09-07 18:27:01 destination > 2022-09-07 18:27:01 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):62 - Airbyte message consumer: succeeded. 2022-09-07 18:27:01 destination > 2022-09-07 18:27:01 INFO i.a.i.d.b.BufferedStreamConsumer(close):171 - executing on success close procedure. 2022-09-07 18:27:01 destination > 2022-09-07 18:27:01 INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):100 - Flushing all 0 current buffers (0 bytes in total) 2022-09-07 18:27:01 destination > 2022-09-07 18:27:01 INFO i.a.i.b.IntegrationRunner(runInternal):152 - Completed integration: io.airbyte.integrations.destination.s3.S3Destination 2022-09-07 18:27:01 ERROR i.a.w.g.DefaultReplicationWorker(run):184 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:177) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:65) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at java.lang.Thread.run(Thread.java:1589) [?:?] Suppressed: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:141) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:65) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:155) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at java.lang.Thread.run(Thread.java:1589) [?:?] Caused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:346) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:344) ~[io.airbyte-airbyte-workers-0.40.3.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] ... 1 more 2022-09-07 18:27:01 INFO i.a.w.g.DefaultReplicationWorker(run):249 - sync summary: io.airbyte.config.ReplicationAttemptSummary@1fe9e800[status=failed,recordsSynced=0,bytesSynced=0,startTime=1662575206622,endTime=1662575221402,totalStats=io.airbyte.config.SyncStats@67df7232[recordsEmitted=0,bytesEmitted=0,sourceStateMessagesEmitted=0,destinationStateMessagesEmitted=0,recordsCommitted=0,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,additionalProperties={}],streamStats=[]] 2022-09-07 18:27:01 INFO i.a.w.g.DefaultReplicationWorker(run):278 - Source did not output any state messages 2022-09-07 18:27:01 WARN i.a.w.g.DefaultReplicationWorker(run):286 - State capture: No new state, falling back on input state: io.airbyte.config.State@5afe060[state={"calls":{"end_time":"2022-09-01T17:07:16Z"},"messages":{"date_sent":"2022-09-01T18:45:32Z"},"message_media":{"date_created":"2022-08-30T20:31:03Z"}}] 2022-09-07 18:27:01 INFO i.a.w.t.TemporalAttemptExecution(get):131 - Stopping cancellation check scheduling... 2022-09-07 18:27:01 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):165 - sync summary: io.airbyte.config.StandardSyncOutput@32800efc[standardSyncSummary=io.airbyte.config.StandardSyncSummary@43b7ee1[status=failed,recordsSynced=0,bytesSynced=0,startTime=1662575206622,endTime=1662575221402,totalStats=io.airbyte.config.SyncStats@67df7232[recordsEmitted=0,bytesEmitted=0,sourceStateMessagesEmitted=0,destinationStateMessagesEmitted=0,recordsCommitted=0,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,additionalProperties={}],streamStats=[]],normalizationSummary=,state=io.airbyte.config.State@5afe060[state={"calls":{"end_time":"2022-09-01T17:07:16Z"},"messages":{"date_sent":"2022-09-01T18:45:32Z"},"message_media":{"date_created":"2022-08-30T20:31:03Z"}}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@6a72f0c[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@61fec8d0[stream=io.airbyte.protocol.models.AirbyteStream@533bddfd[name=twilio_available_phone_number_countries,jsonSchema={"type":"object","properties":{"uri":{"type":["null","string"]},"beta":{"type":["null","boolean"]},"country":{"type":["null","string"]},"country_code":{"type":["null","string"]},"subresource_uris":{"type":["null","object"],"properties":{"local":{"type":["null","string"]},"mobile":{"type":["null","string"]},"toll_free":{"type":["null","string"]}},"additionalProperties":false}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@c286d0d[stream=io.airbyte.protocol.models.AirbyteStream@33c8eccb[name=twilio_available_phone_numbers_local,jsonSchema={"type":"object","properties":{"beta":{"type":["null","boolean"]},"lata":{"type":["null","string"]},"region":{"type":["null","string"]},"latitude":{"type":["null","string"]},"locality":{"type":["null","string"]},"longitude":{"type":["null","string"]},"iso_country":{"type":["null","string"]},"postal_code":{"type":["null","string"]},"rate_center":{"type":["null","string"]},"capabilities":{"type":["null","object"],"properties":{"MMS":{"type":["null","boolean"]},"SMS":{"type":["null","boolean"]},"fax":{"type":["null","boolean"]},"voice":{"type":["null","boolean"]}},"additionalProperties":false},"phone_number":{"type":["null","string"]},"friendly_name":{"type":["null","string"]},"address_requirements":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@24e70a2a[stream=io.airbyte.protocol.models.AirbyteStream@29beef7e[name=twilio_available_phone_numbers_mobile,jsonSchema={"type":"object","properties":{"beta":{"type":["null","boolean"]},"lata":{"type":["null","string"]},"region":{"type":["null","string"]},"latitude":{"type":["null","string"]},"locality":{"type":["null","string"]},"longitude":{"type":["null","string"]},"iso_country":{"type":["null","string"]},"postal_code":{"type":["null","string"]},"rate_center":{"type":["null","string"]},"capabilities":{"type":["null","object"],"properties":{"MMS":{"type":["null","boolean"]},"SMS":{"type":["null","boolean"]},"fax":{"type":["null","boolean"]},"voice":{"type":["null","boolean"]}},"additionalProperties":false},"phone_number":{"type":["null","string"]},"friendly_name":{"type":["null","string"]},"address_requirements":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@6631bf41[stream=io.airbyte.protocol.models.AirbyteStream@126ba9f8[name=twilio_available_phone_numbers_toll_free,jsonSchema={"type":"object","properties":{"beta":{"type":["null","boolean"]},"lata":{"type":["null","string"]},"region":{"type":["null","string"]},"latitude":{"type":["null","string"]},"locality":{"type":["null","string"]},"longitude":{"type":["null","string"]},"iso_country":{"type":["null","string"]},"postal_code":{"type":["null","string"]},"rate_center":{"type":["null","string"]},"capabilities":{"type":["null","object"],"properties":{"MMS":{"type":["null","boolean"]},"SMS":{"type":["null","boolean"]},"fax":{"type":["null","boolean"]},"voice":{"type":["null","boolean"]}},"additionalProperties":false},"phone_number":{"type":["null","string"]},"friendly_name":{"type":["null","string"]},"address_requirements":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@ec157c5[stream=io.airbyte.protocol.models.AirbyteStream@505a9c7c[name=twilio_calls,jsonSchema={"type":"object","properties":{"to":{"type":["null","string"]},"sid":{"type":["null","string"]},"uri":{"type":["null","string"]},"from":{"type":["null","string"]},"price":{"type":["null","number"]},"status":{"type":["null","string"]},"duration":{"type":["null","integer"]},"end_time":{"type":["null","string"],"format":"date-time"},"direction":{"type":["null","string"]},"group_sid":{"type":["null","string"]},"trunk_sid":{"type":["null","string"]},"annotation":{"type":["null","string"]},"price_unit":{"type":["null","string"]},"queue_time":{"type":["null","integer"]},"start_time":{"type":["null","string"],"format":"date-time"},"account_sid":{"type":["null","string"]},"answered_by":{"type":["null","string"]},"api_version":{"type":["null","string"]},"caller_name":{"type":["null","string"]},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"},"to_formatted":{"type":["null","string"]},"forwarded_from":{"type":["null","string"]},"from_formatted":{"type":["null","string"]},"parent_call_sid":{"type":["null","string"]},"phone_number_sid":{"type":["null","string"]},"subresource_uris":{"type":["null","object"],"properties":{"events":{"type":["null","string"]},"siprec":{"type":["null","string"]},"feedback":{"type":["null","string"]},"payments":{"type":["null","string"]},"recordings":{"type":["null","string"]},"notifications":{"type":["null","string"]},"feedback_summaries":{"type":["null","string"]}},"additionalProperties":false}},"additionalProperties":false},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[end_time],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[end_time],destinationSyncMode=append,primaryKey=[[sid]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@3b7afa81[stream=io.airbyte.protocol.models.AirbyteStream@7491b07f[name=twilio_dependent_phone_numbers,jsonSchema={"type":"object","properties":{"sid":{"type":["null","string"]},"uri":{"type":["null","string"]},"sms_url":{"type":["null","string"]},"trunk_sid":{"type":["null","string"]},"voice_url":{"type":["null","string"]},"sms_method":{"type":["null","string"]},"account_sid":{"type":["null","string"]},"api_version":{"type":["null","string"]},"capabilities":{"type":["null","object"],"properties":{"MMS":{"type":["null","boolean"]},"SMS":{"type":["null","boolean"]},"Voice":{"type":["null","boolean"]}},"additionalProperties":false},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"},"phone_number":{"type":["null","string"]},"voice_method":{"type":["null","string"]},"friendly_name":{"type":["null","string"]},"status_callback":{"type":["null","string"]},"emergency_status":{"type":["null","string"]},"sms_fallback_url":{"type":["null","string"]},"voice_fallback_url":{"type":["null","string"]},"sms_application_sid":{"type":["null","string"]},"sms_fallback_method":{"type":["null","string"]},"address_requirements":{"type":["null","string"]},"emergency_address_sid":{"type":["null","string"]},"voice_application_sid":{"type":["null","string"]},"voice_fallback_method":{"type":["null","string"]},"status_callback_method":{"type":["null","string"]},"voice_caller_id_lookup":{"type":["null","boolean"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[sid]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@706aae57[stream=io.airbyte.protocol.models.AirbyteStream@74d7655a[name=twilio_incoming_phone_numbers,jsonSchema={"type":"object","properties":{"sid":{"type":["null","string"]},"uri":{"type":["null","string"]},"beta":{"type":["null","boolean"]},"origin":{"type":["null","string"]},"status":{"type":["null","string"]},"sms_url":{"type":["null","string"]},"trunk_sid":{"type":["null","string"]},"voice_url":{"type":["null","string"]},"bundle_sid":{"type":["null","string"]},"sms_method":{"type":["null","string"]},"account_sid":{"type":["null","string"]},"address_sid":{"type":["null","string"]},"api_version":{"type":["null","string"]},"capabilities":{"type":["null","object"],"properties":{"fax":{"type":["null","boolean"]},"mms":{"type":["null","boolean"]},"sms":{"type":["null","boolean"]},"voice":{"type":["null","boolean"]}},"additionalProperties":false},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"},"identity_sid":{"type":["null","string"]},"phone_number":{"type":["null","string"]},"voice_method":{"type":["null","string"]},"friendly_name":{"type":["null","string"]},"status_callback":{"type":["null","string"]},"emergency_status":{"type":["null","string"]},"sms_fallback_url":{"type":["null","string"]},"voice_fallback_url":{"type":["null","string"]},"voice_receive_mode":{"type":["null","string"]},"sms_application_sid":{"type":["null","string"]},"sms_fallback_method":{"type":["null","string"]},"address_requirements":{"type":["null","string"]},"emergency_address_sid":{"type":["null","string"]},"voice_application_sid":{"type":["null","string"]},"voice_fallback_method":{"type":["null","string"]},"status_callback_method":{"type":["null","string"]},"voice_caller_id_lookup":{"type":["null","boolean"]},"emergency_address_status":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[sid]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@189537b3[stream=io.airbyte.protocol.models.AirbyteStream@61fe7e96[name=twilio_keys,jsonSchema={"type":"object","properties":{"sid":{"type":["null","string"]},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"},"friendly_name":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[sid]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@44c36ce8[stream=io.airbyte.protocol.models.AirbyteStream@bf13c9f[name=twilio_message_media,jsonSchema={"type":"object","properties":{"sid":{"type":["null","string"]},"uri":{"type":["null","string"]},"parent_sid":{"type":["null","string"]},"account_sid":{"type":["null","string"]},"content_type":{"type":["null","string"]},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"}},"additionalProperties":false},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[date_created],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[date_created],destinationSyncMode=append,primaryKey=[[sid]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@3ae8bafd[stream=io.airbyte.protocol.models.AirbyteStream@28f079f8[name=twilio_messages,jsonSchema={"type":"object","properties":{"to":{"type":["null","string"]},"sid":{"type":["null","string"]},"uri":{"type":["null","string"]},"body":{"type":["null","string"]},"from":{"type":["null","string"]},"price":{"type":["null","number"]},"status":{"type":["null","string"]},"date_sent":{"type":["null","string"],"format":"date-time"},"direction":{"type":["null","string"]},"num_media":{"type":["null","integer"]},"error_code":{"type":["null","string"]},"price_unit":{"type":["null","string"]},"account_sid":{"type":["null","string"]},"api_version":{"type":["null","string"]},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"},"num_segments":{"type":["null","integer"]},"error_message":{"type":["null","string"]},"subresource_uris":{"type":["null","object"],"properties":{"media":{"type":["null","string"]},"feedback":{"type":["null","string"]}},"additionalProperties":false},"messaging_service_sid":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[date_sent],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[date_sent],destinationSyncMode=append,primaryKey=[[sid]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@778bf422[stream=io.airbyte.protocol.models.AirbyteStream@751c3b88[name=twilio_outgoing_caller_ids,jsonSchema={"type":"object","properties":{"sid":{"type":["null","string"]},"uri":{"type":["null","string"]},"account_sid":{"type":["null","string"]},"date_created":{"type":["null","string"],"format":"date-time"},"date_updated":{"type":["null","string"],"format":"date-time"},"phone_number":{"type":["null","string"]},"friendly_name":{"type":["null","string"]}},"additionalProperties":false},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[sid]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[sid]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@a5c5884[failureOrigin=source,failureType=system_error,internalMessage='lookback_window',externalMessage=Something went wrong in the connector. See the logs for more details.,metadata=io.airbyte.config.Metadata@21c8df8e[additionalProperties={attemptNumber=2, jobId=2459, from_trace_message=true, connector_command=read}],stacktrace=Traceback (most recent call last): File "/airbyte/integration_code/main.py", line 13, in launch(source, sys.argv[1:]) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 123, in launch for message in source_entrypoint.run(parsed_args): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 114, in run for message in generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 102, in read stream_instances = {s.name: s for s in self.streams(config)} File "/airbyte/integration_code/source_twilio/source.py", line 71, in streams "lookback_window": config["lookback_window"], KeyError: 'lookback_window' ,retryable=,timestamp=1662575207895], io.airbyte.config.FailureReason@94a0571[failureOrigin=source,failureType=,internalMessage=io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped!,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@1d1ebfab[additionalProperties={attemptNumber=2, jobId=2459, connector_command=read}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) at java.base/java.lang.Thread.run(Thread.java:1589) Caused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:346) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140) at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:344) ... 4 more ,retryable=,timestamp=1662575208161]]] 2022-09-07 18:27:01 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):312 - Stopping temporal heartbeating...