2023-01-24 09:51:07 INFO i.a.v.j.JsonSchemaValidator(test):130 - JSON schema validation failed. errors: $.s3_access_key_id: object found, string expected, $.s3_secret_access_key: object found, string expected 2023-01-24 09:51:07 INFO i.a.v.j.JsonSchemaValidator(test):130 - JSON schema validation failed. errors: $.data_source_type: does not have a value in the enumeration [Azure_Blob_Storage], $.azure_blob_storage_account_name: is missing but it is required, $.azure_blob_storage_container_name: is missing but it is required, $.azure_blob_storage_sas_token: is missing but it is required 2023-01-24 09:51:07 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/24/0/logs.log 2023-01-24 09:51:07 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.40.28 2023-01-24 09:51:07 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation 2023-01-24 09:51:07 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:51:07 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2023-01-24 09:51:07 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:51:07 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-tempo:0.3.0 exists... 2023-01-24 09:51:07 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-tempo:0.3.0 was found locally. 2023-01-24 09:51:07 INFO i.a.w.p.DockerProcessFactory(create):120 - Creating docker container = source-tempo-check-24-0-yeymj with resources io.airbyte.config.ResourceRequirements@7fbae1ba[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2023-01-24 09:51:07 INFO i.a.w.p.DockerProcessFactory(create):164 - Preparing command: docker run --rm --init -i -w /data/24/0 --log-driver none --name source-tempo-check-24-0-yeymj --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e FIELD_SELECTION_WORKSPACES= -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_CONNECTOR_IMAGE=airbyte/source-tempo:0.3.0 -e WORKER_JOB_ATTEMPT=0 -e AUTO_DETECT_SCHEMA=false -e AIRBYTE_VERSION=0.40.28 -e WORKER_JOB_ID=24 airbyte/source-tempo:0.3.0 check --config source_config.json 2023-01-24 09:51:07 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):100 - Reading messages from protocol version 0.2.0 2023-01-24 09:51:11 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Check succeeded 2023-01-24 09:51:11 INFO i.a.w.g.DefaultCheckConnectionWorker(run):110 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@35ee7382[status=succeeded,message=] 2023-01-24 09:51:11 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-01-24 09:51:11 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:51:11 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2023-01-24 09:51:11 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:51:11 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/24/0/logs.log 2023-01-24 09:51:11 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.40.28 2023-01-24 09:51:11 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation 2023-01-24 09:51:12 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:51:12 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2023-01-24 09:51:12 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:51:12 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-databricks:0.3.1 exists... 2023-01-24 09:51:12 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-databricks:0.3.1 was found locally. 2023-01-24 09:51:12 INFO i.a.w.p.DockerProcessFactory(create):120 - Creating docker container = destination-databricks-check-24-0-rztlx with resources io.airbyte.config.ResourceRequirements@7fbae1ba[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2023-01-24 09:51:12 INFO i.a.w.p.DockerProcessFactory(create):164 - Preparing command: docker run --rm --init -i -w /data/24/0 --log-driver none --name destination-databricks-check-24-0-rztlx --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e FIELD_SELECTION_WORKSPACES= -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_CONNECTOR_IMAGE=airbyte/destination-databricks:0.3.1 -e WORKER_JOB_ATTEMPT=0 -e AUTO_DETECT_SCHEMA=false -e AIRBYTE_VERSION=0.40.28 -e WORKER_JOB_ID=24 airbyte/destination-databricks:0.3.1 check --config source_config.json 2023-01-24 09:51:12 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):100 - Reading messages from protocol version 0.2.0 2023-01-24 09:51:13 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - integration args: {check=null, config=source_config.json} 2023-01-24 09:51:13 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Running integration: io.airbyte.integrations.destination.databricks.DatabricksDestination 2023-01-24 09:51:13 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Command: CHECK 2023-01-24 09:51:13 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2023-01-24 09:51:13 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):117 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-01-24 09:51:13 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):117 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-01-24 09:51:13 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Using destination type: S3 2023-01-24 09:51:13 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Databricks storage type config: "S3" 2023-01-24 09:51:13 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Creating S3 client... 2023-01-24 09:51:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Storage Object kaltura-343887820357-dev-eu-west-1-data/kaltura-343887820357-dev-eu-west-1-data does not exist in bucket; creating... 2023-01-24 09:51:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Storage Object kaltura-343887820357-dev-eu-west-1-data/kaltura-343887820357-dev-eu-west-1-data has been created in bucket. 2023-01-24 09:51:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Started testing if IAM user can call listObjects on the destination bucket 2023-01-24 09:51:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Finished checking for listObjects permission 2023-01-24 09:51:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Databricks storage type config: "S3" 2023-01-24 09:51:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Starting... 2023-01-24 09:51:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Start completed. 2023-01-24 09:51:16 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Driver does not support get/set network timeout for connections. ([Databricks][JDBC](10220) Driver does not support this optional feature.) 2023-01-24 09:51:20 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Shutdown initiated... 2023-01-24 09:51:20 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):117 - Timed-out waiting for add connection executor to shutdown 2023-01-24 09:51:20 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Shutdown completed. 2023-01-24 09:51:20 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Completed integration: io.airbyte.integrations.destination.databricks.DatabricksDestination 2023-01-24 09:51:21 INFO i.a.w.g.DefaultCheckConnectionWorker(run):110 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@794906d[status=succeeded,message=] 2023-01-24 09:51:21 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:51:21 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2023-01-24 09:51:21 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:51:21 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-01-24 09:51:21 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/24/0/logs.log 2023-01-24 09:51:21 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.40.28 2023-01-24 09:51:21 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation 2023-01-24 09:51:21 INFO i.a.c.EnvConfigs(getEnvOrDefault):1173 - Using default value for environment variable METRIC_CLIENT: '' 2023-01-24 09:51:21 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2023-01-24 09:51:21 INFO i.a.w.g.DefaultReplicationWorker(run):148 - start sync worker. job id: 24 attempt id: 0 2023-01-24 09:51:21 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:51:21 INFO i.a.w.g.DefaultReplicationWorker(run):163 - configured sync modes: {null.customers=full_refresh - overwrite, null.accounts=full_refresh - overwrite, null.worklogs=full_refresh - overwrite, null.workload-schemes=full_refresh - overwrite} 2023-01-24 09:51:21 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START REPLICATION ----- 2023-01-24 09:51:21 INFO i.a.w.i.DefaultAirbyteDestination(start):78 - Running destination... 2023-01-24 09:51:21 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:51:21 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-databricks:0.3.1 exists... 2023-01-24 09:51:21 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-databricks:0.3.1 was found locally. 2023-01-24 09:51:21 INFO i.a.w.p.DockerProcessFactory(create):120 - Creating docker container = destination-databricks-write-24-0-nxhmo with resources io.airbyte.config.ResourceRequirements@4950f9f[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2023-01-24 09:51:21 INFO i.a.w.p.DockerProcessFactory(create):164 - Preparing command: docker run --rm --init -i -w /data/24/0 --log-driver none --name destination-databricks-write-24-0-nxhmo --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e FIELD_SELECTION_WORKSPACES= -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_CONNECTOR_IMAGE=airbyte/destination-databricks:0.3.1 -e WORKER_JOB_ATTEMPT=0 -e AUTO_DETECT_SCHEMA=false -e AIRBYTE_VERSION=0.40.28 -e WORKER_JOB_ID=24 airbyte/destination-databricks:0.3.1 write --config destination_config.json --catalog destination_catalog.json 2023-01-24 09:51:21 INFO i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):33 - Writing messages to protocol version 0.2.0 2023-01-24 09:51:21 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):100 - Reading messages from protocol version 0.2.0 2023-01-24 09:51:21 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-tempo:0.3.0 exists... 2023-01-24 09:51:21 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-tempo:0.3.0 was found locally. 2023-01-24 09:51:21 INFO i.a.w.p.DockerProcessFactory(create):120 - Creating docker container = source-tempo-read-24-0-yslnp with resources io.airbyte.config.ResourceRequirements@6ceef6a5[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2023-01-24 09:51:21 INFO i.a.w.p.DockerProcessFactory(create):164 - Preparing command: docker run --rm --init -i -w /data/24/0 --log-driver none --name source-tempo-read-24-0-yslnp --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e FIELD_SELECTION_WORKSPACES= -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_CONNECTOR_IMAGE=airbyte/source-tempo:0.3.0 -e WORKER_JOB_ATTEMPT=0 -e AUTO_DETECT_SCHEMA=false -e AIRBYTE_VERSION=0.40.28 -e WORKER_JOB_ID=24 airbyte/source-tempo:0.3.0 read --config source_config.json --catalog source_catalog.json --state input_state.json 2023-01-24 09:51:21 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):100 - Reading messages from protocol version 0.2.0 2023-01-24 09:51:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromDstRunnable$4):271 - Destination output thread started. 2023-01-24 09:51:21 INFO i.a.w.g.DefaultReplicationWorker(replicate):243 - Waiting for source and destination threads to complete. 2023-01-24 09:51:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):333 - Replication thread started. 2023-01-24 09:51:22 destination > integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2023-01-24 09:51:22 destination > Running integration: io.airbyte.integrations.destination.databricks.DatabricksDestination 2023-01-24 09:51:22 destination > Command: WRITE 2023-01-24 09:51:22 destination > Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2023-01-24 09:51:23 destination > Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-01-24 09:51:23 destination > Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-01-24 09:51:23 destination > Using destination type: S3 2023-01-24 09:51:23 destination > Databricks storage type config: "S3" 2023-01-24 09:51:23 destination > Databricks storage type config: "S3" 2023-01-24 09:51:23 destination > HikariPool-1 - Starting... 2023-01-24 09:51:23 destination > HikariPool-1 - Start completed. 2023-01-24 09:51:23 source > Starting syncing SourceTempo 2023-01-24 09:51:23 destination > Creating S3 client... 2023-01-24 09:51:23 source > Syncing stream: accounts 2023-01-24 09:51:23 destination > [Stream tempo_accounts] Database schema: raw 2023-01-24 09:51:23 destination > Json schema for stream tempo_accounts: {"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"integer"},"key":{"type":"string"},"lead":{"type":"object","properties":{"self":{"type":["null","string"]},"accountId":{"type":"string"}}},"name":{"type":"string"},"self":{"type":"string"},"links":{"type":"object","properties":{"self":{"type":"string"}}},"global":{"type":"boolean"},"status":{"type":"string"},"contact":{"type":"object","properties":{"self":{"type":"string"},"type":{"type":"string"},"accountId":{"type":"string"}}},"category":{"type":"object","properties":{"id":{"type":"integer"},"key":{"type":"string"},"name":{"type":"string"},"self":{"type":"string"},"type":{"type":"object","properties":{"name":{"type":"string"}}}}},"customer":{"type":["null","object"],"properties":{"id":{"type":"integer"},"key":{"type":"string"},"name":{"type":"string"},"self":{"type":"string"}}},"monthlyBudget":{"type":["null","integer"]}}} 2023-01-24 09:51:23 destination > Avro schema for stream tempo_accounts: {"type":"record","name":"tempo_accounts","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"lead","type":["null",{"type":"record","name":"lead","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"accountId","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"links","type":["null",{"type":"record","name":"links","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"global","type":["null","boolean"],"default":null},{"name":"status","type":["null","string"],"default":null},{"name":"contact","type":["null",{"type":"record","name":"contact","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"type","type":["null","string"],"default":null},{"name":"accountId","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"category","type":["null",{"type":"record","name":"category","fields":[{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"type","type":["null",{"type":"record","name":"type","namespace":"category","fields":[{"name":"name","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"customer","type":["null",{"type":"record","name":"customer","fields":[{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"monthlyBudget","type":["null","int"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:51:23 destination > Full S3 path for stream 'tempo_accounts': s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/f5aebdf5-8048-4e6d-9845-f459cd55a21c/tempo_accounts/2023_01_24_1674553883656_0.parquet 2023-01-24 09:51:23 destination > Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-01-24 09:51:24 destination > Cannot locate configuration: tried hadoop-metrics2-s3a-file-system.properties,hadoop-metrics2.properties 2023-01-24 09:51:24 destination > Scheduled Metric snapshot period at 10 second(s). 2023-01-24 09:51:24 destination > s3a-file-system metrics system started 2023-01-24 09:51:25 destination > [Stream tempo_accounts] Parquet schema: {"type":"record","name":"tempo_accounts","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"lead","type":["null",{"type":"record","name":"lead","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"accountId","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"links","type":["null",{"type":"record","name":"links","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"global","type":["null","boolean"],"default":null},{"name":"status","type":["null","string"],"default":null},{"name":"contact","type":["null",{"type":"record","name":"contact","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"type","type":["null","string"],"default":null},{"name":"accountId","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"category","type":["null",{"type":"record","name":"category","fields":[{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"type","type":["null",{"type":"record","name":"type","namespace":"category","fields":[{"name":"name","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"customer","type":["null",{"type":"record","name":"customer","fields":[{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"monthlyBudget","type":["null","int"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:51:27 source > Read 156 records from accounts stream 2023-01-24 09:51:27 source > Finished syncing accounts 2023-01-24 09:51:27 source > SourceTempo runtimes: Syncing stream accounts 0:00:04.240798 2023-01-24 09:51:27 source > Syncing stream: customers 2023-01-24 09:51:27 destination > Overwrite mode 2023-01-24 09:51:27 destination > [Stream tempo_accounts] Tmp table _airbyte_tmp_wcy_tempo_accounts location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/f5aebdf5-8048-4e6d-9845-f459cd55a21c/tempo_accounts 2023-01-24 09:51:27 destination > [Stream tempo_accounts] Data table tempo_accounts location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/raw/tempo_accounts 2023-01-24 09:51:27 destination > [Stream tempo_customers] Database schema: raw 2023-01-24 09:51:27 destination > Json schema for stream tempo_customers: {"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"integer"},"key":{"type":"string"},"name":{"type":"string"},"self":{"type":"string"}}} 2023-01-24 09:51:27 destination > Avro schema for stream tempo_customers: {"type":"record","name":"tempo_customers","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:51:27 destination > Full S3 path for stream 'tempo_customers': s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/f5aebdf5-8048-4e6d-9845-f459cd55a21c/tempo_customers/2023_01_24_1674553887523_0.parquet 2023-01-24 09:51:27 destination > [Stream tempo_customers] Parquet schema: {"type":"record","name":"tempo_customers","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:51:27 destination > Overwrite mode 2023-01-24 09:51:27 destination > [Stream tempo_customers] Tmp table _airbyte_tmp_rhe_tempo_customers location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/f5aebdf5-8048-4e6d-9845-f459cd55a21c/tempo_customers 2023-01-24 09:51:27 destination > [Stream tempo_customers] Data table tempo_customers location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/raw/tempo_customers 2023-01-24 09:51:27 destination > [Stream tempo_worklogs] Database schema: raw 2023-01-24 09:51:27 destination > Json schema for stream tempo_worklogs: {"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"self":{"type":"string","format":"uri","readOnly":true,"description":"The URL of the worklog"},"issue":{"type":"object","readOnly":true,"properties":{"id":{"type":"integer"},"self":{"type":"string"}},"description":"Details of the issue"},"author":{"type":"object","readOnly":true,"properties":{"self":{"type":["null","string"]},"accountId":{"type":"string"}},"description":"Author of the worklog"},"createdAt":{"type":"string","readOnly":true,"description":"Created at date of the worklog"},"startDate":{"type":"string","readOnly":true,"description":"Start Date of the worklog"},"startTime":{"type":["null","string"],"readOnly":true,"description":"Start time of the worklog"},"updatedAt":{"type":"string","readOnly":true,"description":"Updated at date of the worklog"},"attributes":{"type":"object","readOnly":true,"properties":{"self":{"type":"string"},"values":{"type":["null","array"],"items":{"type":"object","properties":{"key":{"type":"string"},"value":{"type":["null","string"]}}}}},"description":"Additional attribute of the worklog"},"description":{"type":["null","string"],"readOnly":true,"description":"Description of the worklog"},"tempoWorklogId":{"type":"integer","readOnly":true,"description":"The ID of the tempo worklog."},"billableSeconds":{"type":["null","integer"],"description":"Billable time spent working"},"timeSpentSeconds":{"type":"integer","readOnly":true,"description":"Time spend in seconds of the worklog"}}} 2023-01-24 09:51:27 destination > Schema name "values.items" contains illegal character(s) and is standardized to "values_items" 2023-01-24 09:51:27 destination > Avro schema for stream tempo_worklogs: {"type":"record","name":"tempo_worklogs","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"self","type":["null","string"],"default":null},{"name":"issue","type":["null",{"type":"record","name":"issue","fields":[{"name":"id","type":["null","int"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"author","type":["null",{"type":"record","name":"author","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"accountId","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"createdAt","type":["null","string"],"default":null},{"name":"startDate","type":["null","string"],"default":null},{"name":"startTime","type":["null","string"],"default":null},{"name":"updatedAt","type":["null","string"],"default":null},{"name":"attributes","type":["null",{"type":"record","name":"attributes","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"values","type":["null",{"type":"array","items":["null",{"type":"record","name":"values_items","namespace":"attributes","doc":"_airbyte_original_name:values.items","fields":[{"name":"key","type":["null","string"],"default":null},{"name":"value","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}]}],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"description","type":["null","string"],"default":null},{"name":"tempoWorklogId","type":["null","int"],"default":null},{"name":"billableSeconds","type":["null","int"],"default":null},{"name":"timeSpentSeconds","type":["null","int"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:51:27 destination > Full S3 path for stream 'tempo_worklogs': s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/f5aebdf5-8048-4e6d-9845-f459cd55a21c/tempo_worklogs/2023_01_24_1674553887978_0.parquet 2023-01-24 09:51:28 destination > [Stream tempo_worklogs] Parquet schema: {"type":"record","name":"tempo_worklogs","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"self","type":["null","string"],"default":null},{"name":"issue","type":["null",{"type":"record","name":"issue","fields":[{"name":"id","type":["null","int"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"author","type":["null",{"type":"record","name":"author","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"accountId","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"createdAt","type":["null","string"],"default":null},{"name":"startDate","type":["null","string"],"default":null},{"name":"startTime","type":["null","string"],"default":null},{"name":"updatedAt","type":["null","string"],"default":null},{"name":"attributes","type":["null",{"type":"record","name":"attributes","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"values","type":["null",{"type":"array","items":["null",{"type":"record","name":"values_items","namespace":"attributes","doc":"_airbyte_original_name:values.items","fields":[{"name":"key","type":["null","string"],"default":null},{"name":"value","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}]}],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"description","type":["null","string"],"default":null},{"name":"tempoWorklogId","type":["null","int"],"default":null},{"name":"billableSeconds","type":["null","int"],"default":null},{"name":"timeSpentSeconds","type":["null","int"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:51:28 source > Read 14 records from customers stream 2023-01-24 09:51:28 source > Finished syncing customers 2023-01-24 09:51:28 source > SourceTempo runtimes: Syncing stream accounts 0:00:04.240798 Syncing stream customers 0:00:00.860646 2023-01-24 09:51:28 source > Syncing stream: worklogs 2023-01-24 09:51:28 destination > Overwrite mode 2023-01-24 09:51:28 destination > [Stream tempo_worklogs] Tmp table _airbyte_tmp_fxi_tempo_worklogs location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/f5aebdf5-8048-4e6d-9845-f459cd55a21c/tempo_worklogs 2023-01-24 09:51:28 destination > [Stream tempo_worklogs] Data table tempo_worklogs location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/raw/tempo_worklogs 2023-01-24 09:51:28 destination > [Stream tempo_workload-schemes] Database schema: raw 2023-01-24 09:51:28 destination > Json schema for stream tempo_workload-schemes: {"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"integer","readOnly":true,"description":"The ID of the tempo Workload Scheme."},"days":{"type":"array","items":{"type":"object","properties":{"day":{"type":"string"},"requiredSeconds":{"type":"integer"}}},"readOnly":true,"description":"The days of the tempo Workload Scheme."},"name":{"type":"string","readOnly":true,"description":"The name of the tempo Workload Scheme."},"self":{"type":"string","format":"uri","readOnly":true,"description":"The URL of the Workload Scheme"},"description":{"type":"string","readOnly":true,"description":"The description of the tempo Workload Scheme."},"memberCount":{"type":"integer","readOnly":true,"description":"The memberCount of the tempo Workload Scheme."},"defaultScheme":{"type":"boolean","readOnly":true,"description":"The defaultScheme of the tempo Workload Scheme."}}} 2023-01-24 09:51:28 destination > Schema name "tempo_workload-schemes" contains illegal character(s) and is standardized to "tempo_workload_schemes" 2023-01-24 09:51:28 destination > Schema name "days.items" contains illegal character(s) and is standardized to "days_items" 2023-01-24 09:51:28 destination > Avro schema for stream tempo_workload-schemes: {"type":"record","name":"tempo_workload_schemes","doc":"_airbyte_original_name:tempo_workload-schemes","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"id","type":["null","int"],"default":null},{"name":"days","type":["null",{"type":"array","items":["null",{"type":"record","name":"days_items","doc":"_airbyte_original_name:days.items","fields":[{"name":"day","type":["null","string"],"default":null},{"name":"requiredSeconds","type":["null","int"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}]}],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"description","type":["null","string"],"default":null},{"name":"memberCount","type":["null","int"],"default":null},{"name":"defaultScheme","type":["null","boolean"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:51:28 destination > Full S3 path for stream 'tempo_workload-schemes': s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/f5aebdf5-8048-4e6d-9845-f459cd55a21c/tempo_workload-schemes/2023_01_24_1674553888400_0.parquet 2023-01-24 09:51:28 destination > [Stream tempo_workload-schemes] Parquet schema: {"type":"record","name":"tempo_workload_schemes","doc":"_airbyte_original_name:tempo_workload-schemes","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"id","type":["null","int"],"default":null},{"name":"days","type":["null",{"type":"array","items":["null",{"type":"record","name":"days_items","doc":"_airbyte_original_name:days.items","fields":[{"name":"day","type":["null","string"],"default":null},{"name":"requiredSeconds","type":["null","int"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}]}],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"description","type":["null","string"],"default":null},{"name":"memberCount","type":["null","int"],"default":null},{"name":"defaultScheme","type":["null","boolean"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:51:29 destination > Overwrite mode 2023-01-24 09:51:29 destination > [Stream tempo_workload-schemes] Tmp table _airbyte_tmp_mei_tempo_workload_schemes location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/f5aebdf5-8048-4e6d-9845-f459cd55a21c/tempo_workload-schemes 2023-01-24 09:51:29 destination > [Stream tempo_workload-schemes] Data table tempo_workload_schemes location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/raw/tempo_workload-schemes 2023-01-24 09:51:29 destination > class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2023-01-24 09:51:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 1000 (603 KB) 2023-01-24 09:51:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 2000 (1 MB) 2023-01-24 09:52:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 3000 (1 MB) 2023-01-24 09:52:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 4000 (2 MB) 2023-01-24 09:52:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 5000 (3 MB) 2023-01-24 09:52:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 6000 (3 MB) 2023-01-24 09:53:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 7000 (4 MB) 2023-01-24 09:53:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 8000 (4 MB) 2023-01-24 09:53:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 9000 (5 MB) 2023-01-24 09:53:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 10000 (6 MB) 2023-01-24 09:54:03 destination > Flushing tempo_customers: 14 records (24 MB) 2023-01-24 09:54:04 destination > Flushing tempo_worklogs: 10185 records (24 MB) 2023-01-24 09:54:20 destination > /airbyte/javabase.sh: line 26: 10 Killed /airbyte/bin/"$APPLICATION" "$@" 2023-01-24 09:55:20 WARN i.a.c.i.LineGobbler(voidCall):119 - airbyte-source gobbler IOException: Stream closed. Typically happens when cancelling a job. 2023-01-24 09:55:20 ERROR i.a.w.g.DefaultReplicationWorker(replicate):255 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137 at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.general.DefaultReplicationWorker.replicate(DefaultReplicationWorker.java:247) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:171) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:87) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.40.28.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Suppressed: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:155) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.replicate(DefaultReplicationWorker.java:192) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:171) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:87) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.40.28.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Suppressed: java.io.IOException: Stream closed at java.lang.ProcessBuilder$NullOutputStream.write(ProcessBuilder.java:445) ~[?:?] at java.io.OutputStream.write(OutputStream.java:164) ~[?:?] at java.io.BufferedOutputStream.implWrite(BufferedOutputStream.java:216) ~[?:?] at java.io.BufferedOutputStream.write(BufferedOutputStream.java:205) ~[?:?] at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:313) ~[?:?] at sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:409) ~[?:?] at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:414) ~[?:?] at sun.nio.cs.StreamEncoder.lockedFlush(StreamEncoder.java:218) ~[?:?] at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:205) ~[?:?] at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:263) ~[?:?] at java.io.BufferedWriter.implFlush(BufferedWriter.java:372) ~[?:?] at java.io.BufferedWriter.flush(BufferedWriter.java:359) ~[?:?] at io.airbyte.workers.internal.DefaultAirbyteMessageBufferedWriter.flush(DefaultAirbyteMessageBufferedWriter.java:28) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.internal.DefaultAirbyteDestination.notifyEndOfInput(DefaultAirbyteDestination.java:109) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.internal.DefaultAirbyteDestination.close(DefaultAirbyteDestination.java:123) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.replicate(DefaultReplicationWorker.java:192) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:171) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:87) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.40.28.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Caused by: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137 at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromDstRunnable$4(DefaultReplicationWorker.java:297) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] ... 1 more 2023-01-24 09:55:20 INFO i.a.w.g.DefaultReplicationWorker(prepStateForLaterSaving):550 - Source did not output any state messages 2023-01-24 09:55:20 WARN i.a.w.g.DefaultReplicationWorker(prepStateForLaterSaving):558 - State capture: No new state, falling back on input state: io.airbyte.config.State@33c9b2ae[state={}] 2023-01-24 09:55:21 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):481 - sync summary: { "status" : "failed", "recordsSynced" : 10706, "bytesSynced" : 6827093, "startTime" : 1674553881350, "endTime" : 1674554120990, "totalStats" : { "bytesEmitted" : 6827093, "destinationStateMessagesEmitted" : 0, "destinationWriteEndTime" : 1674554061003, "destinationWriteStartTime" : 1674553881450, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0, "recordsEmitted" : 10706, "recordsCommitted" : 0, "replicationEndTime" : 1674554120987, "replicationStartTime" : 1674553881350, "sourceReadEndTime" : 0, "sourceReadStartTime" : 1674553881404, "sourceStateMessagesEmitted" : 0 }, "streamStats" : [ { "streamName" : "tempo_customers", "stats" : { "bytesEmitted" : 1180, "recordsEmitted" : 14 } }, { "streamName" : "tempo_worklogs", "stats" : { "bytesEmitted" : 6734215, "recordsEmitted" : 10536 } }, { "streamName" : "tempo_accounts", "stats" : { "bytesEmitted" : 91698, "recordsEmitted" : 156 } } ] } 2023-01-24 09:55:21 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):482 - failures: [ { "failureOrigin" : "destination", "internalMessage" : "io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process message delivery failed", "externalMessage" : "Something went wrong within the destination connector", "metadata" : { "attemptNumber" : 0, "jobId" : 24, "connector_command" : "write" }, "stacktrace" : "java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process message delivery failed\n\tat java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)\n\tat java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1589)\nCaused by: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process message delivery failed\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$6(DefaultReplicationWorker.java:372)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\t... 3 more\nCaused by: java.io.IOException: Stream closed\n\tat java.base/java.lang.ProcessBuilder$NullOutputStream.write(ProcessBuilder.java:445)\n\tat java.base/java.io.OutputStream.write(OutputStream.java:164)\n\tat java.base/java.io.BufferedOutputStream.implWrite(BufferedOutputStream.java:216)\n\tat java.base/java.io.BufferedOutputStream.write(BufferedOutputStream.java:205)\n\tat java.base/sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:313)\n\tat java.base/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:385)\n\tat java.base/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:361)\n\tat java.base/sun.nio.cs.StreamEncoder.lockedWrite(StreamEncoder.java:162)\n\tat java.base/sun.nio.cs.StreamEncoder.write(StreamEncoder.java:143)\n\tat java.base/java.io.OutputStreamWriter.write(OutputStreamWriter.java:220)\n\tat java.base/java.io.BufferedWriter.implFlushBuffer(BufferedWriter.java:178)\n\tat java.base/java.io.BufferedWriter.flushBuffer(BufferedWriter.java:163)\n\tat java.base/java.io.BufferedWriter.implWrite(BufferedWriter.java:334)\n\tat java.base/java.io.BufferedWriter.write(BufferedWriter.java:313)\n\tat java.base/java.io.Writer.write(Writer.java:278)\n\tat io.airbyte.workers.internal.VersionedAirbyteMessageBufferedWriter.write(VersionedAirbyteMessageBufferedWriter.java:30)\n\tat io.airbyte.workers.internal.DefaultAirbyteDestination.accept(DefaultAirbyteDestination.java:101)\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$6(DefaultReplicationWorker.java:369)\n\t... 4 more\n", "timestamp" : 1674554061652 }, { "failureOrigin" : "destination", "internalMessage" : "io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137", "externalMessage" : "Something went wrong within the destination connector", "metadata" : { "attemptNumber" : 0, "jobId" : 24, "connector_command" : "write" }, "stacktrace" : "java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137\n\tat java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)\n\tat java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1589)\nCaused by: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromDstRunnable$4(DefaultReplicationWorker.java:297)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\t... 3 more\n", "timestamp" : 1674554061010 } ] 2023-01-24 09:55:21 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-01-24 09:55:21 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:55:21 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END REPLICATION ----- 2023-01-24 09:55:21 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:55:21 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):207 - sync summary: io.airbyte.config.StandardSyncOutput@290a5c7c[standardSyncSummary=io.airbyte.config.StandardSyncSummary@41a71fa3[status=failed,recordsSynced=10706,bytesSynced=6827093,startTime=1674553881350,endTime=1674554120990,totalStats=io.airbyte.config.SyncStats@1ac7efdf[bytesEmitted=6827093,destinationStateMessagesEmitted=0,destinationWriteEndTime=1674554061003,destinationWriteStartTime=1674553881450,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,recordsEmitted=10706,recordsCommitted=0,replicationEndTime=1674554120987,replicationStartTime=1674553881350,sourceReadEndTime=0,sourceReadStartTime=1674553881404,sourceStateMessagesEmitted=0,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@ebc786e[streamName=tempo_customers,streamNamespace=,stats=io.airbyte.config.SyncStats@752e3c79[bytesEmitted=1180,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=14,recordsCommitted=,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@c8d7f78[streamName=tempo_worklogs,streamNamespace=,stats=io.airbyte.config.SyncStats@2991d021[bytesEmitted=6734215,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=10536,recordsCommitted=,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@4483b275[streamName=tempo_accounts,streamNamespace=,stats=io.airbyte.config.SyncStats@40ca9368[bytesEmitted=91698,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=156,recordsCommitted=,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}]]]],normalizationSummary=,webhookOperationSummary=,state=io.airbyte.config.State@33c9b2ae[state={}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@27db52b6[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@ec9eb4[stream=io.airbyte.protocol.models.AirbyteStream@592594c6[name=tempo_accounts,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"integer"},"key":{"type":"string"},"lead":{"type":"object","properties":{"self":{"type":["null","string"]},"accountId":{"type":"string"}}},"name":{"type":"string"},"self":{"type":"string"},"links":{"type":"object","properties":{"self":{"type":"string"}}},"global":{"type":"boolean"},"status":{"type":"string"},"contact":{"type":"object","properties":{"self":{"type":"string"},"type":{"type":"string"},"accountId":{"type":"string"}}},"category":{"type":"object","properties":{"id":{"type":"integer"},"key":{"type":"string"},"name":{"type":"string"},"self":{"type":"string"},"type":{"type":"object","properties":{"name":{"type":"string"}}}}},"customer":{"type":["null","object"],"properties":{"id":{"type":"integer"},"key":{"type":"string"},"name":{"type":"string"},"self":{"type":"string"}}},"monthlyBudget":{"type":["null","integer"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@4d600d59[stream=io.airbyte.protocol.models.AirbyteStream@30d3b8a1[name=tempo_customers,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"integer"},"key":{"type":"string"},"name":{"type":"string"},"self":{"type":"string"}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@54ae9931[stream=io.airbyte.protocol.models.AirbyteStream@21d8b4c6[name=tempo_worklogs,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"self":{"type":"string","format":"uri","readOnly":true,"description":"The URL of the worklog"},"issue":{"type":"object","readOnly":true,"properties":{"id":{"type":"integer"},"self":{"type":"string"}},"description":"Details of the issue"},"author":{"type":"object","readOnly":true,"properties":{"self":{"type":["null","string"]},"accountId":{"type":"string"}},"description":"Author of the worklog"},"createdAt":{"type":"string","readOnly":true,"description":"Created at date of the worklog"},"startDate":{"type":"string","readOnly":true,"description":"Start Date of the worklog"},"startTime":{"type":["null","string"],"readOnly":true,"description":"Start time of the worklog"},"updatedAt":{"type":"string","readOnly":true,"description":"Updated at date of the worklog"},"attributes":{"type":"object","readOnly":true,"properties":{"self":{"type":"string"},"values":{"type":["null","array"],"items":{"type":"object","properties":{"key":{"type":"string"},"value":{"type":["null","string"]}}}}},"description":"Additional attribute of the worklog"},"description":{"type":["null","string"],"readOnly":true,"description":"Description of the worklog"},"tempoWorklogId":{"type":"integer","readOnly":true,"description":"The ID of the tempo worklog."},"billableSeconds":{"type":["null","integer"],"description":"Billable time spent working"},"timeSpentSeconds":{"type":"integer","readOnly":true,"description":"Time spend in seconds of the worklog"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[startDate],sourceDefinedPrimaryKey=[[tempoWorklogId]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[startDate],destinationSyncMode=overwrite,primaryKey=[[tempoWorklogId]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@6c1f6f61[stream=io.airbyte.protocol.models.AirbyteStream@41a4c4f3[name=tempo_workload-schemes,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"integer","readOnly":true,"description":"The ID of the tempo Workload Scheme."},"days":{"type":"array","items":{"type":"object","properties":{"day":{"type":"string"},"requiredSeconds":{"type":"integer"}}},"readOnly":true,"description":"The days of the tempo Workload Scheme."},"name":{"type":"string","readOnly":true,"description":"The name of the tempo Workload Scheme."},"self":{"type":"string","format":"uri","readOnly":true,"description":"The URL of the Workload Scheme"},"description":{"type":"string","readOnly":true,"description":"The description of the tempo Workload Scheme."},"memberCount":{"type":"integer","readOnly":true,"description":"The memberCount of the tempo Workload Scheme."},"defaultScheme":{"type":"boolean","readOnly":true,"description":"The defaultScheme of the tempo Workload Scheme."}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@61e3aae7[failureOrigin=destination,failureType=,internalMessage=io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process message delivery failed,externalMessage=Something went wrong within the destination connector,metadata=io.airbyte.config.Metadata@5f94c99[additionalProperties={attemptNumber=0, jobId=24, connector_command=write}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process message delivery failed at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) at java.base/java.lang.Thread.run(Thread.java:1589) Caused by: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process message delivery failed at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$6(DefaultReplicationWorker.java:372) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more Caused by: java.io.IOException: Stream closed at java.base/java.lang.ProcessBuilder$NullOutputStream.write(ProcessBuilder.java:445) at java.base/java.io.OutputStream.write(OutputStream.java:164) at java.base/java.io.BufferedOutputStream.implWrite(BufferedOutputStream.java:216) at java.base/java.io.BufferedOutputStream.write(BufferedOutputStream.java:205) at java.base/sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:313) at java.base/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:385) at java.base/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:361) at java.base/sun.nio.cs.StreamEncoder.lockedWrite(StreamEncoder.java:162) at java.base/sun.nio.cs.StreamEncoder.write(StreamEncoder.java:143) at java.base/java.io.OutputStreamWriter.write(OutputStreamWriter.java:220) at java.base/java.io.BufferedWriter.implFlushBuffer(BufferedWriter.java:178) at java.base/java.io.BufferedWriter.flushBuffer(BufferedWriter.java:163) at java.base/java.io.BufferedWriter.implWrite(BufferedWriter.java:334) at java.base/java.io.BufferedWriter.write(BufferedWriter.java:313) at java.base/java.io.Writer.write(Writer.java:278) at io.airbyte.workers.internal.VersionedAirbyteMessageBufferedWriter.write(VersionedAirbyteMessageBufferedWriter.java:30) at io.airbyte.workers.internal.DefaultAirbyteDestination.accept(DefaultAirbyteDestination.java:101) at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$6(DefaultReplicationWorker.java:369) ... 4 more ,retryable=,timestamp=1674554061652], io.airbyte.config.FailureReason@120a5f20[failureOrigin=destination,failureType=,internalMessage=io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137,externalMessage=Something went wrong within the destination connector,metadata=io.airbyte.config.Metadata@756e82ce[additionalProperties={attemptNumber=0, jobId=24, connector_command=write}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137 at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) at java.base/java.lang.Thread.run(Thread.java:1589) Caused by: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137 at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromDstRunnable$4(DefaultReplicationWorker.java:297) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more ,retryable=,timestamp=1674554061010]]] 2023-01-24 09:55:21 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):212 - Sync summary length: 13118 2023-01-24 09:55:21 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):283 - Stopping temporal heartbeating... 2023-01-24 09:55:21 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to get state 2023-01-24 09:55:21 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to create or update state 2023-01-24 09:55:21 INFO i.a.v.j.JsonSchemaValidator(test):130 - JSON schema validation failed. errors: $.s3_access_key_id: object found, string expected, $.s3_secret_access_key: object found, string expected 2023-01-24 09:55:21 INFO i.a.v.j.JsonSchemaValidator(test):130 - JSON schema validation failed. errors: $.data_source_type: does not have a value in the enumeration [Azure_Blob_Storage], $.azure_blob_storage_account_name: is missing but it is required, $.azure_blob_storage_container_name: is missing but it is required, $.azure_blob_storage_sas_token: is missing but it is required 2023-01-24 09:55:21 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/24/1/logs.log 2023-01-24 09:55:21 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.40.28 2023-01-24 09:55:21 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation 2023-01-24 09:55:21 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:55:21 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2023-01-24 09:55:21 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:55:21 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-tempo:0.3.0 exists... 2023-01-24 09:55:21 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-tempo:0.3.0 was found locally. 2023-01-24 09:55:21 INFO i.a.w.p.DockerProcessFactory(create):120 - Creating docker container = source-tempo-check-24-1-icwrf with resources io.airbyte.config.ResourceRequirements@7fbae1ba[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2023-01-24 09:55:21 INFO i.a.w.p.DockerProcessFactory(create):164 - Preparing command: docker run --rm --init -i -w /data/24/1 --log-driver none --name source-tempo-check-24-1-icwrf --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e FIELD_SELECTION_WORKSPACES= -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_CONNECTOR_IMAGE=airbyte/source-tempo:0.3.0 -e WORKER_JOB_ATTEMPT=1 -e AUTO_DETECT_SCHEMA=false -e AIRBYTE_VERSION=0.40.28 -e WORKER_JOB_ID=24 airbyte/source-tempo:0.3.0 check --config source_config.json 2023-01-24 09:55:21 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):100 - Reading messages from protocol version 0.2.0 2023-01-24 09:55:24 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Check succeeded 2023-01-24 09:55:24 INFO i.a.w.g.DefaultCheckConnectionWorker(run):110 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@770957a0[status=succeeded,message=] 2023-01-24 09:55:24 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-01-24 09:55:24 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:55:24 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2023-01-24 09:55:24 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:55:24 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/24/1/logs.log 2023-01-24 09:55:24 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.40.28 2023-01-24 09:55:24 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation 2023-01-24 09:55:24 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:55:24 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2023-01-24 09:55:24 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:55:24 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-databricks:0.3.1 exists... 2023-01-24 09:55:24 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-databricks:0.3.1 was found locally. 2023-01-24 09:55:24 INFO i.a.w.p.DockerProcessFactory(create):120 - Creating docker container = destination-databricks-check-24-1-olojn with resources io.airbyte.config.ResourceRequirements@7fbae1ba[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2023-01-24 09:55:24 INFO i.a.w.p.DockerProcessFactory(create):164 - Preparing command: docker run --rm --init -i -w /data/24/1 --log-driver none --name destination-databricks-check-24-1-olojn --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e FIELD_SELECTION_WORKSPACES= -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_CONNECTOR_IMAGE=airbyte/destination-databricks:0.3.1 -e WORKER_JOB_ATTEMPT=1 -e AUTO_DETECT_SCHEMA=false -e AIRBYTE_VERSION=0.40.28 -e WORKER_JOB_ID=24 airbyte/destination-databricks:0.3.1 check --config source_config.json 2023-01-24 09:55:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):100 - Reading messages from protocol version 0.2.0 2023-01-24 09:55:26 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - integration args: {check=null, config=source_config.json} 2023-01-24 09:55:26 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Running integration: io.airbyte.integrations.destination.databricks.DatabricksDestination 2023-01-24 09:55:26 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Command: CHECK 2023-01-24 09:55:26 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2023-01-24 09:55:27 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):117 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-01-24 09:55:27 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):117 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-01-24 09:55:27 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Using destination type: S3 2023-01-24 09:55:27 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Databricks storage type config: "S3" 2023-01-24 09:55:27 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Creating S3 client... 2023-01-24 09:55:28 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Storage Object kaltura-343887820357-dev-eu-west-1-data/kaltura-343887820357-dev-eu-west-1-data does not exist in bucket; creating... 2023-01-24 09:55:28 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Storage Object kaltura-343887820357-dev-eu-west-1-data/kaltura-343887820357-dev-eu-west-1-data has been created in bucket. 2023-01-24 09:55:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Started testing if IAM user can call listObjects on the destination bucket 2023-01-24 09:55:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Finished checking for listObjects permission 2023-01-24 09:55:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Databricks storage type config: "S3" 2023-01-24 09:55:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Starting... 2023-01-24 09:55:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Start completed. 2023-01-24 09:55:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Driver does not support get/set network timeout for connections. ([Databricks][JDBC](10220) Driver does not support this optional feature.) 2023-01-24 09:55:37 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Shutdown initiated... 2023-01-24 09:55:37 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Shutdown completed. 2023-01-24 09:55:37 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Completed integration: io.airbyte.integrations.destination.databricks.DatabricksDestination 2023-01-24 09:55:38 INFO i.a.w.g.DefaultCheckConnectionWorker(run):110 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@5cfe9618[status=succeeded,message=] 2023-01-24 09:55:38 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-01-24 09:55:38 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:55:38 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2023-01-24 09:55:38 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:55:38 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/24/1/logs.log 2023-01-24 09:55:38 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.40.28 2023-01-24 09:55:38 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation 2023-01-24 09:55:38 INFO i.a.c.EnvConfigs(getEnvOrDefault):1173 - Using default value for environment variable METRIC_CLIENT: '' 2023-01-24 09:55:38 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2023-01-24 09:55:38 INFO i.a.w.g.DefaultReplicationWorker(run):148 - start sync worker. job id: 24 attempt id: 1 2023-01-24 09:55:38 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:55:38 INFO i.a.w.g.DefaultReplicationWorker(run):163 - configured sync modes: {null.customers=full_refresh - overwrite, null.accounts=full_refresh - overwrite, null.worklogs=full_refresh - overwrite, null.workload-schemes=full_refresh - overwrite} 2023-01-24 09:55:38 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START REPLICATION ----- 2023-01-24 09:55:38 INFO i.a.w.i.DefaultAirbyteDestination(start):78 - Running destination... 2023-01-24 09:55:38 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:55:38 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-databricks:0.3.1 exists... 2023-01-24 09:55:38 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-databricks:0.3.1 was found locally. 2023-01-24 09:55:38 INFO i.a.w.p.DockerProcessFactory(create):120 - Creating docker container = destination-databricks-write-24-1-qjhww with resources io.airbyte.config.ResourceRequirements@f742dc2[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2023-01-24 09:55:38 INFO i.a.w.p.DockerProcessFactory(create):164 - Preparing command: docker run --rm --init -i -w /data/24/1 --log-driver none --name destination-databricks-write-24-1-qjhww --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e FIELD_SELECTION_WORKSPACES= -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_CONNECTOR_IMAGE=airbyte/destination-databricks:0.3.1 -e WORKER_JOB_ATTEMPT=1 -e AUTO_DETECT_SCHEMA=false -e AIRBYTE_VERSION=0.40.28 -e WORKER_JOB_ID=24 airbyte/destination-databricks:0.3.1 write --config destination_config.json --catalog destination_catalog.json 2023-01-24 09:55:38 INFO i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):33 - Writing messages to protocol version 0.2.0 2023-01-24 09:55:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):100 - Reading messages from protocol version 0.2.0 2023-01-24 09:55:38 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-tempo:0.3.0 exists... 2023-01-24 09:55:38 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-tempo:0.3.0 was found locally. 2023-01-24 09:55:38 INFO i.a.w.p.DockerProcessFactory(create):120 - Creating docker container = source-tempo-read-24-1-iaisb with resources io.airbyte.config.ResourceRequirements@46eda2a7[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2023-01-24 09:55:38 INFO i.a.w.p.DockerProcessFactory(create):164 - Preparing command: docker run --rm --init -i -w /data/24/1 --log-driver none --name source-tempo-read-24-1-iaisb --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e FIELD_SELECTION_WORKSPACES= -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_CONNECTOR_IMAGE=airbyte/source-tempo:0.3.0 -e WORKER_JOB_ATTEMPT=1 -e AUTO_DETECT_SCHEMA=false -e AIRBYTE_VERSION=0.40.28 -e WORKER_JOB_ID=24 airbyte/source-tempo:0.3.0 read --config source_config.json --catalog source_catalog.json --state input_state.json 2023-01-24 09:55:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):100 - Reading messages from protocol version 0.2.0 2023-01-24 09:55:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromDstRunnable$4):271 - Destination output thread started. 2023-01-24 09:55:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):333 - Replication thread started. 2023-01-24 09:55:38 INFO i.a.w.g.DefaultReplicationWorker(replicate):243 - Waiting for source and destination threads to complete. 2023-01-24 09:55:40 destination > integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2023-01-24 09:55:40 destination > Running integration: io.airbyte.integrations.destination.databricks.DatabricksDestination 2023-01-24 09:55:40 destination > Command: WRITE 2023-01-24 09:55:40 destination > Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2023-01-24 09:55:40 destination > Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-01-24 09:55:40 destination > Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-01-24 09:55:40 destination > Using destination type: S3 2023-01-24 09:55:40 destination > Databricks storage type config: "S3" 2023-01-24 09:55:40 destination > Databricks storage type config: "S3" 2023-01-24 09:55:40 destination > HikariPool-1 - Starting... 2023-01-24 09:55:40 destination > HikariPool-1 - Start completed. 2023-01-24 09:55:40 source > Starting syncing SourceTempo 2023-01-24 09:55:40 destination > Creating S3 client... 2023-01-24 09:55:40 source > Syncing stream: accounts 2023-01-24 09:55:40 destination > [Stream tempo_accounts] Database schema: raw 2023-01-24 09:55:40 destination > Json schema for stream tempo_accounts: {"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"integer"},"key":{"type":"string"},"lead":{"type":"object","properties":{"self":{"type":["null","string"]},"accountId":{"type":"string"}}},"name":{"type":"string"},"self":{"type":"string"},"links":{"type":"object","properties":{"self":{"type":"string"}}},"global":{"type":"boolean"},"status":{"type":"string"},"contact":{"type":"object","properties":{"self":{"type":"string"},"type":{"type":"string"},"accountId":{"type":"string"}}},"category":{"type":"object","properties":{"id":{"type":"integer"},"key":{"type":"string"},"name":{"type":"string"},"self":{"type":"string"},"type":{"type":"object","properties":{"name":{"type":"string"}}}}},"customer":{"type":["null","object"],"properties":{"id":{"type":"integer"},"key":{"type":"string"},"name":{"type":"string"},"self":{"type":"string"}}},"monthlyBudget":{"type":["null","integer"]}}} 2023-01-24 09:55:40 destination > Avro schema for stream tempo_accounts: {"type":"record","name":"tempo_accounts","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"lead","type":["null",{"type":"record","name":"lead","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"accountId","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"links","type":["null",{"type":"record","name":"links","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"global","type":["null","boolean"],"default":null},{"name":"status","type":["null","string"],"default":null},{"name":"contact","type":["null",{"type":"record","name":"contact","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"type","type":["null","string"],"default":null},{"name":"accountId","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"category","type":["null",{"type":"record","name":"category","fields":[{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"type","type":["null",{"type":"record","name":"type","namespace":"category","fields":[{"name":"name","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"customer","type":["null",{"type":"record","name":"customer","fields":[{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"monthlyBudget","type":["null","int"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:55:40 destination > Full S3 path for stream 'tempo_accounts': s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/2ebaaecd-960d-49c9-b964-c3a3e1972de1/tempo_accounts/2023_01_24_1674554140799_0.parquet 2023-01-24 09:55:41 destination > Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-01-24 09:55:41 destination > Cannot locate configuration: tried hadoop-metrics2-s3a-file-system.properties,hadoop-metrics2.properties 2023-01-24 09:55:41 destination > Scheduled Metric snapshot period at 10 second(s). 2023-01-24 09:55:41 destination > s3a-file-system metrics system started 2023-01-24 09:55:42 source > Read 156 records from accounts stream 2023-01-24 09:55:42 source > Finished syncing accounts 2023-01-24 09:55:42 source > SourceTempo runtimes: Syncing stream accounts 0:00:02.512847 2023-01-24 09:55:42 source > Syncing stream: customers 2023-01-24 09:55:42 destination > [Stream tempo_accounts] Parquet schema: {"type":"record","name":"tempo_accounts","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"lead","type":["null",{"type":"record","name":"lead","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"accountId","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"links","type":["null",{"type":"record","name":"links","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"global","type":["null","boolean"],"default":null},{"name":"status","type":["null","string"],"default":null},{"name":"contact","type":["null",{"type":"record","name":"contact","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"type","type":["null","string"],"default":null},{"name":"accountId","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"category","type":["null",{"type":"record","name":"category","fields":[{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"type","type":["null",{"type":"record","name":"type","namespace":"category","fields":[{"name":"name","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"customer","type":["null",{"type":"record","name":"customer","fields":[{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"monthlyBudget","type":["null","int"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:55:43 destination > Overwrite mode 2023-01-24 09:55:43 destination > [Stream tempo_accounts] Tmp table _airbyte_tmp_osv_tempo_accounts location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/2ebaaecd-960d-49c9-b964-c3a3e1972de1/tempo_accounts 2023-01-24 09:55:43 destination > [Stream tempo_accounts] Data table tempo_accounts location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/raw/tempo_accounts 2023-01-24 09:55:43 destination > [Stream tempo_customers] Database schema: raw 2023-01-24 09:55:43 destination > Json schema for stream tempo_customers: {"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"integer"},"key":{"type":"string"},"name":{"type":"string"},"self":{"type":"string"}}} 2023-01-24 09:55:43 destination > Avro schema for stream tempo_customers: {"type":"record","name":"tempo_customers","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:55:43 destination > Full S3 path for stream 'tempo_customers': s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/2ebaaecd-960d-49c9-b964-c3a3e1972de1/tempo_customers/2023_01_24_1674554143408_0.parquet 2023-01-24 09:55:43 destination > [Stream tempo_customers] Parquet schema: {"type":"record","name":"tempo_customers","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:55:43 destination > Overwrite mode 2023-01-24 09:55:43 source > Read 14 records from customers stream 2023-01-24 09:55:43 source > Finished syncing customers 2023-01-24 09:55:43 source > SourceTempo runtimes: Syncing stream accounts 0:00:02.512847 Syncing stream customers 0:00:00.860040 2023-01-24 09:55:43 source > Syncing stream: worklogs 2023-01-24 09:55:43 destination > [Stream tempo_customers] Tmp table _airbyte_tmp_vko_tempo_customers location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/2ebaaecd-960d-49c9-b964-c3a3e1972de1/tempo_customers 2023-01-24 09:55:43 destination > [Stream tempo_customers] Data table tempo_customers location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/raw/tempo_customers 2023-01-24 09:55:43 destination > [Stream tempo_worklogs] Database schema: raw 2023-01-24 09:55:43 destination > Json schema for stream tempo_worklogs: {"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"self":{"type":"string","format":"uri","readOnly":true,"description":"The URL of the worklog"},"issue":{"type":"object","readOnly":true,"properties":{"id":{"type":"integer"},"self":{"type":"string"}},"description":"Details of the issue"},"author":{"type":"object","readOnly":true,"properties":{"self":{"type":["null","string"]},"accountId":{"type":"string"}},"description":"Author of the worklog"},"createdAt":{"type":"string","readOnly":true,"description":"Created at date of the worklog"},"startDate":{"type":"string","readOnly":true,"description":"Start Date of the worklog"},"startTime":{"type":["null","string"],"readOnly":true,"description":"Start time of the worklog"},"updatedAt":{"type":"string","readOnly":true,"description":"Updated at date of the worklog"},"attributes":{"type":"object","readOnly":true,"properties":{"self":{"type":"string"},"values":{"type":["null","array"],"items":{"type":"object","properties":{"key":{"type":"string"},"value":{"type":["null","string"]}}}}},"description":"Additional attribute of the worklog"},"description":{"type":["null","string"],"readOnly":true,"description":"Description of the worklog"},"tempoWorklogId":{"type":"integer","readOnly":true,"description":"The ID of the tempo worklog."},"billableSeconds":{"type":["null","integer"],"description":"Billable time spent working"},"timeSpentSeconds":{"type":"integer","readOnly":true,"description":"Time spend in seconds of the worklog"}}} 2023-01-24 09:55:43 destination > Schema name "values.items" contains illegal character(s) and is standardized to "values_items" 2023-01-24 09:55:43 destination > Avro schema for stream tempo_worklogs: {"type":"record","name":"tempo_worklogs","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"self","type":["null","string"],"default":null},{"name":"issue","type":["null",{"type":"record","name":"issue","fields":[{"name":"id","type":["null","int"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"author","type":["null",{"type":"record","name":"author","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"accountId","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"createdAt","type":["null","string"],"default":null},{"name":"startDate","type":["null","string"],"default":null},{"name":"startTime","type":["null","string"],"default":null},{"name":"updatedAt","type":["null","string"],"default":null},{"name":"attributes","type":["null",{"type":"record","name":"attributes","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"values","type":["null",{"type":"array","items":["null",{"type":"record","name":"values_items","namespace":"attributes","doc":"_airbyte_original_name:values.items","fields":[{"name":"key","type":["null","string"],"default":null},{"name":"value","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}]}],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"description","type":["null","string"],"default":null},{"name":"tempoWorklogId","type":["null","int"],"default":null},{"name":"billableSeconds","type":["null","int"],"default":null},{"name":"timeSpentSeconds","type":["null","int"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:55:43 destination > Full S3 path for stream 'tempo_worklogs': s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/2ebaaecd-960d-49c9-b964-c3a3e1972de1/tempo_worklogs/2023_01_24_1674554143793_0.parquet 2023-01-24 09:55:44 destination > [Stream tempo_worklogs] Parquet schema: {"type":"record","name":"tempo_worklogs","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"self","type":["null","string"],"default":null},{"name":"issue","type":["null",{"type":"record","name":"issue","fields":[{"name":"id","type":["null","int"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"author","type":["null",{"type":"record","name":"author","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"accountId","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"createdAt","type":["null","string"],"default":null},{"name":"startDate","type":["null","string"],"default":null},{"name":"startTime","type":["null","string"],"default":null},{"name":"updatedAt","type":["null","string"],"default":null},{"name":"attributes","type":["null",{"type":"record","name":"attributes","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"values","type":["null",{"type":"array","items":["null",{"type":"record","name":"values_items","namespace":"attributes","doc":"_airbyte_original_name:values.items","fields":[{"name":"key","type":["null","string"],"default":null},{"name":"value","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}]}],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"description","type":["null","string"],"default":null},{"name":"tempoWorklogId","type":["null","int"],"default":null},{"name":"billableSeconds","type":["null","int"],"default":null},{"name":"timeSpentSeconds","type":["null","int"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:55:44 destination > Overwrite mode 2023-01-24 09:55:44 destination > [Stream tempo_worklogs] Tmp table _airbyte_tmp_flb_tempo_worklogs location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/2ebaaecd-960d-49c9-b964-c3a3e1972de1/tempo_worklogs 2023-01-24 09:55:44 destination > [Stream tempo_worklogs] Data table tempo_worklogs location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/raw/tempo_worklogs 2023-01-24 09:55:44 destination > [Stream tempo_workload-schemes] Database schema: raw 2023-01-24 09:55:44 destination > Json schema for stream tempo_workload-schemes: {"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"integer","readOnly":true,"description":"The ID of the tempo Workload Scheme."},"days":{"type":"array","items":{"type":"object","properties":{"day":{"type":"string"},"requiredSeconds":{"type":"integer"}}},"readOnly":true,"description":"The days of the tempo Workload Scheme."},"name":{"type":"string","readOnly":true,"description":"The name of the tempo Workload Scheme."},"self":{"type":"string","format":"uri","readOnly":true,"description":"The URL of the Workload Scheme"},"description":{"type":"string","readOnly":true,"description":"The description of the tempo Workload Scheme."},"memberCount":{"type":"integer","readOnly":true,"description":"The memberCount of the tempo Workload Scheme."},"defaultScheme":{"type":"boolean","readOnly":true,"description":"The defaultScheme of the tempo Workload Scheme."}}} 2023-01-24 09:55:44 destination > Schema name "tempo_workload-schemes" contains illegal character(s) and is standardized to "tempo_workload_schemes" 2023-01-24 09:55:44 destination > Schema name "days.items" contains illegal character(s) and is standardized to "days_items" 2023-01-24 09:55:44 destination > Avro schema for stream tempo_workload-schemes: {"type":"record","name":"tempo_workload_schemes","doc":"_airbyte_original_name:tempo_workload-schemes","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"id","type":["null","int"],"default":null},{"name":"days","type":["null",{"type":"array","items":["null",{"type":"record","name":"days_items","doc":"_airbyte_original_name:days.items","fields":[{"name":"day","type":["null","string"],"default":null},{"name":"requiredSeconds","type":["null","int"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}]}],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"description","type":["null","string"],"default":null},{"name":"memberCount","type":["null","int"],"default":null},{"name":"defaultScheme","type":["null","boolean"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:55:44 destination > Full S3 path for stream 'tempo_workload-schemes': s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/2ebaaecd-960d-49c9-b964-c3a3e1972de1/tempo_workload-schemes/2023_01_24_1674554144181_0.parquet 2023-01-24 09:55:44 destination > [Stream tempo_workload-schemes] Parquet schema: {"type":"record","name":"tempo_workload_schemes","doc":"_airbyte_original_name:tempo_workload-schemes","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"id","type":["null","int"],"default":null},{"name":"days","type":["null",{"type":"array","items":["null",{"type":"record","name":"days_items","doc":"_airbyte_original_name:days.items","fields":[{"name":"day","type":["null","string"],"default":null},{"name":"requiredSeconds","type":["null","int"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}]}],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"description","type":["null","string"],"default":null},{"name":"memberCount","type":["null","int"],"default":null},{"name":"defaultScheme","type":["null","boolean"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:55:44 destination > Overwrite mode 2023-01-24 09:55:44 destination > [Stream tempo_workload-schemes] Tmp table _airbyte_tmp_qbx_tempo_workload_schemes location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/2ebaaecd-960d-49c9-b964-c3a3e1972de1/tempo_workload-schemes 2023-01-24 09:55:44 destination > [Stream tempo_workload-schemes] Data table tempo_workload_schemes location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/raw/tempo_workload-schemes 2023-01-24 09:55:44 destination > class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2023-01-24 09:55:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 1000 (603 KB) 2023-01-24 09:56:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 2000 (1 MB) 2023-01-24 09:56:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 3000 (1 MB) 2023-01-24 09:56:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 4000 (2 MB) 2023-01-24 09:56:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 5000 (3 MB) 2023-01-24 09:57:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 6000 (3 MB) 2023-01-24 09:57:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 7000 (4 MB) 2023-01-24 09:57:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 8000 (4 MB) 2023-01-24 09:58:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 9000 (5 MB) 2023-01-24 09:58:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 10000 (6 MB) 2023-01-24 09:58:28 destination > Flushing tempo_customers: 14 records (24 MB) 2023-01-24 09:58:28 destination > Flushing tempo_worklogs: 10185 records (24 MB) 2023-01-24 09:58:38 destination > Flushing tempo_accounts: 156 records (24 MB) 2023-01-24 09:59:02 destination > /airbyte/javabase.sh: line 26: 10 Killed /airbyte/bin/"$APPLICATION" "$@" 2023-01-24 09:59:08 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$6):231 - Running sync worker cancellation... 2023-01-24 09:59:08 INFO i.a.w.g.DefaultReplicationWorker(cancel):670 - Cancelling replication worker... 2023-01-24 09:59:18 INFO i.a.w.g.DefaultReplicationWorker(cancel):679 - Cancelling destination... 2023-01-24 09:59:18 INFO i.a.w.i.DefaultAirbyteDestination(cancel):138 - Attempting to cancel destination process... 2023-01-24 09:59:18 INFO i.a.w.i.DefaultAirbyteDestination(cancel):143 - Destination process exists, cancelling... 2023-01-24 09:59:18 INFO i.a.w.i.DefaultAirbyteDestination(cancel):145 - Cancelled destination process! 2023-01-24 09:59:18 INFO i.a.w.g.DefaultReplicationWorker(cancel):687 - Cancelling source... 2023-01-24 09:59:18 INFO i.a.w.i.DefaultAirbyteSource(cancel):162 - Attempting to cancel source process... 2023-01-24 09:59:18 INFO i.a.w.i.DefaultAirbyteSource(cancel):167 - Source process exists, cancelling... 2023-01-24 09:59:18 WARN i.a.c.i.LineGobbler(voidCall):119 - airbyte-source gobbler IOException: Stream closed. Typically happens when cancelling a job. 2023-01-24 09:59:18 ERROR i.a.w.g.DefaultReplicationWorker(replicate):255 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137 at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.general.DefaultReplicationWorker.replicate(DefaultReplicationWorker.java:247) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:171) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:87) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.40.28.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Suppressed: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:155) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.replicate(DefaultReplicationWorker.java:192) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:171) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:87) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.40.28.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Suppressed: java.io.IOException: Stream closed at java.lang.ProcessBuilder$NullOutputStream.write(ProcessBuilder.java:445) ~[?:?] at java.io.OutputStream.write(OutputStream.java:164) ~[?:?] at java.io.BufferedOutputStream.implWrite(BufferedOutputStream.java:216) ~[?:?] at java.io.BufferedOutputStream.write(BufferedOutputStream.java:205) ~[?:?] at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:313) ~[?:?] at sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:409) ~[?:?] at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:414) ~[?:?] at sun.nio.cs.StreamEncoder.lockedFlush(StreamEncoder.java:218) ~[?:?] at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:205) ~[?:?] at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:263) ~[?:?] at java.io.BufferedWriter.implFlush(BufferedWriter.java:372) ~[?:?] at java.io.BufferedWriter.flush(BufferedWriter.java:359) ~[?:?] at io.airbyte.workers.internal.DefaultAirbyteMessageBufferedWriter.flush(DefaultAirbyteMessageBufferedWriter.java:28) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.internal.DefaultAirbyteDestination.notifyEndOfInput(DefaultAirbyteDestination.java:109) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.internal.DefaultAirbyteDestination.close(DefaultAirbyteDestination.java:123) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.replicate(DefaultReplicationWorker.java:192) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:171) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:87) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.40.28.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Caused by: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137 at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromDstRunnable$4(DefaultReplicationWorker.java:297) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] ... 1 more 2023-01-24 09:59:18 INFO i.a.w.i.DefaultAirbyteSource(cancel):169 - Cancelled source process! 2023-01-24 09:59:18 INFO i.a.w.g.DefaultReplicationWorker(prepStateForLaterSaving):550 - Source did not output any state messages 2023-01-24 09:59:18 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$6):235 - Interrupting worker thread... 2023-01-24 09:59:18 WARN i.a.w.g.DefaultReplicationWorker(prepStateForLaterSaving):558 - State capture: No new state, falling back on input state: io.airbyte.config.State@1dd39cac[state={}] 2023-01-24 09:59:18 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$6):238 - Cancelling completable future... 2023-01-24 09:59:18 WARN i.a.c.t.CancellationHandler$TemporalCancellationHandler(checkAndHandleCancellation):53 - Job either timed out or was cancelled. 2023-01-24 09:59:18 WARN i.a.c.t.CancellationHandler$TemporalCancellationHandler(checkAndHandleCancellation):53 - Job either timed out or was cancelled. 2023-01-24 09:59:18 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-01-24 09:59:18 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):283 - Stopping temporal heartbeating... 2023-01-24 09:59:18 WARN i.t.i.a.ActivityTaskExecutors$BaseActivityTaskExecutor(execute):114 - Activity failure. ActivityId=9c8ccbea-8fc3-389c-8c6c-b6c498e6b8f3, activityType=Replicate, attempt=1 java.lang.RuntimeException: java.util.concurrent.CancellationException at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:281) ~[io.airbyte-airbyte-commons-temporal-0.40.28.jar:?] at io.airbyte.workers.temporal.sync.ReplicationActivityImpl.replicate(ReplicationActivityImpl.java:158) ~[io.airbyte-airbyte-workers-0.40.28.jar:?] at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?] at io.temporal.internal.activity.RootActivityInboundCallsInterceptor$POJOActivityInboundCallsInterceptor.executeActivity(RootActivityInboundCallsInterceptor.java:64) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.RootActivityInboundCallsInterceptor.execute(RootActivityInboundCallsInterceptor.java:43) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.ActivityTaskExecutors$BaseActivityTaskExecutor.execute(ActivityTaskExecutors.java:95) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.activity.ActivityTaskHandlerImpl.handle(ActivityTaskHandlerImpl.java:92) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handleActivity(ActivityWorker.java:241) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:206) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:179) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.17.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Caused by: java.util.concurrent.CancellationException at java.util.concurrent.CompletableFuture.cancel(CompletableFuture.java:2510) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getCancellationChecker$6(TemporalAttemptExecution.java:241) ~[io.airbyte-airbyte-workers-0.40.28.jar:?] at io.airbyte.commons.temporal.CancellationHandler$TemporalCancellationHandler.checkAndHandleCancellation(CancellationHandler.java:52) ~[io.airbyte-airbyte-commons-temporal-0.40.28.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getCancellationChecker$7(TemporalAttemptExecution.java:244) ~[io.airbyte-airbyte-workers-0.40.28.jar:?] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:577) ~[?:?] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:358) ~[?:?] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:305) ~[?:?] ... 3 more 2023-01-24 09:59:18 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):481 - sync summary: { "status" : "cancelled", "recordsSynced" : 10810, "bytesSynced" : 6891809, "startTime" : 1674554138369, "endTime" : 1674554358153, "totalStats" : { "bytesEmitted" : 6891809, "destinationStateMessagesEmitted" : 0, "destinationWriteEndTime" : 1674554342936, "destinationWriteStartTime" : 1674554138484, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0, "recordsEmitted" : 10810, "recordsCommitted" : 0, "replicationEndTime" : 1674554358152, "replicationStartTime" : 1674554138369, "sourceReadEndTime" : 0, "sourceReadStartTime" : 1674554138429, "sourceStateMessagesEmitted" : 0 }, "streamStats" : [ { "streamName" : "tempo_customers", "stats" : { "bytesEmitted" : 1180, "recordsEmitted" : 14 } }, { "streamName" : "tempo_worklogs", "stats" : { "bytesEmitted" : 6798931, "recordsEmitted" : 10640 } }, { "streamName" : "tempo_accounts", "stats" : { "bytesEmitted" : 91698, "recordsEmitted" : 156 } } ] } 2023-01-24 09:59:18 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):482 - failures: [ { "failureOrigin" : "destination", "internalMessage" : "io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process message delivery failed", "externalMessage" : "Something went wrong within the destination connector", "metadata" : { "attemptNumber" : 1, "jobId" : 24, "connector_command" : "write" }, "stacktrace" : "java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process message delivery failed\n\tat java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)\n\tat java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1589)\nCaused by: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process message delivery failed\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$6(DefaultReplicationWorker.java:372)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\t... 3 more\nCaused by: java.io.IOException: Stream closed\n\tat java.base/java.lang.ProcessBuilder$NullOutputStream.write(ProcessBuilder.java:445)\n\tat java.base/java.io.OutputStream.write(OutputStream.java:164)\n\tat java.base/java.io.BufferedOutputStream.implWrite(BufferedOutputStream.java:216)\n\tat java.base/java.io.BufferedOutputStream.write(BufferedOutputStream.java:205)\n\tat java.base/sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:313)\n\tat java.base/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:385)\n\tat java.base/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:361)\n\tat java.base/sun.nio.cs.StreamEncoder.lockedWrite(StreamEncoder.java:162)\n\tat java.base/sun.nio.cs.StreamEncoder.write(StreamEncoder.java:143)\n\tat java.base/java.io.OutputStreamWriter.write(OutputStreamWriter.java:220)\n\tat java.base/java.io.BufferedWriter.implFlushBuffer(BufferedWriter.java:178)\n\tat java.base/java.io.BufferedWriter.flushBuffer(BufferedWriter.java:163)\n\tat java.base/java.io.BufferedWriter.implWrite(BufferedWriter.java:334)\n\tat java.base/java.io.BufferedWriter.write(BufferedWriter.java:313)\n\tat java.base/java.io.Writer.write(Writer.java:278)\n\tat io.airbyte.workers.internal.VersionedAirbyteMessageBufferedWriter.write(VersionedAirbyteMessageBufferedWriter.java:30)\n\tat io.airbyte.workers.internal.DefaultAirbyteDestination.accept(DefaultAirbyteDestination.java:101)\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$6(DefaultReplicationWorker.java:369)\n\t... 4 more\n", "timestamp" : 1674554343474 }, { "failureOrigin" : "destination", "internalMessage" : "io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137", "externalMessage" : "Something went wrong within the destination connector", "metadata" : { "attemptNumber" : 1, "jobId" : 24, "connector_command" : "write" }, "stacktrace" : "java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137\n\tat java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)\n\tat java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1589)\nCaused by: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromDstRunnable$4(DefaultReplicationWorker.java:297)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\t... 3 more\n", "timestamp" : 1674554342937 } ] 2023-01-24 09:59:18 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:59:18 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END REPLICATION ----- 2023-01-24 09:59:18 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:59:18 WARN i.t.i.w.ActivityWorker$TaskHandlerImpl(logExceptionDuringResultReporting):365 - Failure during reporting of activity result to the server. ActivityId = 9c8ccbea-8fc3-389c-8c6c-b6c498e6b8f3, ActivityType = Replicate, WorkflowId=sync_24, WorkflowType=SyncWorkflow, RunId=8f750afa-ef44-46ad-9aa6-11363d807c6a io.grpc.StatusRuntimeException: NOT_FOUND: workflow execution already completed at io.grpc.stub.ClientCalls.toStatusRuntimeException(ClientCalls.java:271) ~[grpc-stub-1.51.1.jar:1.51.1] at io.grpc.stub.ClientCalls.getUnchecked(ClientCalls.java:252) ~[grpc-stub-1.51.1.jar:1.51.1] at io.grpc.stub.ClientCalls.blockingUnaryCall(ClientCalls.java:165) ~[grpc-stub-1.51.1.jar:1.51.1] at io.temporal.api.workflowservice.v1.WorkflowServiceGrpc$WorkflowServiceBlockingStub.respondActivityTaskFailed(WorkflowServiceGrpc.java:3866) ~[temporal-serviceclient-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.lambda$sendReply$1(ActivityWorker.java:320) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.retryer.GrpcRetryer.lambda$retry$0(GrpcRetryer.java:52) ~[temporal-serviceclient-1.17.0.jar:?] at io.temporal.internal.retryer.GrpcSyncRetryer.retry(GrpcSyncRetryer.java:67) ~[temporal-serviceclient-1.17.0.jar:?] at io.temporal.internal.retryer.GrpcRetryer.retryWithResult(GrpcRetryer.java:60) ~[temporal-serviceclient-1.17.0.jar:?] at io.temporal.internal.retryer.GrpcRetryer.retry(GrpcRetryer.java:50) ~[temporal-serviceclient-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.sendReply(ActivityWorker.java:315) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handleActivity(ActivityWorker.java:252) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:206) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:179) ~[temporal-sdk-1.17.0.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.17.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] 2023-01-24 09:59:03 INFO i.a.v.j.JsonSchemaValidator(test):130 - JSON schema validation failed. errors: $.s3_access_key_id: object found, string expected, $.s3_secret_access_key: object found, string expected 2023-01-24 09:59:03 INFO i.a.v.j.JsonSchemaValidator(test):130 - JSON schema validation failed. errors: $.data_source_type: does not have a value in the enumeration [Azure_Blob_Storage], $.azure_blob_storage_account_name: is missing but it is required, $.azure_blob_storage_container_name: is missing but it is required, $.azure_blob_storage_sas_token: is missing but it is required 2023-01-24 09:59:04 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/24/2/logs.log 2023-01-24 09:59:04 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.40.28 2023-01-24 09:59:04 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation 2023-01-24 09:59:04 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:59:04 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2023-01-24 09:59:04 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:59:04 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-tempo:0.3.0 exists... 2023-01-24 09:59:04 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-tempo:0.3.0 was found locally. 2023-01-24 09:59:04 INFO i.a.w.p.DockerProcessFactory(create):120 - Creating docker container = source-tempo-check-24-2-caqjx with resources io.airbyte.config.ResourceRequirements@7fbae1ba[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2023-01-24 09:59:04 INFO i.a.w.p.DockerProcessFactory(create):164 - Preparing command: docker run --rm --init -i -w /data/24/2 --log-driver none --name source-tempo-check-24-2-caqjx --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e FIELD_SELECTION_WORKSPACES= -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_CONNECTOR_IMAGE=airbyte/source-tempo:0.3.0 -e WORKER_JOB_ATTEMPT=2 -e AUTO_DETECT_SCHEMA=false -e AIRBYTE_VERSION=0.40.28 -e WORKER_JOB_ID=24 airbyte/source-tempo:0.3.0 check --config source_config.json 2023-01-24 09:59:04 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):100 - Reading messages from protocol version 0.2.0 2023-01-24 09:59:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Check succeeded 2023-01-24 09:59:09 INFO i.a.w.g.DefaultCheckConnectionWorker(run):110 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@2126d039[status=succeeded,message=] 2023-01-24 09:59:09 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-01-24 09:59:09 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:59:09 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2023-01-24 09:59:09 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:59:09 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/24/2/logs.log 2023-01-24 09:59:09 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.40.28 2023-01-24 09:59:09 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation 2023-01-24 09:59:09 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:59:09 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2023-01-24 09:59:09 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:59:09 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-databricks:0.3.1 exists... 2023-01-24 09:59:09 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-databricks:0.3.1 was found locally. 2023-01-24 09:59:09 INFO i.a.w.p.DockerProcessFactory(create):120 - Creating docker container = destination-databricks-check-24-2-rsytv with resources io.airbyte.config.ResourceRequirements@7fbae1ba[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2023-01-24 09:59:09 INFO i.a.w.p.DockerProcessFactory(create):164 - Preparing command: docker run --rm --init -i -w /data/24/2 --log-driver none --name destination-databricks-check-24-2-rsytv --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e FIELD_SELECTION_WORKSPACES= -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_CONNECTOR_IMAGE=airbyte/destination-databricks:0.3.1 -e WORKER_JOB_ATTEMPT=2 -e AUTO_DETECT_SCHEMA=false -e AIRBYTE_VERSION=0.40.28 -e WORKER_JOB_ID=24 airbyte/destination-databricks:0.3.1 check --config source_config.json 2023-01-24 09:59:09 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):100 - Reading messages from protocol version 0.2.0 2023-01-24 09:59:12 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - integration args: {check=null, config=source_config.json} 2023-01-24 09:59:12 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Running integration: io.airbyte.integrations.destination.databricks.DatabricksDestination 2023-01-24 09:59:12 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Command: CHECK 2023-01-24 09:59:12 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2023-01-24 09:59:13 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):117 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-01-24 09:59:13 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):117 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-01-24 09:59:13 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Using destination type: S3 2023-01-24 09:59:13 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Databricks storage type config: "S3" 2023-01-24 09:59:13 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Creating S3 client... 2023-01-24 09:59:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Storage Object kaltura-343887820357-dev-eu-west-1-data/kaltura-343887820357-dev-eu-west-1-data does not exist in bucket; creating... 2023-01-24 09:59:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Storage Object kaltura-343887820357-dev-eu-west-1-data/kaltura-343887820357-dev-eu-west-1-data has been created in bucket. 2023-01-24 09:59:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Started testing if IAM user can call listObjects on the destination bucket 2023-01-24 09:59:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Finished checking for listObjects permission 2023-01-24 09:59:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Databricks storage type config: "S3" 2023-01-24 09:59:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Starting... 2023-01-24 09:59:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Start completed. 2023-01-24 09:59:17 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Driver does not support get/set network timeout for connections. ([Databricks][JDBC](10220) Driver does not support this optional feature.) 2023-01-24 09:59:22 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Shutdown initiated... 2023-01-24 09:59:22 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):117 - Timed-out waiting for add connection executor to shutdown 2023-01-24 09:59:22 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - HikariPool-1 - Shutdown completed. 2023-01-24 09:59:22 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):120 - Completed integration: io.airbyte.integrations.destination.databricks.DatabricksDestination 2023-01-24 09:59:22 INFO i.a.w.g.DefaultCheckConnectionWorker(run):110 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@4dc35f3f[status=succeeded,message=] 2023-01-24 09:59:22 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:59:22 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-01-24 09:59:22 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2023-01-24 09:59:22 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:59:22 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/24/2/logs.log 2023-01-24 09:59:22 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.40.28 2023-01-24 09:59:22 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to save workflow id for cancellation 2023-01-24 09:59:22 INFO i.a.c.EnvConfigs(getEnvOrDefault):1173 - Using default value for environment variable METRIC_CLIENT: '' 2023-01-24 09:59:22 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2023-01-24 09:59:22 INFO i.a.w.g.DefaultReplicationWorker(run):148 - start sync worker. job id: 24 attempt id: 2 2023-01-24 09:59:22 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:59:22 INFO i.a.w.g.DefaultReplicationWorker(run):163 - configured sync modes: {null.customers=full_refresh - overwrite, null.accounts=full_refresh - overwrite, null.worklogs=full_refresh - overwrite, null.workload-schemes=full_refresh - overwrite} 2023-01-24 09:59:22 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START REPLICATION ----- 2023-01-24 09:59:22 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 09:59:22 INFO i.a.w.i.DefaultAirbyteDestination(start):78 - Running destination... 2023-01-24 09:59:22 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-databricks:0.3.1 exists... 2023-01-24 09:59:22 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-databricks:0.3.1 was found locally. 2023-01-24 09:59:22 INFO i.a.w.p.DockerProcessFactory(create):120 - Creating docker container = destination-databricks-write-24-2-pliwh with resources io.airbyte.config.ResourceRequirements@7f0c9de0[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2023-01-24 09:59:22 INFO i.a.w.p.DockerProcessFactory(create):164 - Preparing command: docker run --rm --init -i -w /data/24/2 --log-driver none --name destination-databricks-write-24-2-pliwh --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e FIELD_SELECTION_WORKSPACES= -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_CONNECTOR_IMAGE=airbyte/destination-databricks:0.3.1 -e WORKER_JOB_ATTEMPT=2 -e AUTO_DETECT_SCHEMA=false -e AIRBYTE_VERSION=0.40.28 -e WORKER_JOB_ID=24 airbyte/destination-databricks:0.3.1 write --config destination_config.json --catalog destination_catalog.json 2023-01-24 09:59:22 INFO i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):33 - Writing messages to protocol version 0.2.0 2023-01-24 09:59:22 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):100 - Reading messages from protocol version 0.2.0 2023-01-24 09:59:22 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-tempo:0.3.0 exists... 2023-01-24 09:59:22 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-tempo:0.3.0 was found locally. 2023-01-24 09:59:22 INFO i.a.w.p.DockerProcessFactory(create):120 - Creating docker container = source-tempo-read-24-2-nlane with resources io.airbyte.config.ResourceRequirements@33872708[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2023-01-24 09:59:22 INFO i.a.w.p.DockerProcessFactory(create):164 - Preparing command: docker run --rm --init -i -w /data/24/2 --log-driver none --name source-tempo-read-24-2-nlane --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e FIELD_SELECTION_WORKSPACES= -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_CONNECTOR_IMAGE=airbyte/source-tempo:0.3.0 -e WORKER_JOB_ATTEMPT=2 -e AUTO_DETECT_SCHEMA=false -e AIRBYTE_VERSION=0.40.28 -e WORKER_JOB_ID=24 airbyte/source-tempo:0.3.0 read --config source_config.json --catalog source_catalog.json --state input_state.json 2023-01-24 09:59:22 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):100 - Reading messages from protocol version 0.2.0 2023-01-24 09:59:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromDstRunnable$4):271 - Destination output thread started. 2023-01-24 09:59:22 INFO i.a.w.g.DefaultReplicationWorker(replicate):243 - Waiting for source and destination threads to complete. 2023-01-24 09:59:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):333 - Replication thread started. 2023-01-24 09:59:24 destination > integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2023-01-24 09:59:24 destination > Running integration: io.airbyte.integrations.destination.databricks.DatabricksDestination 2023-01-24 09:59:24 destination > Command: WRITE 2023-01-24 09:59:24 destination > Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2023-01-24 09:59:24 destination > Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-01-24 09:59:24 destination > Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-01-24 09:59:24 destination > Using destination type: S3 2023-01-24 09:59:24 destination > Databricks storage type config: "S3" 2023-01-24 09:59:24 destination > Databricks storage type config: "S3" 2023-01-24 09:59:24 destination > HikariPool-1 - Starting... 2023-01-24 09:59:24 source > Starting syncing SourceTempo 2023-01-24 09:59:24 destination > HikariPool-1 - Start completed. 2023-01-24 09:59:24 source > Syncing stream: accounts 2023-01-24 09:59:24 destination > Creating S3 client... 2023-01-24 09:59:25 destination > [Stream tempo_accounts] Database schema: raw 2023-01-24 09:59:25 destination > Json schema for stream tempo_accounts: {"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"integer"},"key":{"type":"string"},"lead":{"type":"object","properties":{"self":{"type":["null","string"]},"accountId":{"type":"string"}}},"name":{"type":"string"},"self":{"type":"string"},"links":{"type":"object","properties":{"self":{"type":"string"}}},"global":{"type":"boolean"},"status":{"type":"string"},"contact":{"type":"object","properties":{"self":{"type":"string"},"type":{"type":"string"},"accountId":{"type":"string"}}},"category":{"type":"object","properties":{"id":{"type":"integer"},"key":{"type":"string"},"name":{"type":"string"},"self":{"type":"string"},"type":{"type":"object","properties":{"name":{"type":"string"}}}}},"customer":{"type":["null","object"],"properties":{"id":{"type":"integer"},"key":{"type":"string"},"name":{"type":"string"},"self":{"type":"string"}}},"monthlyBudget":{"type":["null","integer"]}}} 2023-01-24 09:59:25 destination > Avro schema for stream tempo_accounts: {"type":"record","name":"tempo_accounts","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"lead","type":["null",{"type":"record","name":"lead","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"accountId","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"links","type":["null",{"type":"record","name":"links","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"global","type":["null","boolean"],"default":null},{"name":"status","type":["null","string"],"default":null},{"name":"contact","type":["null",{"type":"record","name":"contact","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"type","type":["null","string"],"default":null},{"name":"accountId","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"category","type":["null",{"type":"record","name":"category","fields":[{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"type","type":["null",{"type":"record","name":"type","namespace":"category","fields":[{"name":"name","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"customer","type":["null",{"type":"record","name":"customer","fields":[{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"monthlyBudget","type":["null","int"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:59:25 destination > Full S3 path for stream 'tempo_accounts': s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/57a20efb-5db9-4861-9bfb-be6aa28bd919/tempo_accounts/2023_01_24_1674554365078_0.parquet 2023-01-24 09:59:25 destination > Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-01-24 09:59:25 destination > Cannot locate configuration: tried hadoop-metrics2-s3a-file-system.properties,hadoop-metrics2.properties 2023-01-24 09:59:25 destination > Scheduled Metric snapshot period at 10 second(s). 2023-01-24 09:59:25 destination > s3a-file-system metrics system started 2023-01-24 09:59:27 source > Read 156 records from accounts stream 2023-01-24 09:59:27 source > Finished syncing accounts 2023-01-24 09:59:27 source > SourceTempo runtimes: Syncing stream accounts 0:00:03.079291 2023-01-24 09:59:27 source > Syncing stream: customers 2023-01-24 09:59:27 destination > [Stream tempo_accounts] Parquet schema: {"type":"record","name":"tempo_accounts","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"lead","type":["null",{"type":"record","name":"lead","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"accountId","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"links","type":["null",{"type":"record","name":"links","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"global","type":["null","boolean"],"default":null},{"name":"status","type":["null","string"],"default":null},{"name":"contact","type":["null",{"type":"record","name":"contact","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"type","type":["null","string"],"default":null},{"name":"accountId","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"category","type":["null",{"type":"record","name":"category","fields":[{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"type","type":["null",{"type":"record","name":"type","namespace":"category","fields":[{"name":"name","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"customer","type":["null",{"type":"record","name":"customer","fields":[{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"monthlyBudget","type":["null","int"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:59:28 destination > Overwrite mode 2023-01-24 09:59:28 destination > [Stream tempo_accounts] Tmp table _airbyte_tmp_tps_tempo_accounts location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/57a20efb-5db9-4861-9bfb-be6aa28bd919/tempo_accounts 2023-01-24 09:59:28 destination > [Stream tempo_accounts] Data table tempo_accounts location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/raw/tempo_accounts 2023-01-24 09:59:28 destination > [Stream tempo_customers] Database schema: raw 2023-01-24 09:59:28 destination > Json schema for stream tempo_customers: {"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"integer"},"key":{"type":"string"},"name":{"type":"string"},"self":{"type":"string"}}} 2023-01-24 09:59:28 destination > Avro schema for stream tempo_customers: {"type":"record","name":"tempo_customers","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:59:28 destination > Full S3 path for stream 'tempo_customers': s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/57a20efb-5db9-4861-9bfb-be6aa28bd919/tempo_customers/2023_01_24_1674554368408_0.parquet 2023-01-24 09:59:28 source > Read 14 records from customers stream 2023-01-24 09:59:28 source > Finished syncing customers 2023-01-24 09:59:28 source > SourceTempo runtimes: Syncing stream accounts 0:00:03.079291 Syncing stream customers 0:00:00.893690 2023-01-24 09:59:28 source > Syncing stream: worklogs 2023-01-24 09:59:28 destination > [Stream tempo_customers] Parquet schema: {"type":"record","name":"tempo_customers","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"id","type":["null","int"],"default":null},{"name":"key","type":["null","string"],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:59:28 destination > Overwrite mode 2023-01-24 09:59:28 destination > [Stream tempo_customers] Tmp table _airbyte_tmp_hhs_tempo_customers location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/57a20efb-5db9-4861-9bfb-be6aa28bd919/tempo_customers 2023-01-24 09:59:28 destination > [Stream tempo_customers] Data table tempo_customers location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/raw/tempo_customers 2023-01-24 09:59:28 destination > [Stream tempo_worklogs] Database schema: raw 2023-01-24 09:59:28 destination > Json schema for stream tempo_worklogs: {"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"self":{"type":"string","format":"uri","readOnly":true,"description":"The URL of the worklog"},"issue":{"type":"object","readOnly":true,"properties":{"id":{"type":"integer"},"self":{"type":"string"}},"description":"Details of the issue"},"author":{"type":"object","readOnly":true,"properties":{"self":{"type":["null","string"]},"accountId":{"type":"string"}},"description":"Author of the worklog"},"createdAt":{"type":"string","readOnly":true,"description":"Created at date of the worklog"},"startDate":{"type":"string","readOnly":true,"description":"Start Date of the worklog"},"startTime":{"type":["null","string"],"readOnly":true,"description":"Start time of the worklog"},"updatedAt":{"type":"string","readOnly":true,"description":"Updated at date of the worklog"},"attributes":{"type":"object","readOnly":true,"properties":{"self":{"type":"string"},"values":{"type":["null","array"],"items":{"type":"object","properties":{"key":{"type":"string"},"value":{"type":["null","string"]}}}}},"description":"Additional attribute of the worklog"},"description":{"type":["null","string"],"readOnly":true,"description":"Description of the worklog"},"tempoWorklogId":{"type":"integer","readOnly":true,"description":"The ID of the tempo worklog."},"billableSeconds":{"type":["null","integer"],"description":"Billable time spent working"},"timeSpentSeconds":{"type":"integer","readOnly":true,"description":"Time spend in seconds of the worklog"}}} 2023-01-24 09:59:28 destination > Schema name "values.items" contains illegal character(s) and is standardized to "values_items" 2023-01-24 09:59:28 destination > Avro schema for stream tempo_worklogs: {"type":"record","name":"tempo_worklogs","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"self","type":["null","string"],"default":null},{"name":"issue","type":["null",{"type":"record","name":"issue","fields":[{"name":"id","type":["null","int"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"author","type":["null",{"type":"record","name":"author","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"accountId","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"createdAt","type":["null","string"],"default":null},{"name":"startDate","type":["null","string"],"default":null},{"name":"startTime","type":["null","string"],"default":null},{"name":"updatedAt","type":["null","string"],"default":null},{"name":"attributes","type":["null",{"type":"record","name":"attributes","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"values","type":["null",{"type":"array","items":["null",{"type":"record","name":"values_items","namespace":"attributes","doc":"_airbyte_original_name:values.items","fields":[{"name":"key","type":["null","string"],"default":null},{"name":"value","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}]}],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"description","type":["null","string"],"default":null},{"name":"tempoWorklogId","type":["null","int"],"default":null},{"name":"billableSeconds","type":["null","int"],"default":null},{"name":"timeSpentSeconds","type":["null","int"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:59:28 destination > Full S3 path for stream 'tempo_worklogs': s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/57a20efb-5db9-4861-9bfb-be6aa28bd919/tempo_worklogs/2023_01_24_1674554368838_0.parquet 2023-01-24 09:59:29 destination > [Stream tempo_worklogs] Parquet schema: {"type":"record","name":"tempo_worklogs","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"self","type":["null","string"],"default":null},{"name":"issue","type":["null",{"type":"record","name":"issue","fields":[{"name":"id","type":["null","int"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"author","type":["null",{"type":"record","name":"author","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"accountId","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"createdAt","type":["null","string"],"default":null},{"name":"startDate","type":["null","string"],"default":null},{"name":"startTime","type":["null","string"],"default":null},{"name":"updatedAt","type":["null","string"],"default":null},{"name":"attributes","type":["null",{"type":"record","name":"attributes","fields":[{"name":"self","type":["null","string"],"default":null},{"name":"values","type":["null",{"type":"array","items":["null",{"type":"record","name":"values_items","namespace":"attributes","doc":"_airbyte_original_name:values.items","fields":[{"name":"key","type":["null","string"],"default":null},{"name":"value","type":["null","string"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}]}],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}],"default":null},{"name":"description","type":["null","string"],"default":null},{"name":"tempoWorklogId","type":["null","int"],"default":null},{"name":"billableSeconds","type":["null","int"],"default":null},{"name":"timeSpentSeconds","type":["null","int"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:59:29 destination > Overwrite mode 2023-01-24 09:59:29 destination > [Stream tempo_worklogs] Tmp table _airbyte_tmp_yle_tempo_worklogs location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/57a20efb-5db9-4861-9bfb-be6aa28bd919/tempo_worklogs 2023-01-24 09:59:29 destination > [Stream tempo_worklogs] Data table tempo_worklogs location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/raw/tempo_worklogs 2023-01-24 09:59:29 destination > [Stream tempo_workload-schemes] Database schema: raw 2023-01-24 09:59:29 destination > Json schema for stream tempo_workload-schemes: {"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"integer","readOnly":true,"description":"The ID of the tempo Workload Scheme."},"days":{"type":"array","items":{"type":"object","properties":{"day":{"type":"string"},"requiredSeconds":{"type":"integer"}}},"readOnly":true,"description":"The days of the tempo Workload Scheme."},"name":{"type":"string","readOnly":true,"description":"The name of the tempo Workload Scheme."},"self":{"type":"string","format":"uri","readOnly":true,"description":"The URL of the Workload Scheme"},"description":{"type":"string","readOnly":true,"description":"The description of the tempo Workload Scheme."},"memberCount":{"type":"integer","readOnly":true,"description":"The memberCount of the tempo Workload Scheme."},"defaultScheme":{"type":"boolean","readOnly":true,"description":"The defaultScheme of the tempo Workload Scheme."}}} 2023-01-24 09:59:29 destination > Schema name "tempo_workload-schemes" contains illegal character(s) and is standardized to "tempo_workload_schemes" 2023-01-24 09:59:29 destination > Schema name "days.items" contains illegal character(s) and is standardized to "days_items" 2023-01-24 09:59:29 destination > Avro schema for stream tempo_workload-schemes: {"type":"record","name":"tempo_workload_schemes","doc":"_airbyte_original_name:tempo_workload-schemes","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"id","type":["null","int"],"default":null},{"name":"days","type":["null",{"type":"array","items":["null",{"type":"record","name":"days_items","doc":"_airbyte_original_name:days.items","fields":[{"name":"day","type":["null","string"],"default":null},{"name":"requiredSeconds","type":["null","int"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}]}],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"description","type":["null","string"],"default":null},{"name":"memberCount","type":["null","int"],"default":null},{"name":"defaultScheme","type":["null","boolean"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:59:29 destination > Full S3 path for stream 'tempo_workload-schemes': s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/57a20efb-5db9-4861-9bfb-be6aa28bd919/tempo_workload-schemes/2023_01_24_1674554369270_0.parquet 2023-01-24 09:59:29 destination > [Stream tempo_workload-schemes] Parquet schema: {"type":"record","name":"tempo_workload_schemes","doc":"_airbyte_original_name:tempo_workload-schemes","fields":[{"name":"_airbyte_ab_id","type":{"type":"string","logicalType":"uuid"}},{"name":"_airbyte_emitted_at","type":{"type":"long","logicalType":"timestamp-millis"}},{"name":"id","type":["null","int"],"default":null},{"name":"days","type":["null",{"type":"array","items":["null",{"type":"record","name":"days_items","doc":"_airbyte_original_name:days.items","fields":[{"name":"day","type":["null","string"],"default":null},{"name":"requiredSeconds","type":["null","int"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]}]}],"default":null},{"name":"name","type":["null","string"],"default":null},{"name":"self","type":["null","string"],"default":null},{"name":"description","type":["null","string"],"default":null},{"name":"memberCount","type":["null","int"],"default":null},{"name":"defaultScheme","type":["null","boolean"],"default":null},{"name":"_airbyte_additional_properties","type":["null",{"type":"map","values":"string"}],"default":null}]} 2023-01-24 09:59:29 destination > Overwrite mode 2023-01-24 09:59:29 destination > [Stream tempo_workload-schemes] Tmp table _airbyte_tmp_phm_tempo_workload_schemes location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/57a20efb-5db9-4861-9bfb-be6aa28bd919/tempo_workload-schemes 2023-01-24 09:59:29 destination > [Stream tempo_workload-schemes] Data table tempo_workload_schemes location: s3://kaltura-343887820357-dev-eu-west-1-data/air-bytes/raw/tempo_workload-schemes 2023-01-24 09:59:29 destination > class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2023-01-24 09:59:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 1000 (603 KB) 2023-01-24 09:59:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 2000 (1 MB) 2023-01-24 10:00:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 3000 (1 MB) 2023-01-24 10:00:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 4000 (2 MB) 2023-01-24 10:00:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 5000 (3 MB) 2023-01-24 10:01:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 6000 (3 MB) 2023-01-24 10:01:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 7000 (4 MB) 2023-01-24 10:01:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 8000 (4 MB) 2023-01-24 10:02:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 9000 (5 MB) 2023-01-24 10:02:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 10000 (6 MB) 2023-01-24 10:02:27 destination > Flushing tempo_customers: 14 records (24 MB) 2023-01-24 10:02:27 destination > Flushing tempo_worklogs: 10185 records (24 MB) 2023-01-24 10:02:29 destination > Flushing tempo_accounts: 156 records (24 MB) 2023-01-24 10:02:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 11000 (6 MB) 2023-01-24 10:03:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 12000 (7 MB) 2023-01-24 10:03:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 13000 (7 MB) 2023-01-24 10:03:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 14000 (8 MB) 2023-01-24 10:03:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 15000 (9 MB) 2023-01-24 10:04:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 16000 (9 MB) 2023-01-24 10:04:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 17000 (10 MB) 2023-01-24 10:04:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 18000 (10 MB) 2023-01-24 10:05:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 19000 (11 MB) 2023-01-24 10:05:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):378 - Records read: 20000 (12 MB) 2023-01-24 10:05:29 destination > Flushing tempo_worklogs: 10261 records (24 MB) 2023-01-24 10:05:32 destination > /airbyte/javabase.sh: line 26: 11 Killed /airbyte/bin/"$APPLICATION" "$@" 2023-01-24 10:06:32 WARN i.a.c.i.LineGobbler(voidCall):119 - airbyte-source gobbler IOException: Stream closed. Typically happens when cancelling a job. 2023-01-24 10:06:32 ERROR i.a.w.g.DefaultReplicationWorker(replicate):255 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137 at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.general.DefaultReplicationWorker.replicate(DefaultReplicationWorker.java:247) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:171) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:87) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.40.28.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Suppressed: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:155) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.replicate(DefaultReplicationWorker.java:192) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:171) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:87) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.40.28.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Suppressed: java.io.IOException: Stream closed at java.lang.ProcessBuilder$NullOutputStream.write(ProcessBuilder.java:445) ~[?:?] at java.io.OutputStream.write(OutputStream.java:164) ~[?:?] at java.io.BufferedOutputStream.implWrite(BufferedOutputStream.java:216) ~[?:?] at java.io.BufferedOutputStream.write(BufferedOutputStream.java:205) ~[?:?] at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:313) ~[?:?] at sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:409) ~[?:?] at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:414) ~[?:?] at sun.nio.cs.StreamEncoder.lockedFlush(StreamEncoder.java:218) ~[?:?] at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:205) ~[?:?] at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:263) ~[?:?] at java.io.BufferedWriter.implFlush(BufferedWriter.java:372) ~[?:?] at java.io.BufferedWriter.flush(BufferedWriter.java:359) ~[?:?] at io.airbyte.workers.internal.DefaultAirbyteMessageBufferedWriter.flush(DefaultAirbyteMessageBufferedWriter.java:28) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.internal.DefaultAirbyteDestination.notifyEndOfInput(DefaultAirbyteDestination.java:109) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.internal.DefaultAirbyteDestination.close(DefaultAirbyteDestination.java:123) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.replicate(DefaultReplicationWorker.java:192) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:171) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:87) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.40.28.jar:?] at java.lang.Thread.run(Thread.java:1589) ~[?:?] Caused by: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137 at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromDstRunnable$4(DefaultReplicationWorker.java:297) ~[io.airbyte-airbyte-commons-worker-0.40.28.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?] ... 1 more 2023-01-24 10:06:32 INFO i.a.w.g.DefaultReplicationWorker(prepStateForLaterSaving):550 - Source did not output any state messages 2023-01-24 10:06:32 WARN i.a.w.g.DefaultReplicationWorker(prepStateForLaterSaving):558 - State capture: No new state, falling back on input state: io.airbyte.config.State@3db32923[state={}] 2023-01-24 10:06:32 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):481 - sync summary: { "status" : "failed", "recordsSynced" : 20661, "bytesSynced" : 13083397, "startTime" : 1674554362552, "endTime" : 1674554792634, "totalStats" : { "bytesEmitted" : 13083397, "destinationStateMessagesEmitted" : 0, "destinationWriteEndTime" : 1674554732654, "destinationWriteStartTime" : 1674554362656, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0, "recordsEmitted" : 20661, "recordsCommitted" : 0, "replicationEndTime" : 1674554792633, "replicationStartTime" : 1674554362552, "sourceReadEndTime" : 0, "sourceReadStartTime" : 1674554362603, "sourceStateMessagesEmitted" : 0 }, "streamStats" : [ { "streamName" : "tempo_customers", "stats" : { "bytesEmitted" : 1180, "recordsEmitted" : 14 } }, { "streamName" : "tempo_worklogs", "stats" : { "bytesEmitted" : 12990519, "recordsEmitted" : 20491 } }, { "streamName" : "tempo_accounts", "stats" : { "bytesEmitted" : 91698, "recordsEmitted" : 156 } } ] } 2023-01-24 10:06:32 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):482 - failures: [ { "failureOrigin" : "destination", "internalMessage" : "io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process message delivery failed", "externalMessage" : "Something went wrong within the destination connector", "metadata" : { "attemptNumber" : 2, "jobId" : 24, "connector_command" : "write" }, "stacktrace" : "java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process message delivery failed\n\tat java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)\n\tat java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1589)\nCaused by: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process message delivery failed\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$6(DefaultReplicationWorker.java:372)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\t... 3 more\nCaused by: java.io.IOException: Stream closed\n\tat java.base/java.lang.ProcessBuilder$NullOutputStream.write(ProcessBuilder.java:445)\n\tat java.base/java.io.OutputStream.write(OutputStream.java:164)\n\tat java.base/java.io.BufferedOutputStream.implWrite(BufferedOutputStream.java:216)\n\tat java.base/java.io.BufferedOutputStream.write(BufferedOutputStream.java:205)\n\tat java.base/sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:313)\n\tat java.base/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:385)\n\tat java.base/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:361)\n\tat java.base/sun.nio.cs.StreamEncoder.lockedWrite(StreamEncoder.java:162)\n\tat java.base/sun.nio.cs.StreamEncoder.write(StreamEncoder.java:143)\n\tat java.base/java.io.OutputStreamWriter.write(OutputStreamWriter.java:220)\n\tat java.base/java.io.BufferedWriter.implFlushBuffer(BufferedWriter.java:178)\n\tat java.base/java.io.BufferedWriter.flushBuffer(BufferedWriter.java:163)\n\tat java.base/java.io.BufferedWriter.implWrite(BufferedWriter.java:334)\n\tat java.base/java.io.BufferedWriter.write(BufferedWriter.java:313)\n\tat java.base/java.io.Writer.write(Writer.java:278)\n\tat io.airbyte.workers.internal.VersionedAirbyteMessageBufferedWriter.write(VersionedAirbyteMessageBufferedWriter.java:30)\n\tat io.airbyte.workers.internal.DefaultAirbyteDestination.accept(DefaultAirbyteDestination.java:101)\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$6(DefaultReplicationWorker.java:369)\n\t... 4 more\n", "timestamp" : 1674554733943 }, { "failureOrigin" : "destination", "internalMessage" : "io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137", "externalMessage" : "Something went wrong within the destination connector", "metadata" : { "attemptNumber" : 2, "jobId" : 24, "connector_command" : "write" }, "stacktrace" : "java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137\n\tat java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)\n\tat java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1589)\nCaused by: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromDstRunnable$4(DefaultReplicationWorker.java:297)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\t... 3 more\n", "timestamp" : 1674554732657 } ] 2023-01-24 10:06:32 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 10:06:32 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END REPLICATION ----- 2023-01-24 10:06:32 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-01-24 10:06:32 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-01-24 10:06:32 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):207 - sync summary: io.airbyte.config.StandardSyncOutput@12e02e0[standardSyncSummary=io.airbyte.config.StandardSyncSummary@76af8606[status=failed,recordsSynced=20661,bytesSynced=13083397,startTime=1674554362552,endTime=1674554792634,totalStats=io.airbyte.config.SyncStats@6889796f[bytesEmitted=13083397,destinationStateMessagesEmitted=0,destinationWriteEndTime=1674554732654,destinationWriteStartTime=1674554362656,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,recordsEmitted=20661,recordsCommitted=0,replicationEndTime=1674554792633,replicationStartTime=1674554362552,sourceReadEndTime=0,sourceReadStartTime=1674554362603,sourceStateMessagesEmitted=0,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@d2b01af[streamName=tempo_customers,streamNamespace=,stats=io.airbyte.config.SyncStats@7ce32be8[bytesEmitted=1180,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=14,recordsCommitted=,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@76f60dc4[streamName=tempo_worklogs,streamNamespace=,stats=io.airbyte.config.SyncStats@55175074[bytesEmitted=12990519,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=20491,recordsCommitted=,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@e40500[streamName=tempo_accounts,streamNamespace=,stats=io.airbyte.config.SyncStats@653dc29f[bytesEmitted=91698,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=156,recordsCommitted=,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}]]]],normalizationSummary=,webhookOperationSummary=,state=io.airbyte.config.State@3db32923[state={}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@23e36bd1[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@4c981b29[stream=io.airbyte.protocol.models.AirbyteStream@6cf4dbbf[name=tempo_accounts,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"integer"},"key":{"type":"string"},"lead":{"type":"object","properties":{"self":{"type":["null","string"]},"accountId":{"type":"string"}}},"name":{"type":"string"},"self":{"type":"string"},"links":{"type":"object","properties":{"self":{"type":"string"}}},"global":{"type":"boolean"},"status":{"type":"string"},"contact":{"type":"object","properties":{"self":{"type":"string"},"type":{"type":"string"},"accountId":{"type":"string"}}},"category":{"type":"object","properties":{"id":{"type":"integer"},"key":{"type":"string"},"name":{"type":"string"},"self":{"type":"string"},"type":{"type":"object","properties":{"name":{"type":"string"}}}}},"customer":{"type":["null","object"],"properties":{"id":{"type":"integer"},"key":{"type":"string"},"name":{"type":"string"},"self":{"type":"string"}}},"monthlyBudget":{"type":["null","integer"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@67d6d584[stream=io.airbyte.protocol.models.AirbyteStream@5fd3974c[name=tempo_customers,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"integer"},"key":{"type":"string"},"name":{"type":"string"},"self":{"type":"string"}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@531e8ecc[stream=io.airbyte.protocol.models.AirbyteStream@197d9e33[name=tempo_worklogs,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"self":{"type":"string","format":"uri","readOnly":true,"description":"The URL of the worklog"},"issue":{"type":"object","readOnly":true,"properties":{"id":{"type":"integer"},"self":{"type":"string"}},"description":"Details of the issue"},"author":{"type":"object","readOnly":true,"properties":{"self":{"type":["null","string"]},"accountId":{"type":"string"}},"description":"Author of the worklog"},"createdAt":{"type":"string","readOnly":true,"description":"Created at date of the worklog"},"startDate":{"type":"string","readOnly":true,"description":"Start Date of the worklog"},"startTime":{"type":["null","string"],"readOnly":true,"description":"Start time of the worklog"},"updatedAt":{"type":"string","readOnly":true,"description":"Updated at date of the worklog"},"attributes":{"type":"object","readOnly":true,"properties":{"self":{"type":"string"},"values":{"type":["null","array"],"items":{"type":"object","properties":{"key":{"type":"string"},"value":{"type":["null","string"]}}}}},"description":"Additional attribute of the worklog"},"description":{"type":["null","string"],"readOnly":true,"description":"Description of the worklog"},"tempoWorklogId":{"type":"integer","readOnly":true,"description":"The ID of the tempo worklog."},"billableSeconds":{"type":["null","integer"],"description":"Billable time spent working"},"timeSpentSeconds":{"type":"integer","readOnly":true,"description":"Time spend in seconds of the worklog"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[startDate],sourceDefinedPrimaryKey=[[tempoWorklogId]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[startDate],destinationSyncMode=overwrite,primaryKey=[[tempoWorklogId]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@4856026d[stream=io.airbyte.protocol.models.AirbyteStream@bfc85dc[name=tempo_workload-schemes,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":"integer","readOnly":true,"description":"The ID of the tempo Workload Scheme."},"days":{"type":"array","items":{"type":"object","properties":{"day":{"type":"string"},"requiredSeconds":{"type":"integer"}}},"readOnly":true,"description":"The days of the tempo Workload Scheme."},"name":{"type":"string","readOnly":true,"description":"The name of the tempo Workload Scheme."},"self":{"type":"string","format":"uri","readOnly":true,"description":"The URL of the Workload Scheme"},"description":{"type":"string","readOnly":true,"description":"The description of the tempo Workload Scheme."},"memberCount":{"type":"integer","readOnly":true,"description":"The memberCount of the tempo Workload Scheme."},"defaultScheme":{"type":"boolean","readOnly":true,"description":"The defaultScheme of the tempo Workload Scheme."}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@2cb30281[failureOrigin=destination,failureType=,internalMessage=io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process message delivery failed,externalMessage=Something went wrong within the destination connector,metadata=io.airbyte.config.Metadata@594a8d22[additionalProperties={attemptNumber=2, jobId=24, connector_command=write}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process message delivery failed at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) at java.base/java.lang.Thread.run(Thread.java:1589) Caused by: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process message delivery failed at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$6(DefaultReplicationWorker.java:372) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more Caused by: java.io.IOException: Stream closed at java.base/java.lang.ProcessBuilder$NullOutputStream.write(ProcessBuilder.java:445) at java.base/java.io.OutputStream.write(OutputStream.java:164) at java.base/java.io.BufferedOutputStream.implWrite(BufferedOutputStream.java:216) at java.base/java.io.BufferedOutputStream.write(BufferedOutputStream.java:205) at java.base/sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:313) at java.base/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:385) at java.base/sun.nio.cs.StreamEncoder.implWrite(StreamEncoder.java:361) at java.base/sun.nio.cs.StreamEncoder.lockedWrite(StreamEncoder.java:162) at java.base/sun.nio.cs.StreamEncoder.write(StreamEncoder.java:143) at java.base/java.io.OutputStreamWriter.write(OutputStreamWriter.java:220) at java.base/java.io.BufferedWriter.implFlushBuffer(BufferedWriter.java:178) at java.base/java.io.BufferedWriter.flushBuffer(BufferedWriter.java:163) at java.base/java.io.BufferedWriter.implWrite(BufferedWriter.java:334) at java.base/java.io.BufferedWriter.write(BufferedWriter.java:313) at java.base/java.io.Writer.write(Writer.java:278) at io.airbyte.workers.internal.VersionedAirbyteMessageBufferedWriter.write(VersionedAirbyteMessageBufferedWriter.java:30) at io.airbyte.workers.internal.DefaultAirbyteDestination.accept(DefaultAirbyteDestination.java:101) at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromSrcAndWriteToDstRunnable$6(DefaultReplicationWorker.java:369) ... 4 more ,retryable=,timestamp=1674554733943], io.airbyte.config.FailureReason@2177a90c[failureOrigin=destination,failureType=,internalMessage=io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137,externalMessage=Something went wrong within the destination connector,metadata=io.airbyte.config.Metadata@4e4a1a9b[additionalProperties={attemptNumber=2, jobId=24, connector_command=write}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137 at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) at java.base/java.lang.Thread.run(Thread.java:1589) Caused by: io.airbyte.workers.general.DefaultReplicationWorker$DestinationException: Destination process exited with non-zero exit code 137 at io.airbyte.workers.general.DefaultReplicationWorker.lambda$readFromDstRunnable$4(DefaultReplicationWorker.java:297) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more ,retryable=,timestamp=1674554732657]]] 2023-01-24 10:06:32 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):212 - Sync summary length: 13121 2023-01-24 10:06:32 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):283 - Stopping temporal heartbeating... 2023-01-24 10:06:32 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to get state 2023-01-24 10:06:32 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):172 - Attempt 0 to create or update state