2022-10-12 21:46:20 INFO i.a.a.LoggingTrackingClient(track):43 - track. version: null, userId: null, action: Connector Jobs, metadata: {job_type=sync, namespace_definition=source, config.source.access_key._secret=set, frequency=1440 min, connector_source_definition_id=ea12c401-c399-4e35-8c9e-f961080d0f85, config.destination.port=set, workspace_id=d5abb5e0-1921-4f10-affb-e9f0af57cf5d, config.destination.database=set, attempt_stage=STARTED, config.source.account_id._secret=set, config.destination.password._secret=set, attempt_id=1, connector_destination=Redshift, connector_destination_docker_repository=airbyte/destination-redshift, table_prefix=false, workspace_name=d5abb5e0-1921-4f10-affb-e9f0af57cf5d, config.source.start_date=set, catalog.destination_sync_mode.overwrite=set, number_of_streams=1, connector_source=Call rail, config.destination.host=set, connector_source_docker_repository=adhamsuliman/source-call-rail, config.destination.schema=set, config.destination.username=set, catalog.sync_mode.full_refresh=set, connection_id=c3f15617-32d6-4c89-9399-6a30f525d855, job_id=37, connector_source_version=dev, connector_destination_version=0.3.50, operation.normalization=1, operation_count=1, config.destination.uploading_method.method=Standard, connector_destination_definition_id=f7a7d195-377f-cf5b-70a5-be6b819019dc} 2022-10-12 21:46:20 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/37/0/logs.log 2022-10-12 21:46:20 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-12 21:46:21 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:21 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-10-12 21:46:21 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:21 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if adhamsuliman/source-call-rail:dev exists... 2022-10-12 21:46:21 INFO i.a.c.i.LineGobbler(voidCall):114 - adhamsuliman/source-call-rail:dev was found locally. 2022-10-12 21:46:21 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-call-rail-check-37-0-dmzsl with resources io.airbyte.config.ResourceRequirements@36c63a79[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-12 21:46:21 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/37/0 --log-driver none --name source-call-rail-check-37-0-dmzsl --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=adhamsuliman/source-call-rail:dev -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=37 adhamsuliman/source-call-rail:dev check --config source_config.json 2022-10-12 21:46:24 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Check succeeded 2022-10-12 21:46:24 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-12 21:46:24 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:24 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-12 21:46:24 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:24 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/37/0/logs.log 2022-10-12 21:46:24 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-12 21:46:24 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:24 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-10-12 21:46:24 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:24 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-redshift:0.3.50 exists... 2022-10-12 21:46:25 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-redshift:0.3.50 was found locally. 2022-10-12 21:46:25 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-redshift-check-37-0-masqr with resources io.airbyte.config.ResourceRequirements@36c63a79[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-12 21:46:25 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/37/0 --log-driver none --name destination-redshift-check-37-0-masqr --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-redshift:0.3.50 -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=37 airbyte/destination-redshift:0.3.50 check --config source_config.json 2022-10-12 21:46:28 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - starting destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:46:28 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - integration args: {check=null, config=source_config.json} 2022-10-12 21:46:28 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Running integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:46:28 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Command: CHECK 2022-10-12 21:46:28 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-10-12 21:46:28 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-12 21:46:28 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-12 21:46:28 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-12 21:46:28 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - The "standard" upload mode is not performant, and is not recommended for production. Please use the Amazon S3 upload mode if you are syncing a large amount of data. 2022-10-12 21:46:28 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Using destination type: STANDARD 2022-10-12 21:46:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Starting... 2022-10-12 21:46:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Start completed. 2022-10-12 21:46:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Driver does not support get/set network timeout for connections. ([Amazon][JDBC](10220) Driver does not support this optional feature.) 2022-10-12 21:46:31 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Shutdown initiated... 2022-10-12 21:46:31 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Shutdown completed. 2022-10-12 21:46:31 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Completed integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:46:31 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - completed destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:46:32 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-12 21:46:32 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:32 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-12 21:46:32 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:32 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/37/0/logs.log 2022-10-12 21:46:32 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-12 21:46:32 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):55 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-10-12 21:46:32 INFO i.a.c.EnvConfigs(getEnvOrDefault):1072 - Using default value for environment variable METRIC_CLIENT: '' 2022-10-12 21:46:32 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2022-10-12 21:46:32 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):55 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-10-12 21:46:32 INFO i.a.w.g.DefaultReplicationWorker(run):122 - start sync worker. job id: 37 attempt id: 0 2022-10-12 21:46:32 INFO i.a.w.g.DefaultReplicationWorker(run):135 - configured sync modes: {null.calls=full_refresh - overwrite} 2022-10-12 21:46:32 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:32 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-10-12 21:46:32 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START REPLICATION ----- 2022-10-12 21:46:32 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:32 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-redshift:0.3.50 exists... 2022-10-12 21:46:32 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-redshift:0.3.50 was found locally. 2022-10-12 21:46:33 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-redshift-write-37-0-yojgl with resources io.airbyte.config.ResourceRequirements@6d8e3363[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-12 21:46:33 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/37/0 --log-driver none --name destination-redshift-write-37-0-yojgl --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-redshift:0.3.50 -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=37 airbyte/destination-redshift:0.3.50 write --config destination_config.json --catalog destination_catalog.json 2022-10-12 21:46:33 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if adhamsuliman/source-call-rail:dev exists... 2022-10-12 21:46:33 INFO i.a.c.i.LineGobbler(voidCall):114 - adhamsuliman/source-call-rail:dev was found locally. 2022-10-12 21:46:33 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-call-rail-read-37-0-fklcm with resources io.airbyte.config.ResourceRequirements@5fa877e4[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-12 21:46:33 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/37/0 --log-driver none --name source-call-rail-read-37-0-fklcm --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=adhamsuliman/source-call-rail:dev -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=37 adhamsuliman/source-call-rail:dev read --config source_config.json --catalog source_catalog.json 2022-10-12 21:46:33 INFO i.a.w.g.DefaultReplicationWorker(run):177 - Waiting for source and destination threads to complete. 2022-10-12 21:46:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):322 - Replication thread started. 2022-10-12 21:46:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):435 - Destination output thread started. 2022-10-12 21:46:37 destination > starting destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:46:37 destination > integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-10-12 21:46:37 destination > Running integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:46:37 destination > Command: WRITE 2022-10-12 21:46:37 destination > Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-10-12 21:46:37 destination > Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-12 21:46:37 destination > Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-12 21:46:37 destination > Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-12 21:46:37 destination > The "standard" upload mode is not performant, and is not recommended for production. Please use the Amazon S3 upload mode if you are syncing a large amount of data. 2022-10-12 21:46:37 destination > Using destination type: STANDARD 2022-10-12 21:46:38 destination > HikariPool-1 - Starting... 2022-10-12 21:46:38 destination > HikariPool-1 - Start completed. 2022-10-12 21:46:38 destination > Write config: WriteConfig{streamName=calls, namespace=null, outputSchemaName=src_call_rail, tmpTableName=_airbyte_tmp_qiz_calls, outputTableName=_airbyte_raw_calls, syncMode=overwrite} 2022-10-12 21:46:38 source > Starting syncing SourceCallRail 2022-10-12 21:46:38 destination > class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2022-10-12 21:46:38 destination > Preparing tmp tables in destination started for 1 streams 2022-10-12 21:46:38 destination > Preparing tmp table in destination started for stream calls. schema: src_call_rail, tmp table name: _airbyte_tmp_qiz_calls 2022-10-12 21:46:39 source > Syncing stream: calls 2022-10-12 21:46:39 source > Read 22 records from calls stream 2022-10-12 21:46:39 source > Finished syncing calls 2022-10-12 21:46:39 source > SourceCallRail runtimes: Syncing stream calls 0:00:00.560473 2022-10-12 21:46:39 source > Finished syncing SourceCallRail 2022-10-12 21:46:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):355 - Source has no more messages, closing connection. 2022-10-12 21:46:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):363 - Total records read: 22 (14 KB) 2022-10-12 21:46:40 INFO i.a.w.g.DefaultReplicationWorker(run):182 - One of source or destination thread complete. Waiting on the other. 2022-10-12 21:46:40 destination > HikariPool-1 - Driver does not support get/set network timeout for connections. ([Amazon][JDBC](10220) Driver does not support this optional feature.) 2022-10-12 21:46:41 destination > Preparing tables in destination completed. 2022-10-12 21:46:41 destination > Airbyte message consumer: succeeded. 2022-10-12 21:46:41 destination > executing on success close procedure. 2022-10-12 21:46:41 destination > Flushing calls: 22 records (57 KB) 2022-10-12 21:46:41 destination > actual size of batch: 22 2022-10-12 21:46:42 destination > Executing operations for Redshift Destination DB engine... 2022-10-12 21:46:42 destination > Discovering NOT SUPER table types... 2022-10-12 21:46:42 destination > Executing operations for Redshift Destination DB engine completed. 2022-10-12 21:46:42 destination > Finalizing tables in destination started for 1 streams 2022-10-12 21:46:42 destination > Finalizing stream calls. schema src_call_rail, tmp table _airbyte_tmp_qiz_calls, final table _airbyte_raw_calls 2022-10-12 21:46:43 destination > Executing finalization of tables. 2022-10-12 21:46:43 destination > Finalizing tables in destination completed. 2022-10-12 21:46:43 destination > Cleaning tmp tables in destination started for 1 streams 2022-10-12 21:46:43 destination > Cleaning tmp table in destination started for stream calls. schema src_call_rail, tmp table name: _airbyte_tmp_qiz_calls 2022-10-12 21:46:43 destination > Cleaning tmp tables in destination completed. 2022-10-12 21:46:43 destination > Completed integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:46:43 destination > completed destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:46:43 INFO i.a.w.g.DefaultReplicationWorker(run):184 - Source and destination threads complete. 2022-10-12 21:46:43 INFO i.a.w.g.DefaultReplicationWorker(run):281 - Source did not output any state messages 2022-10-12 21:46:43 WARN i.a.w.g.DefaultReplicationWorker(run):292 - State capture: No state retained. 2022-10-12 21:46:43 INFO i.a.w.g.DefaultReplicationWorker(run):300 - sync summary: { "status" : "completed", "recordsSynced" : 22, "bytesSynced" : 14559, "startTime" : 1665611192898, "endTime" : 1665611203978, "totalStats" : { "recordsEmitted" : 22, "bytesEmitted" : 14559, "sourceStateMessagesEmitted" : 0, "destinationStateMessagesEmitted" : 0, "recordsCommitted" : 22, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0 }, "streamStats" : [ { "streamName" : "calls", "stats" : { "recordsEmitted" : 22, "bytesEmitted" : 14559, "recordsCommitted" : 22 } } ] } 2022-10-12 21:46:43 INFO i.a.w.g.DefaultReplicationWorker(run):301 - failures: [ ] 2022-10-12 21:46:43 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-12 21:46:43 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:43 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END REPLICATION ----- 2022-10-12 21:46:43 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:43 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):159 - sync summary: io.airbyte.config.StandardSyncOutput@402f4da[standardSyncSummary=io.airbyte.config.StandardSyncSummary@3dd56a27[status=completed,recordsSynced=22,bytesSynced=14559,startTime=1665611192898,endTime=1665611203978,totalStats=io.airbyte.config.SyncStats@7cae4268[recordsEmitted=22,bytesEmitted=14559,sourceStateMessagesEmitted=0,destinationStateMessagesEmitted=0,recordsCommitted=22,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@6cbc7d69[streamName=calls,stats=io.airbyte.config.SyncStats@7f8be000[recordsEmitted=22,bytesEmitted=14559,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=22,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,additionalProperties={}]]]],normalizationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@69193984[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@67aa8bcd[stream=io.airbyte.protocol.models.AirbyteStream@68f2e564[name=calls,jsonSchema={"streams":[{"stream":{"name":"calls","json_schema":{"type":"object","$schema":"https://apidocs.callrail.com/calls","properties":{"id":{"type":["null","string"]},"answered":{"type":["null","bool"]},"duration":{"type":["null","int"]},"recording":{"type":["null","string"]},"voicemail":{"type":["null","bool"]},"start_time":{"type":["null","date-time"]},"customer_city":{"type":["null","string"]},"customer_name":{"type":["null","string"]},"customer_state":{"type":["null","string"]},"customer_country":{"type":["null","string"]},"recording_duration":{"type":["null","int"]},"business_phone_number":{"type":["null","string"]},"customer_phone_number":{"type":["null","string"]},"tracking_phone_number":{"type":["null","string"]}}}},"sync_mode":"full_refresh","destination_sync_mode":"overwrite"}]},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-10-12 21:46:43 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):280 - Stopping temporal heartbeating... 2022-10-12 21:46:44 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/37/0/logs.log 2022-10-12 21:46:44 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-12 21:46:44 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:44 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START DEFAULT NORMALIZATION ----- 2022-10-12 21:46:44 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):138 - Running with normalization version: airbyte/normalization-redshift:0.2.22 2022-10-12 21:46:44 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:44 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/normalization-redshift:0.2.22 exists... 2022-10-12 21:46:44 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/normalization-redshift:0.2.22 was found locally. 2022-10-12 21:46:44 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = normalization-redshift-normalize-37-0-vdyzg with resources io.airbyte.config.ResourceRequirements@42ca83ae[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-12 21:46:44 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/37/0/normalize --log-driver none --name normalization-redshift-normalize-37-0-vdyzg --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.40.10 airbyte/normalization-redshift:0.2.22 run --integration-type redshift --config destination_config.json --catalog destination_catalog.json 2022-10-12 21:46:45 normalization > Running: transform-config --config destination_config.json --integration-type redshift --out /data/37/0/normalize 2022-10-12 21:46:46 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/37/0/normalize') 2022-10-12 21:46:46 normalization > transform_redshift 2022-10-12 21:46:46 normalization > Running: transform-catalog --integration-type redshift --profile-config-dir /data/37/0/normalize --catalog destination_catalog.json --out /data/37/0/normalize/models/generated/ --json-column _airbyte_data 2022-10-12 21:46:48 normalization > Processing destination_catalog.json... 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2022-10-12 21:46:48 normalization > Showing destination_catalog.json to diagnose/debug errors (1): 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2022-10-12 21:46:48 normalization > { 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "streams" 2022-10-12 21:46:48 normalization > { 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "stream" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "name" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "json_schema" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "streams" 2022-10-12 21:46:48 normalization > { 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "stream" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "name" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "json_schema" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "$schema" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "properties" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "id" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > }, 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "answered" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "bool" 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > }, 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "duration" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "int" 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > }, 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "recording" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > }, 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "voicemail" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "bool" 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > }, 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "start_time" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "date-time" 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > }, 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "customer_city" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > }, 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "customer_name" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > }, 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "customer_state" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > }, 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "customer_country" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > }, 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "recording_duration" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "int" 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > }, 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "business_phone_number" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > }, 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "customer_phone_number" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > }, 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "tracking_phone_number" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > } 2022-10-12 21:46:48 normalization > } 2022-10-12 21:46:48 normalization > } 2022-10-12 21:46:48 normalization > }, 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "sync_mode" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "destination_sync_mode" 2022-10-12 21:46:48 normalization > } 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > }, 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "supported_sync_modes" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "full_refresh" 2022-10-12 21:46:48 normalization > ], 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "default_cursor_field" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "source_defined_primary_key" 2022-10-12 21:46:48 normalization > [ 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "id" 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > }, 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "sync_mode" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "cursor_field" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "destination_sync_mode" 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "primary_key" 2022-10-12 21:46:48 normalization > [ 2022-10-12 21:46:48 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "id" 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > } 2022-10-12 21:46:48 normalization > ] 2022-10-12 21:46:48 normalization > } 2022-10-12 21:46:48 normalization > Traceback (most recent call last): 2022-10-12 21:46:48 normalization > File "/usr/local/bin/transform-catalog", line 8, in 2022-10-12 21:46:48 INFO i.a.w.g.DefaultNormalizationWorker(run):82 - Normalization executed in 4 seconds. 2022-10-12 21:46:48 normalization > sys.exit(main()) 2022-10-12 21:46:48 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py", line 104, in main 2022-10-12 21:46:48 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):164 - Completing future exceptionally... io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:92) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:27) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at java.lang.Thread.run(Thread.java:833) ~[?:?] 2022-10-12 21:46:48 normalization > TransformCatalog().run(args) 2022-10-12 21:46:48 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py", line 36, in run 2022-10-12 21:46:48 normalization > self.process_catalog() 2022-10-12 21:46:48 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py", line 64, in process_catalog 2022-10-12 21:46:48 normalization > processor.process(catalog_file=catalog_file, json_column_name=json_col, default_schema=schema) 2022-10-12 21:46:48 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py", line 55, in process 2022-10-12 21:46:48 normalization > stream_processors = self.build_stream_processor( 2022-10-12 21:46:48 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py", line 138, in build_stream_processor 2022-10-12 21:46:48 normalization > properties = get_field(get_field(stream_config, "json_schema", message), "properties", message) 2022-10-12 21:46:48 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-12 21:46:48 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py", line 230, in get_field 2022-10-12 21:46:49 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):280 - Stopping temporal heartbeating... 2022-10-12 21:46:49 normalization > raise KeyError(message) 2022-10-12 21:46:49 normalization > KeyError: "'json_schema'.'properties' are not defined for stream calls" 2022-10-12 21:46:49 WARN i.t.i.a.POJOActivityTaskHandler(activityFailureToResult):307 - Activity failure. ActivityId=58bd674a-6ee1-3616-82a6-aafd846516c5, activityType=Normalize, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:278) ~[io.airbyte-airbyte-commons-temporal-0.40.10.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.normalize(NormalizationActivityImpl.java:93) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] at java.lang.Thread.run(Thread.java:833) ~[?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:56) ~[temporal-serviceclient-1.8.1.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:448) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:51) ~[temporal-sdk-1.8.1.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:138) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:121) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:273) ~[io.airbyte-airbyte-commons-temporal-0.40.10.jar:?] ... 14 more Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:132) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:121) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:273) ~[io.airbyte-airbyte-commons-temporal-0.40.10.jar:?] ... 14 more Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:92) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:27) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] ... 1 more 2022-10-12 21:46:50 INFO i.a.a.LoggingTrackingClient(track):43 - track. version: null, userId: null, action: Connector Jobs, metadata: {job_type=sync, namespace_definition=source, config.source.access_key._secret=set, frequency=1440 min, connector_source_definition_id=ea12c401-c399-4e35-8c9e-f961080d0f85, config.destination.port=set, workspace_id=d5abb5e0-1921-4f10-affb-e9f0af57cf5d, config.destination.database=set, attempt_stage=STARTED, config.source.account_id._secret=set, config.destination.password._secret=set, attempt_id=2, connector_destination=Redshift, connector_destination_docker_repository=airbyte/destination-redshift, table_prefix=false, workspace_name=d5abb5e0-1921-4f10-affb-e9f0af57cf5d, config.source.start_date=set, catalog.destination_sync_mode.overwrite=set, number_of_streams=1, connector_source=Call rail, config.destination.host=set, connector_source_docker_repository=adhamsuliman/source-call-rail, config.destination.schema=set, config.destination.username=set, catalog.sync_mode.full_refresh=set, connection_id=c3f15617-32d6-4c89-9399-6a30f525d855, job_id=37, connector_source_version=dev, connector_destination_version=0.3.50, operation.normalization=1, operation_count=1, config.destination.uploading_method.method=Standard, connector_destination_definition_id=f7a7d195-377f-cf5b-70a5-be6b819019dc} 2022-10-12 21:46:50 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/37/1/logs.log 2022-10-12 21:46:50 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-12 21:46:51 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:51 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-10-12 21:46:51 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:51 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if adhamsuliman/source-call-rail:dev exists... 2022-10-12 21:46:51 INFO i.a.c.i.LineGobbler(voidCall):114 - adhamsuliman/source-call-rail:dev was found locally. 2022-10-12 21:46:51 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-call-rail-check-37-1-qvcgo with resources io.airbyte.config.ResourceRequirements@36c63a79[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-12 21:46:51 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/37/1 --log-driver none --name source-call-rail-check-37-1-qvcgo --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=adhamsuliman/source-call-rail:dev -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=37 adhamsuliman/source-call-rail:dev check --config source_config.json 2022-10-12 21:46:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Check succeeded 2022-10-12 21:46:57 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-12 21:46:57 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:57 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-12 21:46:57 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:57 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/37/1/logs.log 2022-10-12 21:46:57 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-12 21:46:58 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:58 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-10-12 21:46:58 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:46:58 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-redshift:0.3.50 exists... 2022-10-12 21:46:58 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-redshift:0.3.50 was found locally. 2022-10-12 21:46:58 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-redshift-check-37-1-wilio with resources io.airbyte.config.ResourceRequirements@36c63a79[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-12 21:46:58 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/37/1 --log-driver none --name destination-redshift-check-37-1-wilio --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-redshift:0.3.50 -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=37 airbyte/destination-redshift:0.3.50 check --config source_config.json 2022-10-12 21:47:03 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - starting destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:47:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - integration args: {check=null, config=source_config.json} 2022-10-12 21:47:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Running integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:47:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Command: CHECK 2022-10-12 21:47:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-10-12 21:47:05 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-12 21:47:05 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-12 21:47:05 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-12 21:47:05 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - The "standard" upload mode is not performant, and is not recommended for production. Please use the Amazon S3 upload mode if you are syncing a large amount of data. 2022-10-12 21:47:05 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Using destination type: STANDARD 2022-10-12 21:47:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Starting... 2022-10-12 21:47:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Start completed. 2022-10-12 21:47:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Driver does not support get/set network timeout for connections. ([Amazon][JDBC](10220) Driver does not support this optional feature.) 2022-10-12 21:47:11 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Shutdown initiated... 2022-10-12 21:47:11 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Shutdown completed. 2022-10-12 21:47:11 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Completed integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:47:11 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - completed destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:47:11 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-12 21:47:11 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:47:11 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-12 21:47:11 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:47:12 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/37/1/logs.log 2022-10-12 21:47:12 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-12 21:47:12 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):55 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-10-12 21:47:12 INFO i.a.c.EnvConfigs(getEnvOrDefault):1072 - Using default value for environment variable METRIC_CLIENT: '' 2022-10-12 21:47:12 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2022-10-12 21:47:12 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):55 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-10-12 21:47:12 INFO i.a.w.g.DefaultReplicationWorker(run):122 - start sync worker. job id: 37 attempt id: 1 2022-10-12 21:47:12 INFO i.a.w.g.DefaultReplicationWorker(run):135 - configured sync modes: {null.calls=full_refresh - overwrite} 2022-10-12 21:47:12 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:47:12 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-10-12 21:47:12 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START REPLICATION ----- 2022-10-12 21:47:12 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:47:12 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-redshift:0.3.50 exists... 2022-10-12 21:47:12 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-redshift:0.3.50 was found locally. 2022-10-12 21:47:12 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-redshift-write-37-1-afffe with resources io.airbyte.config.ResourceRequirements@79cbf1c2[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-12 21:47:12 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/37/1 --log-driver none --name destination-redshift-write-37-1-afffe --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-redshift:0.3.50 -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=37 airbyte/destination-redshift:0.3.50 write --config destination_config.json --catalog destination_catalog.json 2022-10-12 21:47:12 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if adhamsuliman/source-call-rail:dev exists... 2022-10-12 21:47:13 INFO i.a.c.i.LineGobbler(voidCall):114 - adhamsuliman/source-call-rail:dev was found locally. 2022-10-12 21:47:13 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-call-rail-read-37-1-crrbv with resources io.airbyte.config.ResourceRequirements@7c60648a[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-12 21:47:13 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/37/1 --log-driver none --name source-call-rail-read-37-1-crrbv --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=adhamsuliman/source-call-rail:dev -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=37 adhamsuliman/source-call-rail:dev read --config source_config.json --catalog source_catalog.json 2022-10-12 21:47:13 INFO i.a.w.g.DefaultReplicationWorker(run):177 - Waiting for source and destination threads to complete. 2022-10-12 21:47:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):322 - Replication thread started. 2022-10-12 21:47:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):435 - Destination output thread started. 2022-10-12 21:47:21 destination > starting destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:47:22 destination > integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-10-12 21:47:22 destination > Running integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:47:22 destination > Command: WRITE 2022-10-12 21:47:22 destination > Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-10-12 21:47:23 destination > Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-12 21:47:23 destination > Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-12 21:47:23 destination > Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-12 21:47:23 destination > The "standard" upload mode is not performant, and is not recommended for production. Please use the Amazon S3 upload mode if you are syncing a large amount of data. 2022-10-12 21:47:23 destination > Using destination type: STANDARD 2022-10-12 21:47:25 destination > HikariPool-1 - Starting... 2022-10-12 21:47:25 destination > HikariPool-1 - Start completed. 2022-10-12 21:47:25 destination > Write config: WriteConfig{streamName=calls, namespace=null, outputSchemaName=src_call_rail, tmpTableName=_airbyte_tmp_jjf_calls, outputTableName=_airbyte_raw_calls, syncMode=overwrite} 2022-10-12 21:47:25 source > Starting syncing SourceCallRail 2022-10-12 21:47:25 destination > class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2022-10-12 21:47:25 destination > Preparing tmp tables in destination started for 1 streams 2022-10-12 21:47:25 destination > Preparing tmp table in destination started for stream calls. schema: src_call_rail, tmp table name: _airbyte_tmp_jjf_calls 2022-10-12 21:47:26 source > Syncing stream: calls 2022-10-12 21:47:27 source > Read 22 records from calls stream 2022-10-12 21:47:27 source > Finished syncing calls 2022-10-12 21:47:27 source > SourceCallRail runtimes: Syncing stream calls 0:00:01.081151 2022-10-12 21:47:27 source > Finished syncing SourceCallRail 2022-10-12 21:47:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):355 - Source has no more messages, closing connection. 2022-10-12 21:47:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):363 - Total records read: 22 (14 KB) 2022-10-12 21:47:28 INFO i.a.w.g.DefaultReplicationWorker(run):182 - One of source or destination thread complete. Waiting on the other. 2022-10-12 21:47:29 destination > HikariPool-1 - Driver does not support get/set network timeout for connections. ([Amazon][JDBC](10220) Driver does not support this optional feature.) 2022-10-12 21:47:30 destination > Preparing tables in destination completed. 2022-10-12 21:47:31 destination > Airbyte message consumer: succeeded. 2022-10-12 21:47:31 destination > executing on success close procedure. 2022-10-12 21:47:31 destination > Flushing calls: 22 records (57 KB) 2022-10-12 21:47:31 destination > actual size of batch: 22 2022-10-12 21:47:32 destination > Executing operations for Redshift Destination DB engine... 2022-10-12 21:47:32 destination > Discovering NOT SUPER table types... 2022-10-12 21:47:33 destination > Executing operations for Redshift Destination DB engine completed. 2022-10-12 21:47:33 destination > Finalizing tables in destination started for 1 streams 2022-10-12 21:47:33 destination > Finalizing stream calls. schema src_call_rail, tmp table _airbyte_tmp_jjf_calls, final table _airbyte_raw_calls 2022-10-12 21:47:33 destination > Executing finalization of tables. 2022-10-12 21:47:33 destination > Finalizing tables in destination completed. 2022-10-12 21:47:33 destination > Cleaning tmp tables in destination started for 1 streams 2022-10-12 21:47:33 destination > Cleaning tmp table in destination started for stream calls. schema src_call_rail, tmp table name: _airbyte_tmp_jjf_calls 2022-10-12 21:47:33 destination > Cleaning tmp tables in destination completed. 2022-10-12 21:47:33 destination > Completed integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:47:33 destination > completed destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:47:34 INFO i.a.w.g.DefaultReplicationWorker(run):184 - Source and destination threads complete. 2022-10-12 21:47:34 INFO i.a.w.g.DefaultReplicationWorker(run):281 - Source did not output any state messages 2022-10-12 21:47:34 WARN i.a.w.g.DefaultReplicationWorker(run):292 - State capture: No state retained. 2022-10-12 21:47:34 INFO i.a.w.g.DefaultReplicationWorker(run):300 - sync summary: { "status" : "completed", "recordsSynced" : 22, "bytesSynced" : 14559, "startTime" : 1665611232741, "endTime" : 1665611254826, "totalStats" : { "recordsEmitted" : 22, "bytesEmitted" : 14559, "sourceStateMessagesEmitted" : 0, "destinationStateMessagesEmitted" : 0, "recordsCommitted" : 22, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0 }, "streamStats" : [ { "streamName" : "calls", "stats" : { "recordsEmitted" : 22, "bytesEmitted" : 14559, "recordsCommitted" : 22 } } ] } 2022-10-12 21:47:34 INFO i.a.w.g.DefaultReplicationWorker(run):301 - failures: [ ] 2022-10-12 21:47:34 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:47:34 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-12 21:47:34 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END REPLICATION ----- 2022-10-12 21:47:34 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:47:34 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):159 - sync summary: io.airbyte.config.StandardSyncOutput@6f70c562[standardSyncSummary=io.airbyte.config.StandardSyncSummary@2a7256e8[status=completed,recordsSynced=22,bytesSynced=14559,startTime=1665611232741,endTime=1665611254826,totalStats=io.airbyte.config.SyncStats@aaa858a[recordsEmitted=22,bytesEmitted=14559,sourceStateMessagesEmitted=0,destinationStateMessagesEmitted=0,recordsCommitted=22,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@1b92f9c8[streamName=calls,stats=io.airbyte.config.SyncStats@72a0740d[recordsEmitted=22,bytesEmitted=14559,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=22,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,additionalProperties={}]]]],normalizationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@4a5da9a7[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@1405f3b3[stream=io.airbyte.protocol.models.AirbyteStream@18d50442[name=calls,jsonSchema={"streams":[{"stream":{"name":"calls","json_schema":{"type":"object","$schema":"https://apidocs.callrail.com/calls","properties":{"id":{"type":["null","string"]},"answered":{"type":["null","bool"]},"duration":{"type":["null","int"]},"recording":{"type":["null","string"]},"voicemail":{"type":["null","bool"]},"start_time":{"type":["null","date-time"]},"customer_city":{"type":["null","string"]},"customer_name":{"type":["null","string"]},"customer_state":{"type":["null","string"]},"customer_country":{"type":["null","string"]},"recording_duration":{"type":["null","int"]},"business_phone_number":{"type":["null","string"]},"customer_phone_number":{"type":["null","string"]},"tracking_phone_number":{"type":["null","string"]}}}},"sync_mode":"full_refresh","destination_sync_mode":"overwrite"}]},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-10-12 21:47:34 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):280 - Stopping temporal heartbeating... 2022-10-12 21:47:35 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/37/1/logs.log 2022-10-12 21:47:35 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-12 21:47:35 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:47:35 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):138 - Running with normalization version: airbyte/normalization-redshift:0.2.22 2022-10-12 21:47:35 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START DEFAULT NORMALIZATION ----- 2022-10-12 21:47:35 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:47:35 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/normalization-redshift:0.2.22 exists... 2022-10-12 21:47:35 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/normalization-redshift:0.2.22 was found locally. 2022-10-12 21:47:35 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = normalization-redshift-normalize-37-1-igmyw with resources io.airbyte.config.ResourceRequirements@573f322a[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-12 21:47:35 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/37/1/normalize --log-driver none --name normalization-redshift-normalize-37-1-igmyw --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.40.10 airbyte/normalization-redshift:0.2.22 run --integration-type redshift --config destination_config.json --catalog destination_catalog.json 2022-10-12 21:47:37 normalization > Running: transform-config --config destination_config.json --integration-type redshift --out /data/37/1/normalize 2022-10-12 21:47:40 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/37/1/normalize') 2022-10-12 21:47:40 normalization > transform_redshift 2022-10-12 21:47:41 normalization > Running: transform-catalog --integration-type redshift --profile-config-dir /data/37/1/normalize --catalog destination_catalog.json --out /data/37/1/normalize/models/generated/ --json-column _airbyte_data 2022-10-12 21:47:44 normalization > Processing destination_catalog.json... 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2022-10-12 21:47:45 normalization > Showing destination_catalog.json to diagnose/debug errors (1): 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2022-10-12 21:47:45 normalization > { 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "streams" 2022-10-12 21:47:45 normalization > { 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "stream" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "name" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "json_schema" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "streams" 2022-10-12 21:47:45 normalization > { 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "stream" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "name" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "json_schema" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "$schema" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "properties" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "id" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > }, 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "answered" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "bool" 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > }, 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "duration" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "int" 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > }, 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "recording" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > }, 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "voicemail" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "bool" 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > }, 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "start_time" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "date-time" 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > }, 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "customer_city" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > }, 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "customer_name" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > }, 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "customer_state" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > }, 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "customer_country" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > }, 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "recording_duration" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "int" 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > }, 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "business_phone_number" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > }, 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "customer_phone_number" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > }, 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "tracking_phone_number" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > } 2022-10-12 21:47:45 normalization > } 2022-10-12 21:47:45 normalization > } 2022-10-12 21:47:45 normalization > }, 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "sync_mode" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "destination_sync_mode" 2022-10-12 21:47:45 normalization > } 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > }, 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "supported_sync_modes" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "full_refresh" 2022-10-12 21:47:45 normalization > ], 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "default_cursor_field" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "source_defined_primary_key" 2022-10-12 21:47:45 normalization > [ 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "id" 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > }, 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "sync_mode" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "cursor_field" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "destination_sync_mode" 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "primary_key" 2022-10-12 21:47:45 normalization > [ 2022-10-12 21:47:45 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "id" 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > } 2022-10-12 21:47:45 normalization > ] 2022-10-12 21:47:45 normalization > } 2022-10-12 21:47:45 normalization > Traceback (most recent call last): 2022-10-12 21:47:45 normalization > File "/usr/local/bin/transform-catalog", line 8, in 2022-10-12 21:47:45 normalization > sys.exit(main()) 2022-10-12 21:47:45 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py", line 104, in main 2022-10-12 21:47:45 INFO i.a.w.g.DefaultNormalizationWorker(run):82 - Normalization executed in 10 seconds. 2022-10-12 21:47:45 normalization > TransformCatalog().run(args) 2022-10-12 21:47:45 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py", line 36, in run 2022-10-12 21:47:45 normalization > self.process_catalog() 2022-10-12 21:47:45 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py", line 64, in process_catalog 2022-10-12 21:47:45 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):164 - Completing future exceptionally... io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:92) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:27) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at java.lang.Thread.run(Thread.java:833) ~[?:?] 2022-10-12 21:47:46 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-12 21:47:46 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):280 - Stopping temporal heartbeating... 2022-10-12 21:47:45 normalization > processor.process(catalog_file=catalog_file, json_column_name=json_col, default_schema=schema) 2022-10-12 21:47:46 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py", line 55, in process 2022-10-12 21:47:46 normalization > stream_processors = self.build_stream_processor( 2022-10-12 21:47:46 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py", line 138, in build_stream_processor 2022-10-12 21:47:46 normalization > properties = get_field(get_field(stream_config, "json_schema", message), "properties", message) 2022-10-12 21:47:46 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py", line 230, in get_field 2022-10-12 21:47:46 normalization > raise KeyError(message) 2022-10-12 21:47:46 normalization > KeyError: "'json_schema'.'properties' are not defined for stream calls" 2022-10-12 21:47:46 WARN i.t.i.a.POJOActivityTaskHandler(activityFailureToResult):307 - Activity failure. ActivityId=6c97f4ec-910d-3018-906a-8b6ae0ddcc2e, activityType=Normalize, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:278) ~[io.airbyte-airbyte-commons-temporal-0.40.10.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.normalize(NormalizationActivityImpl.java:93) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] at java.lang.Thread.run(Thread.java:833) ~[?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:56) ~[temporal-serviceclient-1.8.1.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:448) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:51) ~[temporal-sdk-1.8.1.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:138) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:121) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:273) ~[io.airbyte-airbyte-commons-temporal-0.40.10.jar:?] ... 14 more Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:132) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:121) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:273) ~[io.airbyte-airbyte-commons-temporal-0.40.10.jar:?] ... 14 more Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:92) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:27) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] ... 1 more 2022-10-12 21:47:51 INFO i.a.a.LoggingTrackingClient(track):43 - track. version: null, userId: null, action: Connector Jobs, metadata: {job_type=sync, namespace_definition=source, config.source.access_key._secret=set, frequency=1440 min, connector_source_definition_id=ea12c401-c399-4e35-8c9e-f961080d0f85, config.destination.port=set, workspace_id=d5abb5e0-1921-4f10-affb-e9f0af57cf5d, config.destination.database=set, attempt_stage=STARTED, config.source.account_id._secret=set, config.destination.password._secret=set, attempt_id=3, connector_destination=Redshift, connector_destination_docker_repository=airbyte/destination-redshift, table_prefix=false, workspace_name=d5abb5e0-1921-4f10-affb-e9f0af57cf5d, config.source.start_date=set, catalog.destination_sync_mode.overwrite=set, number_of_streams=1, connector_source=Call rail, config.destination.host=set, connector_source_docker_repository=adhamsuliman/source-call-rail, config.destination.schema=set, config.destination.username=set, catalog.sync_mode.full_refresh=set, connection_id=c3f15617-32d6-4c89-9399-6a30f525d855, job_id=37, connector_source_version=dev, connector_destination_version=0.3.50, operation.normalization=1, operation_count=1, config.destination.uploading_method.method=Standard, connector_destination_definition_id=f7a7d195-377f-cf5b-70a5-be6b819019dc} 2022-10-12 21:47:51 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/37/2/logs.log 2022-10-12 21:47:51 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-12 21:47:52 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:47:52 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-10-12 21:47:52 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:47:52 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if adhamsuliman/source-call-rail:dev exists... 2022-10-12 21:47:52 INFO i.a.c.i.LineGobbler(voidCall):114 - adhamsuliman/source-call-rail:dev was found locally. 2022-10-12 21:47:52 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-call-rail-check-37-2-pbmna with resources io.airbyte.config.ResourceRequirements@36c63a79[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-12 21:47:52 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/37/2 --log-driver none --name source-call-rail-check-37-2-pbmna --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=adhamsuliman/source-call-rail:dev -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=37 adhamsuliman/source-call-rail:dev check --config source_config.json 2022-10-12 21:48:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Check succeeded 2022-10-12 21:48:07 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-12 21:48:07 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:48:07 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-12 21:48:07 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:48:08 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/37/2/logs.log 2022-10-12 21:48:08 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-12 21:48:09 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:48:09 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-10-12 21:48:09 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:48:09 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-redshift:0.3.50 exists... 2022-10-12 21:48:10 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-redshift:0.3.50 was found locally. 2022-10-12 21:48:10 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-redshift-check-37-2-vpzzb with resources io.airbyte.config.ResourceRequirements@36c63a79[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-12 21:48:10 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/37/2 --log-driver none --name destination-redshift-check-37-2-vpzzb --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-redshift:0.3.50 -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=37 airbyte/destination-redshift:0.3.50 check --config source_config.json 2022-10-12 21:48:20 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - starting destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:48:22 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - integration args: {check=null, config=source_config.json} 2022-10-12 21:48:22 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Running integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:48:22 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Command: CHECK 2022-10-12 21:48:22 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-10-12 21:48:23 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-12 21:48:23 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-12 21:48:23 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-12 21:48:23 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - The "standard" upload mode is not performant, and is not recommended for production. Please use the Amazon S3 upload mode if you are syncing a large amount of data. 2022-10-12 21:48:23 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Using destination type: STANDARD 2022-10-12 21:48:24 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Starting... 2022-10-12 21:48:25 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Start completed. 2022-10-12 21:48:28 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Driver does not support get/set network timeout for connections. ([Amazon][JDBC](10220) Driver does not support this optional feature.) 2022-10-12 21:48:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Shutdown initiated... 2022-10-12 21:48:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Shutdown completed. 2022-10-12 21:48:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Completed integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:48:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - completed destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:48:31 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-12 21:48:31 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:48:31 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-12 21:48:31 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:48:33 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/37/2/logs.log 2022-10-12 21:48:33 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-12 21:48:33 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):55 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-10-12 21:48:33 INFO i.a.c.EnvConfigs(getEnvOrDefault):1072 - Using default value for environment variable METRIC_CLIENT: '' 2022-10-12 21:48:33 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2022-10-12 21:48:34 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):55 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-10-12 21:48:34 INFO i.a.w.g.DefaultReplicationWorker(run):122 - start sync worker. job id: 37 attempt id: 2 2022-10-12 21:48:34 INFO i.a.w.g.DefaultReplicationWorker(run):135 - configured sync modes: {null.calls=full_refresh - overwrite} 2022-10-12 21:48:34 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:48:34 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-10-12 21:48:34 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START REPLICATION ----- 2022-10-12 21:48:34 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:48:34 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-redshift:0.3.50 exists... 2022-10-12 21:48:34 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-redshift:0.3.50 was found locally. 2022-10-12 21:48:34 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-redshift-write-37-2-kolnj with resources io.airbyte.config.ResourceRequirements@534d0d6a[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-12 21:48:34 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/37/2 --log-driver none --name destination-redshift-write-37-2-kolnj --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-redshift:0.3.50 -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=37 airbyte/destination-redshift:0.3.50 write --config destination_config.json --catalog destination_catalog.json 2022-10-12 21:48:34 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if adhamsuliman/source-call-rail:dev exists... 2022-10-12 21:48:35 INFO i.a.c.i.LineGobbler(voidCall):114 - adhamsuliman/source-call-rail:dev was found locally. 2022-10-12 21:48:35 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-call-rail-read-37-2-draxa with resources io.airbyte.config.ResourceRequirements@4f6b71b8[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-12 21:48:35 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/37/2 --log-driver none --name source-call-rail-read-37-2-draxa --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=adhamsuliman/source-call-rail:dev -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=37 adhamsuliman/source-call-rail:dev read --config source_config.json --catalog source_catalog.json 2022-10-12 21:48:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):435 - Destination output thread started. 2022-10-12 21:48:35 INFO i.a.w.g.DefaultReplicationWorker(run):177 - Waiting for source and destination threads to complete. 2022-10-12 21:48:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):322 - Replication thread started. 2022-10-12 21:48:49 destination > starting destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:48:50 destination > integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-10-12 21:48:50 destination > Running integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:48:50 destination > Command: WRITE 2022-10-12 21:48:50 destination > Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-10-12 21:48:51 destination > Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-12 21:48:51 destination > Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-12 21:48:51 destination > Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-12 21:48:52 destination > The "standard" upload mode is not performant, and is not recommended for production. Please use the Amazon S3 upload mode if you are syncing a large amount of data. 2022-10-12 21:48:52 destination > Using destination type: STANDARD 2022-10-12 21:48:52 source > Starting syncing SourceCallRail 2022-10-12 21:48:52 destination > HikariPool-1 - Starting... 2022-10-12 21:48:53 destination > HikariPool-1 - Start completed. 2022-10-12 21:48:53 destination > Write config: WriteConfig{streamName=calls, namespace=null, outputSchemaName=src_call_rail, tmpTableName=_airbyte_tmp_elz_calls, outputTableName=_airbyte_raw_calls, syncMode=overwrite} 2022-10-12 21:48:53 destination > class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2022-10-12 21:48:53 destination > Preparing tmp tables in destination started for 1 streams 2022-10-12 21:48:53 destination > Preparing tmp table in destination started for stream calls. schema: src_call_rail, tmp table name: _airbyte_tmp_elz_calls 2022-10-12 21:48:53 source > Syncing stream: calls 2022-10-12 21:48:54 source > Read 22 records from calls stream 2022-10-12 21:48:54 source > Finished syncing calls 2022-10-12 21:48:54 source > SourceCallRail runtimes: Syncing stream calls 0:00:00.561138 2022-10-12 21:48:54 source > Finished syncing SourceCallRail 2022-10-12 21:48:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):355 - Source has no more messages, closing connection. 2022-10-12 21:48:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):363 - Total records read: 22 (14 KB) 2022-10-12 21:48:54 INFO i.a.w.g.DefaultReplicationWorker(run):182 - One of source or destination thread complete. Waiting on the other. 2022-10-12 21:48:56 destination > HikariPool-1 - Driver does not support get/set network timeout for connections. ([Amazon][JDBC](10220) Driver does not support this optional feature.) 2022-10-12 21:48:57 destination > Preparing tables in destination completed. 2022-10-12 21:48:57 destination > Airbyte message consumer: succeeded. 2022-10-12 21:48:57 destination > executing on success close procedure. 2022-10-12 21:48:57 destination > Flushing calls: 22 records (57 KB) 2022-10-12 21:48:57 destination > actual size of batch: 22 2022-10-12 21:48:59 destination > Executing operations for Redshift Destination DB engine... 2022-10-12 21:48:59 destination > Discovering NOT SUPER table types... 2022-10-12 21:48:59 destination > Executing operations for Redshift Destination DB engine completed. 2022-10-12 21:48:59 destination > Finalizing tables in destination started for 1 streams 2022-10-12 21:48:59 destination > Finalizing stream calls. schema src_call_rail, tmp table _airbyte_tmp_elz_calls, final table _airbyte_raw_calls 2022-10-12 21:48:59 destination > Executing finalization of tables. 2022-10-12 21:49:00 destination > Finalizing tables in destination completed. 2022-10-12 21:49:00 destination > Cleaning tmp tables in destination started for 1 streams 2022-10-12 21:49:00 destination > Cleaning tmp table in destination started for stream calls. schema src_call_rail, tmp table name: _airbyte_tmp_elz_calls 2022-10-12 21:49:00 destination > Cleaning tmp tables in destination completed. 2022-10-12 21:49:00 destination > Completed integration: io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:49:00 destination > completed destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination 2022-10-12 21:49:01 INFO i.a.w.g.DefaultReplicationWorker(run):184 - Source and destination threads complete. 2022-10-12 21:49:01 INFO i.a.w.g.DefaultReplicationWorker(run):281 - Source did not output any state messages 2022-10-12 21:49:01 WARN i.a.w.g.DefaultReplicationWorker(run):292 - State capture: No state retained. 2022-10-12 21:49:01 INFO i.a.w.g.DefaultReplicationWorker(run):300 - sync summary: { "status" : "completed", "recordsSynced" : 22, "bytesSynced" : 14559, "startTime" : 1665611314130, "endTime" : 1665611341133, "totalStats" : { "recordsEmitted" : 22, "bytesEmitted" : 14559, "sourceStateMessagesEmitted" : 0, "destinationStateMessagesEmitted" : 0, "recordsCommitted" : 22, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0 }, "streamStats" : [ { "streamName" : "calls", "stats" : { "recordsEmitted" : 22, "bytesEmitted" : 14559, "recordsCommitted" : 22 } } ] } 2022-10-12 21:49:01 INFO i.a.w.g.DefaultReplicationWorker(run):301 - failures: [ ] 2022-10-12 21:49:01 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-12 21:49:01 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):159 - sync summary: io.airbyte.config.StandardSyncOutput@756b4172[standardSyncSummary=io.airbyte.config.StandardSyncSummary@3069d1bb[status=completed,recordsSynced=22,bytesSynced=14559,startTime=1665611314130,endTime=1665611341133,totalStats=io.airbyte.config.SyncStats@564c3e8e[recordsEmitted=22,bytesEmitted=14559,sourceStateMessagesEmitted=0,destinationStateMessagesEmitted=0,recordsCommitted=22,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@193671c[streamName=calls,stats=io.airbyte.config.SyncStats@2e5cd68d[recordsEmitted=22,bytesEmitted=14559,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=22,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,additionalProperties={}]]]],normalizationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@50462ef4[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@67c9d23c[stream=io.airbyte.protocol.models.AirbyteStream@7df8f25e[name=calls,jsonSchema={"streams":[{"stream":{"name":"calls","json_schema":{"type":"object","$schema":"https://apidocs.callrail.com/calls","properties":{"id":{"type":["null","string"]},"answered":{"type":["null","bool"]},"duration":{"type":["null","int"]},"recording":{"type":["null","string"]},"voicemail":{"type":["null","bool"]},"start_time":{"type":["null","date-time"]},"customer_city":{"type":["null","string"]},"customer_name":{"type":["null","string"]},"customer_state":{"type":["null","string"]},"customer_country":{"type":["null","string"]},"recording_duration":{"type":["null","int"]},"business_phone_number":{"type":["null","string"]},"customer_phone_number":{"type":["null","string"]},"tracking_phone_number":{"type":["null","string"]}}}},"sync_mode":"full_refresh","destination_sync_mode":"overwrite"}]},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-10-12 21:49:01 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):280 - Stopping temporal heartbeating... 2022-10-12 21:49:01 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:49:01 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END REPLICATION ----- 2022-10-12 21:49:01 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:49:01 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/37/2/logs.log 2022-10-12 21:49:01 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-12 21:49:01 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:49:01 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START DEFAULT NORMALIZATION ----- 2022-10-12 21:49:01 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-12 21:49:01 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):138 - Running with normalization version: airbyte/normalization-redshift:0.2.22 2022-10-12 21:49:01 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/normalization-redshift:0.2.22 exists... 2022-10-12 21:49:02 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/normalization-redshift:0.2.22 was found locally. 2022-10-12 21:49:02 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = normalization-redshift-normalize-37-2-jyemu with resources io.airbyte.config.ResourceRequirements@76da47a2[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-12 21:49:02 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/37/2/normalize --log-driver none --name normalization-redshift-normalize-37-2-jyemu --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.40.10 airbyte/normalization-redshift:0.2.22 run --integration-type redshift --config destination_config.json --catalog destination_catalog.json 2022-10-12 21:49:03 normalization > Running: transform-config --config destination_config.json --integration-type redshift --out /data/37/2/normalize 2022-10-12 21:49:06 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/37/2/normalize') 2022-10-12 21:49:06 normalization > transform_redshift 2022-10-12 21:49:06 normalization > Running: transform-catalog --integration-type redshift --profile-config-dir /data/37/2/normalize --catalog destination_catalog.json --out /data/37/2/normalize/models/generated/ --json-column _airbyte_data 2022-10-12 21:49:07 normalization > Processing destination_catalog.json... 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2022-10-12 21:49:08 normalization > Showing destination_catalog.json to diagnose/debug errors (1): 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2022-10-12 21:49:08 normalization > { 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "streams" 2022-10-12 21:49:08 normalization > { 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "stream" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "name" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "json_schema" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "streams" 2022-10-12 21:49:08 normalization > { 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "stream" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "name" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "json_schema" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "$schema" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "properties" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "id" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > }, 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "answered" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "bool" 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > }, 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "duration" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "int" 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > }, 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "recording" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > }, 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "voicemail" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "bool" 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > }, 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "start_time" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "date-time" 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > }, 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "customer_city" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > }, 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "customer_name" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > }, 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "customer_state" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > }, 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "customer_country" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > }, 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "recording_duration" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "int" 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > }, 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "business_phone_number" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > }, 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "customer_phone_number" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > }, 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "tracking_phone_number" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "type" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "null" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "string" 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > } 2022-10-12 21:49:08 normalization > } 2022-10-12 21:49:08 normalization > } 2022-10-12 21:49:08 normalization > }, 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "sync_mode" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "destination_sync_mode" 2022-10-12 21:49:08 normalization > } 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > }, 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "supported_sync_modes" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "full_refresh" 2022-10-12 21:49:08 normalization > ], 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "default_cursor_field" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "source_defined_primary_key" 2022-10-12 21:49:08 normalization > [ 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "id" 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > }, 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "sync_mode" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "cursor_field" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "destination_sync_mode" 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "primary_key" 2022-10-12 21:49:08 normalization > [ 2022-10-12 21:49:08 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - "id" 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > } 2022-10-12 21:49:08 normalization > ] 2022-10-12 21:49:08 normalization > } 2022-10-12 21:49:08 INFO i.a.w.g.DefaultNormalizationWorker(run):82 - Normalization executed in 6 seconds. 2022-10-12 21:49:08 normalization > Traceback (most recent call last): 2022-10-12 21:49:08 normalization > File "/usr/local/bin/transform-catalog", line 8, in 2022-10-12 21:49:08 normalization > sys.exit(main()) 2022-10-12 21:49:08 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):164 - Completing future exceptionally... io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:92) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:27) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at java.lang.Thread.run(Thread.java:833) ~[?:?] 2022-10-12 21:49:08 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py", line 104, in main 2022-10-12 21:49:08 normalization > TransformCatalog().run(args) 2022-10-12 21:49:08 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-12 21:49:08 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py", line 36, in run 2022-10-12 21:49:08 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):280 - Stopping temporal heartbeating... 2022-10-12 21:49:08 normalization > self.process_catalog() 2022-10-12 21:49:08 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py", line 64, in process_catalog 2022-10-12 21:49:08 normalization > processor.process(catalog_file=catalog_file, json_column_name=json_col, default_schema=schema) 2022-10-12 21:49:08 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py", line 55, in process 2022-10-12 21:49:08 normalization > stream_processors = self.build_stream_processor( 2022-10-12 21:49:08 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py", line 138, in build_stream_processor 2022-10-12 21:49:08 normalization > properties = get_field(get_field(stream_config, "json_schema", message), "properties", message) 2022-10-12 21:49:08 normalization > File "/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py", line 230, in get_field 2022-10-12 21:49:08 WARN i.t.i.a.POJOActivityTaskHandler(activityFailureToResult):307 - Activity failure. ActivityId=5d931a96-6a42-3335-8755-e817adf476fc, activityType=Normalize, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:278) ~[io.airbyte-airbyte-commons-temporal-0.40.10.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.normalize(NormalizationActivityImpl.java:93) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] at java.lang.Thread.run(Thread.java:833) ~[?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:56) ~[temporal-serviceclient-1.8.1.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:448) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:51) ~[temporal-sdk-1.8.1.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:138) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:121) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:273) ~[io.airbyte-airbyte-commons-temporal-0.40.10.jar:?] ... 14 more Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:132) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:121) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:273) ~[io.airbyte-airbyte-commons-temporal-0.40.10.jar:?] ... 14 more Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:92) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:27) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] ... 1 more 2022-10-12 21:49:08 normalization > raise KeyError(message) 2022-10-12 21:49:08 normalization > KeyError: "'json_schema'.'properties' are not defined for stream calls"