2022-07-21 13:27:10 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.storage: must be a constant value HTTPS
2022-07-21 13:27:10 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.storage: must be a constant value GCS
2022-07-21 13:27:10 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.storage: must be a constant value S3
2022-07-21 13:27:10 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.storage_account: is missing but it is required, $.storage: must be a constant value AzBlob
2022-07-21 13:27:10 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.password: object found, string expected, $.storage: must be a constant value SSH
2022-07-21 13:27:10 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.password: object found, string expected, $.storage: must be a constant value SCP
2022-07-21 13:27:10 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.password: object found, string expected
2022-07-21 13:27:10 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.storage: must be a constant value local
2022-07-21 13:27:11 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/8488/0/logs.log
2022-07-21 13:27:11 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha
2022-07-21 13:27:11 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-file:0.2.14 exists...
2022-07-21 13:27:11 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-file:0.2.14 was found locally.
2022-07-21 13:27:11 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 8488
2022-07-21 13:27:11 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/8488/0 --log-driver none --name source-file-check-8488-0-ctips --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/source-file:0.2.14 -e WORKER_JOB_ATTEMPT=0 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=8488 airbyte/source-file:0.2.14 check --config source_config.json
2022-07-21 13:27:14 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):97 - Checking access to sftp:///sftproot/dli-sftp/all_skyward_users.csv...
2022-07-21 13:27:14 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):96 - ignoring unsupported keyword arguments: ['connect_kwargs']
2022-07-21 13:27:14 ERROR i.a.c.i.LineGobbler(voidCall):82 - /usr/local/lib/python3.9/site-packages/paramiko/transport.py:219: CryptographyDeprecationWarning: Blowfish has been deprecated
2022-07-21 13:27:14 ERROR i.a.c.i.LineGobbler(voidCall):82 -   "class": algorithms.Blowfish,
2022-07-21 13:27:14 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):97 - Check succeeded
2022-07-21 13:27:15 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling...
2022-07-21 13:27:15 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/8488/0/logs.log
2022-07-21 13:27:15 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha
2022-07-21 13:27:15 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-redshift:0.3.47 exists...
2022-07-21 13:27:15 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-redshift:0.3.47 was found locally.
2022-07-21 13:27:15 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 8488
2022-07-21 13:27:15 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/8488/0 --log-driver none --name destination-redshift-check-8488-0-ljslj --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/destination-redshift:0.3.47 -e WORKER_JOB_ATTEMPT=0 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=8488 airbyte/destination-redshift:0.3.47 check --config source_config.json
2022-07-21 13:27:16 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings.
2022-07-21 13:27:16 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-07-21 13:27:16 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-07-21 13:27:16 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-07-21 13:27:16 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-07-21 13:27:16 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2022-07-21 13:27:16 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-07-21 13:27:18 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-21 13:27:18 INFO i.a.i.d.r.RedshiftDestination(main):63 - starting destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination
2022-07-21 13:27:18 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-21 13:27:18 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json}
2022-07-21 13:27:18 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-21 13:27:18 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.redshift.RedshiftDestination
2022-07-21 13:27:18 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-21 13:27:18 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK
2022-07-21 13:27:18 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-21 13:27:18 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}
2022-07-21 13:27:18 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-21 13:27:18 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-07-21 13:27:18 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-21 13:27:18 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-07-21 13:27:18 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-21 13:27:18 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-07-21 13:27:18 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-21 13:27:18 INFO i.a.i.d.j.c.SwitchingDestination(check):55 - Using destination type: COPY_S3
2022-07-21 13:27:18 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-21 13:27:18 INFO i.a.i.d.s.S3DestinationConfig(createS3Client):190 - Creating S3 client...
2022-07-21 13:27:19 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-21 13:27:19 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):102 - Storage Object psd.airbyte.staging/psd.airbyte.staging does not exist in bucket; creating...
2022-07-21 13:27:19 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-21 13:27:19 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):104 - Storage Object psd.airbyte.staging/psd.airbyte.staging has been created in bucket.
2022-07-21 13:27:19 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-21 13:27:19 INFO i.a.i.d.s.S3Destination(testIAMUserHasListObjectPermission):155 - Started testing if IAM user can call listObjects on the destination bucket
2022-07-21 13:27:19 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-21 13:27:19 INFO i.a.i.d.s.S3Destination(testIAMUserHasListObjectPermission):158 - Finished checking for listObjects permission
2022-07-21 13:27:20 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-21 13:27:20 INFO c.z.h.HikariDataSource(<init>):80 - HikariPool-1 - Starting...
2022-07-21 13:27:20 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-21 13:27:20 INFO c.z.h.HikariDataSource(<init>):82 - HikariPool-1 - Start completed.
2022-07-21 13:27:20 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-21 13:27:20 INFO c.z.h.p.PoolBase(getAndSetNetworkTimeout):536 - HikariPool-1 - Driver does not support get/set network timeout for connections. ([Amazon][JDBC](10220) Driver does not support this optional feature.)
2022-07-21 13:27:20 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-21 13:27:20 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated...
2022-07-21 13:27:20 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-21 13:27:20 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed.
2022-07-21 13:27:21 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling...
2022-07-21 13:27:21 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/8488/0/logs.log
2022-07-21 13:27:21 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha
2022-07-21 13:27:21 INFO i.a.w.g.DefaultReplicationWorker(run):115 - start sync worker. job id: 8488 attempt id: 0
2022-07-21 13:27:21 INFO i.a.w.g.DefaultReplicationWorker(run):127 - configured sync modes: {null.skyward_staff=full_refresh - overwrite}
2022-07-21 13:27:21 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination...
2022-07-21 13:27:21 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-redshift:0.3.47 exists...
2022-07-21 13:27:21 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-redshift:0.3.47 was found locally.
2022-07-21 13:27:21 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 8488
2022-07-21 13:27:21 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/8488/0 --log-driver none --name destination-redshift-write-8488-0-ittzk --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/destination-redshift:0.3.47 -e WORKER_JOB_ATTEMPT=0 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=8488 airbyte/destination-redshift:0.3.47 write --config destination_config.json --catalog destination_catalog.json
2022-07-21 13:27:21 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-file:0.2.14 exists...
2022-07-21 13:27:21 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-file:0.2.14 was found locally.
2022-07-21 13:27:21 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 8488
2022-07-21 13:27:21 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/8488/0 --log-driver none --name source-file-read-8488-0-fdczz --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/source-file:0.2.14 -e WORKER_JOB_ATTEMPT=0 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=8488 airbyte/source-file:0.2.14 read --config source_config.json --catalog source_catalog.json --state input_state.json
2022-07-21 13:27:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):405 - Destination output thread started.
2022-07-21 13:27:21 INFO i.a.w.g.DefaultReplicationWorker(run):169 - Waiting for source and destination threads to complete.
2022-07-21 13:27:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):298 - Replication thread started.
2022-07-21 13:27:22 destination > SLF4J: Class path contains multiple SLF4J bindings.
2022-07-21 13:27:22 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-07-21 13:27:22 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-reload4j-1.7.36.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-07-21 13:27:22 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-07-21 13:27:22 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-07-21 13:27:22 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2022-07-21 13:27:23 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-07-21 13:27:25 destination > 2022-07-21 13:27:25 INFO i.a.i.d.r.RedshiftDestination(main):63 - starting destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination
2022-07-21 13:27:25 destination > 2022-07-21 13:27:25 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2022-07-21 13:27:25 destination > 2022-07-21 13:27:25 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.redshift.RedshiftDestination
2022-07-21 13:27:25 destination > 2022-07-21 13:27:25 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE
2022-07-21 13:27:25 destination > 2022-07-21 13:27:25 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2022-07-21 13:27:26 destination > 2022-07-21 13:27:26 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-07-21 13:27:26 destination > 2022-07-21 13:27:26 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-07-21 13:27:26 destination > 2022-07-21 13:27:26 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-07-21 13:27:26 source > Reading skyward_staff (sftp:///sftproot/dli-sftp/all_skyward_users.csv)...
2022-07-21 13:27:26 source > ignoring unsupported keyword arguments: ['connect_kwargs']
2022-07-21 13:27:26 destination > 2022-07-21 13:27:26 INFO i.a.i.d.j.c.SwitchingDestination(getConsumer):65 - Using destination type: COPY_S3
2022-07-21 13:27:26 source > /usr/local/lib/python3.9/site-packages/paramiko/transport.py:219: CryptographyDeprecationWarning: Blowfish has been deprecated
2022-07-21 13:27:26 source >   "class": algorithms.Blowfish,
2022-07-21 13:27:26 source > /airbyte/integration_code/source_file/client.py:364: FutureWarning: Passing a set as an indexer is deprecated and will raise in a future version. Use a list instead.
2022-07-21 13:27:26 source >   yield from df[columns].to_dict(orient="records")
...
2024 records removed (sensitive data)
...
2022-07-21 13:27:29 destination > 2022-07-21 13:27:29 INFO i.a.i.d.s.StagingConsumerFactory(lambda$toWriteConfig$0):99 - Write config: WriteConfig{streamName=sftp_skyward_staff, namespace=null, outputSchemaName=raw_data, tmpTableName=_airbyte_tmp_wyc_sftp_skyward_staff, outputTableName=_airbyte_raw_sftp_skyward_staff, syncMode=overwrite}
2022-07-21 13:27:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):335 - Total records read: 43 (35 KB)
2022-07-21 13:27:29 INFO i.a.w.g.DefaultReplicationWorker(run):174 - One of source or destination thread complete. Waiting on the other.
2022-07-21 13:27:29 destination > 2022-07-21 13:27:29 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started.
2022-07-21 13:27:29 destination > 2022-07-21 13:27:29 INFO i.a.i.d.s.StagingConsumerFactory(lambda$onStartFunction$2):117 - Preparing tmp tables in destination started for 1 streams
2022-07-21 13:27:29 destination > 2022-07-21 13:27:29 INFO i.a.i.d.s.StagingConsumerFactory(lambda$onStartFunction$2):125 - Preparing staging area in destination started for schema raw_data stream sftp_skyward_staff: tmp table: _airbyte_tmp_wyc_sftp_skyward_staff, stage: raw_data_sftp_skyward_staff/2022_07_21_13_e68ffb11-ca22-4be1-b420-648fffe3ab77/
2022-07-21 13:27:30 destination > 2022-07-21 13:27:30 INFO c.z.h.p.PoolBase(getAndSetNetworkTimeout):536 - HikariPool-1 - Driver does not support get/set network timeout for connections. ([Amazon][JDBC](10220) Driver does not support this optional feature.)
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):102 - Storage Object psd.airbyte.staging/raw_data_sftp_skyward_staff does not exist in bucket; creating...
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):104 - Storage Object psd.airbyte.staging/raw_data_sftp_skyward_staff has been created in bucket.
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO i.a.i.d.s.StagingConsumerFactory(lambda$onStartFunction$2):136 - Preparing staging area in destination completed for schema raw_data stream sftp_skyward_staff
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO i.a.i.d.s.StagingConsumerFactory(lambda$onStartFunction$2):139 - Preparing tmp tables in destination completed.
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):48 - Starting a new buffer for stream sftp_skyward_staff (current state: 0 bytes in 0 buffers)
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded.
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO i.a.i.d.b.BufferedStreamConsumer(close):171 - executing on success close procedure.
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):103 - Flushing all 1 current buffers (0 bytes in total)
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$flushAll$2):106 - Flushing buffer of stream sftp_skyward_staff (10 bytes)
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO i.a.i.d.s.StagingConsumerFactory(lambda$flushBufferFunction$3):158 - Flushing buffer for stream sftp_skyward_staff (10 bytes) to staging
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO i.a.i.d.r.BaseSerializedBuffer(flush):131 - Wrapping up compression and write GZIP trailer data.
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 - Finished writing data to d54f30d9-0bdd-4b38-a21d-91b81b5dca3710546358447974248616.csv.gz (6 KB)
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to psd.airbyte.staging/raw_data_sftp_skyward_staff/2022_07_21_13_e68ffb11-ca22-4be1-b420-648fffe3ab77/0.csv.gz with full ID FCNt6GRsFAzyQmZYDqj0WFn9GPFv9K8n_579_kKpfO01h16w.oYcT8qVKG2r_yFbmiID02Th7kTnGhHBHTNFq5GqAYPe4yi8PTpsNWdBm7nuMCe4P0LI4e4OUxBwn0v_
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000]
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO a.m.s.StreamTransferManager(complete):367 - [Manager uploading to psd.airbyte.staging/raw_data_sftp_skyward_staff/2022_07_21_13_e68ffb11-ca22-4be1-b420-648fffe3ab77/0.csv.gz with id FCNt6GRsF...OUxBwn0v_]: Uploading leftover stream [Part number 1 containing 0.01 MB]
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to psd.airbyte.staging/raw_data_sftp_skyward_staff/2022_07_21_13_e68ffb11-ca22-4be1-b420-648fffe3ab77/0.csv.gz with id FCNt6GRsF...OUxBwn0v_]: Finished uploading [Part number 1 containing 0.01 MB]
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to psd.airbyte.staging/raw_data_sftp_skyward_staff/2022_07_21_13_e68ffb11-ca22-4be1-b420-648fffe3ab77/0.csv.gz with id FCNt6GRsF...OUxBwn0v_]: Completed
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):198 - Uploaded buffer file to storage: d54f30d9-0bdd-4b38-a21d-91b81b5dca3710546358447974248616.csv.gz -> raw_data_sftp_skyward_staff/2022_07_21_13_e68ffb11-ca22-4be1-b420-648fffe3ab77/0.csv.gz (filename: 0.csv.gz)
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO i.a.i.d.r.FileBuffer(deleteFile):81 - Deleting tempFile data d54f30d9-0bdd-4b38-a21d-91b81b5dca3710546358447974248616.csv.gz
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO i.a.i.d.r.SerializedBufferingStrategy(close):127 - Closing buffer for stream sftp_skyward_staff
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):186 - Copying into tables in destination started for 1 streams
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):195 - Copying stream sftp_skyward_staff of schema raw_data into tmp table _airbyte_tmp_wyc_sftp_skyward_staff to final table _airbyte_raw_sftp_skyward_staff from stage path raw_data_sftp_skyward_staff/2022_07_21_13_e68ffb11-ca22-4be1-b420-648fffe3ab77/ with 1 file(s) [0.csv.gz]
2022-07-21 13:27:31 destination > 2022-07-21 13:27:31 INFO i.a.i.d.r.o.RedshiftS3StagingSqlOperations(copyIntoTmpTableFromStage):109 - Starting copy to tmp table from stage: _airbyte_tmp_wyc_sftp_skyward_staff in destination from stage: raw_data_sftp_skyward_staff/2022_07_21_13_e68ffb11-ca22-4be1-b420-648fffe3ab77/, schema: raw_data, .
2022-07-21 13:27:32 destination > 2022-07-21 13:27:32 INFO i.a.i.d.r.o.RedshiftS3StagingSqlOperations(copyIntoTmpTableFromStage):116 - Copy to tmp table raw_data._airbyte_tmp_wyc_sftp_skyward_staff in destination complete.
2022-07-21 13:27:32 destination > 2022-07-21 13:27:32 INFO i.a.i.d.r.o.RedshiftSqlOperations(onDestinationCloseOperations):139 - Executing operations for Redshift Destination DB engine...
2022-07-21 13:27:32 destination > 2022-07-21 13:27:32 INFO i.a.i.d.r.o.RedshiftSqlOperations(discoverNotSuperTables):189 - Discovering NOT SUPER table types...
2022-07-21 13:27:32 destination > 2022-07-21 13:27:32 INFO i.a.i.d.r.o.RedshiftSqlOperations(onDestinationCloseOperations):157 - Executing operations for Redshift Destination DB engine completed.
2022-07-21 13:27:32 destination > 2022-07-21 13:27:32 INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):216 - Executing finalization of tables.
2022-07-21 13:27:32 destination > 2022-07-21 13:27:32 INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):218 - Finalizing tables in destination completed.
2022-07-21 13:27:32 destination > 2022-07-21 13:27:32 INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):220 - Cleaning up destination started for 1 streams
2022-07-21 13:27:32 destination > 2022-07-21 13:27:32 INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):224 - Cleaning tmp table in destination started for stream sftp_skyward_staff. schema raw_data, tmp table name: _airbyte_tmp_wyc_sftp_skyward_staff
2022-07-21 13:27:32 destination > 2022-07-21 13:27:32 INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):230 - Cleaning stage in destination started for stream sftp_skyward_staff. schema raw_data, stage: raw_data_sftp_skyward_staff
2022-07-21 13:27:32 destination > 2022-07-21 13:27:32 INFO i.a.i.d.s.S3StorageOperations(cleanUpObjects):301 - Deleting objects raw_data_sftp_skyward_staff/, raw_data_sftp_skyward_staff/2022_07_21_13_e68ffb11-ca22-4be1-b420-648fffe3ab77/0.csv.gz, raw_data_sftp_skyward_staff/2022_07_21_13_e68ffb11-ca22-4be1-b420-648fffe3ab77/78efaf21-975e-443a-95ac-356262d38302.manifest
2022-07-21 13:27:32 destination > 2022-07-21 13:27:32 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):290 - Storage bucket raw_data_sftp_skyward_staff has been cleaned-up (3 objects were deleted)...
2022-07-21 13:27:32 destination > 2022-07-21 13:27:32 INFO i.a.i.d.s.StagingConsumerFactory(lambda$onCloseFunction$4):235 - Cleaning up destination completed.
2022-07-21 13:27:32 destination > 2022-07-21 13:27:32 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.destination.redshift.RedshiftDestination
2022-07-21 13:27:32 destination > 2022-07-21 13:27:32 INFO i.a.i.d.r.RedshiftDestination(main):65 - completed destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination
2022-07-21 13:27:33 INFO i.a.w.g.DefaultReplicationWorker(run):176 - Source and destination threads complete.
2022-07-21 13:27:33 INFO i.a.w.g.DefaultReplicationWorker(run):239 - sync summary: io.airbyte.config.ReplicationAttemptSummary@70858bff[status=completed,recordsSynced=43,bytesSynced=36587,startTime=1658410041306,endTime=1658410053353,totalStats=io.airbyte.config.SyncStats@3b504ba7[recordsEmitted=43,bytesEmitted=36587,stateMessagesEmitted=0,recordsCommitted=43],streamStats=[io.airbyte.config.StreamSyncStats@6c0e62ea[streamName=sftp_skyward_staff,stats=io.airbyte.config.SyncStats@3d06a8ce[recordsEmitted=43,bytesEmitted=36587,stateMessagesEmitted=<null>,recordsCommitted=43]]]]
2022-07-21 13:27:33 INFO i.a.w.g.DefaultReplicationWorker(run):268 - Source did not output any state messages
2022-07-21 13:27:33 WARN i.a.w.g.DefaultReplicationWorker(run):276 - State capture: No new state, falling back on input state: io.airbyte.config.State@618006e2[state={}]
2022-07-21 13:27:33 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling...
2022-07-21 13:27:33 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):161 - sync summary: io.airbyte.config.StandardSyncOutput@26b627b1[standardSyncSummary=io.airbyte.config.StandardSyncSummary@2c1bf471[status=completed,recordsSynced=43,bytesSynced=36587,startTime=1658410041306,endTime=1658410053353,totalStats=io.airbyte.config.SyncStats@3b504ba7[recordsEmitted=43,bytesEmitted=36587,stateMessagesEmitted=0,recordsCommitted=43],streamStats=[io.airbyte.config.StreamSyncStats@6c0e62ea[streamName=sftp_skyward_staff,stats=io.airbyte.config.SyncStats@3d06a8ce[recordsEmitted=43,bytesEmitted=36587,stateMessagesEmitted=<null>,recordsCommitted=43]]]],normalizationSummary=<null>,state=io.airbyte.config.State@618006e2[state={}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@fb78ba2[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@55b3e2bf[stream=io.airbyte.protocol.models.AirbyteStream@42afcc17[name=sftp_skyward_staff,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"ZIP":{"type":["string","null"]},"CITY":{"type":["string","null"]},"POBOX":{"type":["string","null"]},"STATE":{"type":["string","null"]},"TITLE":{"type":["string","null"]},"GENDER":{"type":["string","null"]},"PHONE1":{"type":["string","null"]},"PHONE2":{"type":["string","null"]},"PHONE3":{"type":["string","null"]},"PSD_SSN":{"type":["number","null"]},"KEY_CARD":{"type":["number","null"]},"BIRTHDATE":{"type":["string","null"]},"BLDG_NAME":{"type":["string","null"]},"LAST_NAME":{"type":["string","null"]},"RACE_CODE":{"type":["string","null"]},"WORK_DAYS":{"type":["number","null"]},"ZIP_PLUS4":{"type":["string","null"]},"BLDG2_NAME":{"type":["string","null"]},"BLDG3_NAME":{"type":["string","null"]},"FIRST_NAME":{"type":["string","null"]},"START_DATE":{"type":["string","null"]},"STREET_DIR":{"type":["string","null"]},"WP_NAME_ID":{"type":["number","null"]},"CERT_NUMBER":{"type":["string","null"]},"MIDDLE_NAME":{"type":["string","null"]},"NAME_SUFFIX":{"type":["string","null"]},"STREET_APPT":{"type":["string","null"]},"STREET_NAME":{"type":["string","null"]},"WP_BLDG_CODE":{"type":["string","null"]},"WP_NALPHAKEY":{"type":["string","null"]},"EMPLOYEE_TYPE":{"type":["string","null"]},"HAAPRO-ACTIVE":{"type":["boolean","null"]},"STREET_NUMBER":{"type":["string","null"]},"WP_BLDG2_CODE":{"type":["string","null"]},"WP_BLDG3_CODE":{"type":["string","null"]},"STATE_BLDG_CODE":{"type":["number","null"]},"STATE_BLDG2_CODE":{"type":["number","null"]},"STATE_BLDG3_CODE":{"type":["number","null"]},"EMPLOYEE_TYPE_CODE":{"type":["string","null"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=<null>,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=<null>,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[],additionalProperties={}]],additionalProperties={}],failures=[]]
2022-07-21 13:27:33 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating...