2022-09-28 13:30:26 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.access_token: is missing but it is required, $.refresh_token: is missing but it is required
2022-09-28 13:30:26 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.private_key: is missing but it is required
2022-09-28 13:30:26 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.password: object found, string expected
2022-09-28 13:30:26 INFO i.a.a.LoggingTrackingClient(track):43 - track. version: null, userId: null, action: Connector Jobs, metadata: {job_type=sync, config.source.format.infer_datatypes=true, namespace_definition=customformat, config.destination.loading_method.method=Standard, config.source.format.additional_reader_options=set, config.source.format.delimiter=set, frequency=manual, connector_source_definition_id=69589781-7828-43c5-9f63-8925b1c1ccc2, workspace_id=6235d81b-dbe6-43bd-8c5e-30222856eaec, config.destination.database=set, attempt_stage=STARTED, config.source.format.filetype=csv, config.destination.warehouse=set, attempt_id=1, config.source.format.newlines_in_values=false, connector_destination=Snowflake, catalog.sync_mode.incremental=set, connector_destination_docker_repository=airbyte/destination-snowflake, config.source.schema=set, config.source.format.advanced_options=set, config.destination.role=set, table_prefix=false, workspace_name=6235d81b-dbe6-43bd-8c5e-30222856eaec, config.source.format.double_quote=true, config.source.dataset=set, config.source.provider.aws_secret_access_key._secret=set, config.source.format.quote_char=set, number_of_streams=1, connector_source=S3, config.destination.host=set, config.source.provider.path_prefix=set, connector_source_docker_repository=airbyte/source-s3, config.source.format.block_size=set, config.destination.schema=set, config.destination.username=set, connection_id=56f2566a-f86d-409f-820c-c5ac8714b121, config.source.path_pattern=set, job_id=22058, connector_source_version=0.1.21, catalog.destination_sync_mode.append=set, connector_destination_version=0.4.38, config.source.provider.aws_access_key_id._secret=set, config.source.format.encoding=set, operation.normalization=1, operation_count=1, config.source.provider.bucket=set, connector_destination_definition_id=424892c4-daac-4491-b35d-c6688ba547ba}
2022-09-28 13:30:26 INFO i.a.w.t.TemporalAttemptExecution(get):106 - Docker volume job log path: /tmp/workspace/22058/0/logs.log
2022-09-28 13:30:26 INFO i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.9
2022-09-28 13:30:26 INFO i.a.c.i.LineGobbler(voidCall):114 - 
2022-09-28 13:30:26 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK -----
2022-09-28 13:30:26 INFO i.a.c.i.LineGobbler(voidCall):114 - 
2022-09-28 13:30:26 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-s3:0.1.21 exists...
2022-09-28 13:30:26 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-s3:0.1.21 was found locally.
2022-09-28 13:30:26 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-s3-check-22058-0-yoxby with resources io.airbyte.config.ResourceRequirements@7a614b44[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=]
2022-09-28 13:30:26 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/22058/0 --log-driver none --name source-s3-check-22058-0-yoxby --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/source-s3:0.1.21 -e AIRBYTE_VERSION=0.40.9 -e WORKER_JOB_ID=22058 airbyte/source-s3:0.1.21 check --config source_config.json
2022-09-28 13:30:28 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - initialised stream with format: 
2022-09-28 13:30:28 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - initialised stream with format: {'encoding': 'utf8', 'filetype': 'csv', 'delimiter': ',', 'block_size': 100000, 'quote_char': '"', 'double_quote': True, 'infer_datatypes': True, 'advanced_options': '{}', 'newlines_in_values': False, 'additional_reader_options': '{}'}
2022-09-28 13:30:28 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Iterating S3 bucket 'sagemaker-job-cancellation-model' with prefix: 'models_log_Ireland/model_logs_production/metadata/' 
2022-09-28 13:30:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Check succeeded
2022-09-28 13:30:30 INFO i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling...
2022-09-28 13:30:30 INFO i.a.c.i.LineGobbler(voidCall):114 - 
2022-09-28 13:30:30 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK -----
2022-09-28 13:30:30 INFO i.a.c.i.LineGobbler(voidCall):114 - 
2022-09-28 13:30:30 INFO i.a.w.t.TemporalAttemptExecution(get):106 - Docker volume job log path: /tmp/workspace/22058/0/logs.log
2022-09-28 13:30:30 INFO i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.9
2022-09-28 13:30:30 INFO i.a.c.i.LineGobbler(voidCall):114 - 
2022-09-28 13:30:30 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK -----
2022-09-28 13:30:30 INFO i.a.c.i.LineGobbler(voidCall):114 - 
2022-09-28 13:30:30 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-snowflake:0.4.38 exists...
2022-09-28 13:30:30 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-snowflake:0.4.38 was found locally.
2022-09-28 13:30:30 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-snowflake-check-22058-0-nytmt with resources io.airbyte.config.ResourceRequirements@7a614b44[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=]
2022-09-28 13:30:30 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/22058/0 --log-driver none --name destination-snowflake-check-22058-0-nytmt --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-snowflake:0.4.38 -e AIRBYTE_VERSION=0.40.9 -e WORKER_JOB_ID=22058 airbyte/destination-snowflake:0.4.38 check --config source_config.json
2022-09-28 13:30:31 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - integration args: {check=null, config=source_config.json}
2022-09-28 13:30:31 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Running integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination
2022-09-28 13:30:31 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Command: CHECK
2022-09-28 13:30:31 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}
2022-09-28 13:30:31 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-09-28 13:30:31 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-09-28 13:30:31 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Using destination type: INTERNAL_STAGING
2022-09-28 13:30:32 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Starting...
2022-09-28 13:30:33 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Added connection net.snowflake.client.jdbc.SnowflakeConnectionV1@532e27ab
2022-09-28 13:30:33 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Start completed.
2022-09-28 13:30:33 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - closing connection
2022-09-28 13:30:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Shutdown initiated...
2022-09-28 13:30:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - HikariPool-1 - Shutdown completed.
2022-09-28 13:30:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Completed integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination
2022-09-28 13:30:35 INFO i.a.c.i.LineGobbler(voidCall):114 - 
2022-09-28 13:30:35 INFO i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling...
2022-09-28 13:30:35 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK -----
2022-09-28 13:30:35 INFO i.a.c.i.LineGobbler(voidCall):114 - 
2022-09-28 13:30:35 INFO i.a.w.t.TemporalAttemptExecution(get):106 - Docker volume job log path: /tmp/workspace/22058/0/logs.log
2022-09-28 13:30:35 INFO i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.9
2022-09-28 13:30:35 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):49 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false'
2022-09-28 13:30:35 INFO i.a.c.EnvConfigs(getEnvOrDefault):1096 - Using default value for environment variable METRIC_CLIENT: ''
2022-09-28 13:30:35 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 
2022-09-28 13:30:35 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):49 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false'
2022-09-28 13:30:35 INFO i.a.w.g.DefaultReplicationWorker(run):122 - start sync worker. job id: 22058 attempt id: 0
2022-09-28 13:30:35 INFO i.a.c.i.LineGobbler(voidCall):114 - 
2022-09-28 13:30:35 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START REPLICATION -----
2022-09-28 13:30:35 INFO i.a.c.i.LineGobbler(voidCall):114 - 
2022-09-28 13:30:35 INFO i.a.w.g.DefaultReplicationWorker(run):135 - configured sync modes: {null.cancellation_model_ireland_prod_metadata=incremental - append}
2022-09-28 13:30:35 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination...
2022-09-28 13:30:35 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-snowflake:0.4.38 exists...
2022-09-28 13:30:35 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-snowflake:0.4.38 was found locally.
2022-09-28 13:30:35 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-snowflake-write-22058-0-eycja with resources io.airbyte.config.ResourceRequirements@3168ed32[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=]
2022-09-28 13:30:35 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/22058/0 --log-driver none --name destination-snowflake-write-22058-0-eycja --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-snowflake:0.4.38 -e AIRBYTE_VERSION=0.40.9 -e WORKER_JOB_ID=22058 airbyte/destination-snowflake:0.4.38 write --config destination_config.json --catalog destination_catalog.json
2022-09-28 13:30:35 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-s3:0.1.21 exists...
2022-09-28 13:30:35 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-s3:0.1.21 was found locally.
2022-09-28 13:30:35 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-s3-read-22058-0-qafjl with resources io.airbyte.config.ResourceRequirements@7d00c976[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=]
2022-09-28 13:30:35 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/22058/0 --log-driver none --name source-s3-read-22058-0-qafjl --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/source-s3:0.1.21 -e AIRBYTE_VERSION=0.40.9 -e WORKER_JOB_ID=22058 airbyte/source-s3:0.1.21 read --config source_config.json --catalog source_catalog.json --state input_state.json
2022-09-28 13:30:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):435 - Destination output thread started.
2022-09-28 13:30:35 INFO i.a.w.g.DefaultReplicationWorker(run):177 - Waiting for source and destination threads to complete.
2022-09-28 13:30:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):322 - Replication thread started.
2022-09-28 13:30:37 destination > integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2022-09-28 13:30:37 destination > Running integration: io.airbyte.integrations.destination.snowflake.SnowflakeDestination
2022-09-28 13:30:37 destination > Command: WRITE
2022-09-28 13:30:37 destination > Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2022-09-28 13:30:37 destination > Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-09-28 13:30:37 destination > Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-09-28 13:30:37 destination > Using destination type: INTERNAL_STAGING
2022-09-28 13:30:37 source > initialised stream with format: 
2022-09-28 13:30:37 source > Starting syncing SourceS3
2022-09-28 13:30:37 source > initialised stream with format: {'encoding': 'utf8', 'filetype': 'csv', 'delimiter': ',', 'block_size': 100000, 'quote_char': '"', 'double_quote': True, 'infer_datatypes': True, 'advanced_options': '{}', 'newlines_in_values': False, 'additional_reader_options': '{}'}
2022-09-28 13:30:37 source > Syncing stream: cancellation_model_ireland_prod_metadata 
2022-09-28 13:30:37 source > Iterating S3 bucket 'sagemaker-job-cancellation-model' with prefix: 'models_log_Ireland/model_logs_production/metadata/' 
2022-09-28 13:30:38 destination > Write config: WriteConfig{streamName=cancellation_model_ireland_prod_metadata, namespace=machine_learning, outputSchemaName=machine_learning, tmpTableName=_airbyte_tmp_gja_cancellation_model_ireland_prod_metadata, outputTableName=_airbyte_raw_cancellation_model_ireland_prod_metadata, syncMode=append}
2022-09-28 13:30:38 destination > class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started.
2022-09-28 13:30:38 destination > Preparing tmp tables in destination started for 1 streams
2022-09-28 13:30:38 destination > Preparing staging area in destination started for schema machine_learning stream cancellation_model_ireland_prod_metadata: tmp table: _airbyte_tmp_gja_cancellation_model_ireland_prod_metadata, stage: 2022/09/28/13/1134D808-7420-4452-9FAE-8D3FC1E2D320/
2022-09-28 13:30:38 destination > HikariPool-1 - Starting...
2022-09-28 13:30:39 destination > HikariPool-1 - Added connection net.snowflake.client.jdbc.SnowflakeConnectionV1@66236a0a
2022-09-28 13:30:39 destination > HikariPool-1 - Start completed.
2022-09-28 13:30:39 destination > closing connection
2022-09-28 13:30:39 destination > Preparing staging area in destination completed for schema machine_learning stream cancellation_model_ireland_prod_metadata
2022-09-28 13:30:39 destination > Preparing tmp tables in destination completed.