2023-02-14 14:53:20 INFO i.a.v.j.JsonSchemaValidator(test):130 - JSON schema validation failed. errors: $.format_type: does not have a value in the enumeration [Avro], $.compression_codec: should be valid to one and only one of schema, but more than one are valid: {"title":"No Compression","required":["codec"],"properties":{"codec":{"enum":["no compression"],"type":"string","default":"no compression"}}}{"title":"Deflate","required":["codec","compression_level"],"properties":{"codec":{"enum":["Deflate"],"type":"string","default":"Deflate"},"compression_level":{"type":"integer","title":"Deflate Level","default":0,"maximum":9,"minimum":0,"description":"0: no compression & fastest, 9: best compression & slowest."}}}{"title":"bzip2","required":["codec"],"properties":{"codec":{"enum":["bzip2"],"type":"string","default":"bzip2"}}}{"title":"xz","required":["codec","compression_level"],"properties":{"codec":{"enum":["xz"],"type":"string","default":"xz"},"compression_level":{"type":"integer","title":"Compression Level","default":6,"maximum":9,"minimum":0,"description":"See here for details."}}}{"title":"zstandard","required":["codec","compression_level"],"properties":{"codec":{"enum":["zstandard"],"type":"string","default":"zstandard"},"include_checksum":{"type":"boolean","title":"Include Checksum","default":false,"description":"If true, include a checksum with each data block."},"compression_level":{"type":"integer","title":"Compression Level","default":3,"maximum":22,"minimum":-5,"description":"Negative levels are 'fast' modes akin to lz4 or snappy, levels above 9 are generally for archival purposes, and levels above 18 use a lot of memory."}}}{"title":"snappy","required":["codec"],"properties":{"codec":{"enum":["snappy"],"type":"string","default":"snappy"}}}, $.compression_codec: string found, object expected 2023-02-14 14:53:20 INFO i.a.v.j.JsonSchemaValidator(test):130 - JSON schema validation failed. errors: $.flattening: is missing but it is required, $.format_type: does not have a value in the enumeration [CSV] 2023-02-14 14:53:20 INFO i.a.v.j.JsonSchemaValidator(test):130 - JSON schema validation failed. errors: $.format_type: does not have a value in the enumeration [JSONL] 2023-02-14 14:53:20 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/7455/0/logs.log 2023-02-14 14:53:20 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.40.23 2023-02-14 14:53:20 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-02-14 14:53:20 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):56 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2023-02-14 14:53:20 INFO i.a.c.EnvConfigs(getEnvOrDefault):1094 - Using default value for environment variable METRIC_CLIENT: '' 2023-02-14 14:53:20 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2023-02-14 14:53:20 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):56 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2023-02-14 14:53:20 INFO i.a.w.g.DefaultReplicationWorker(run):135 - start sync worker. job id: 7455 attempt id: 0 2023-02-14 14:53:20 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-02-14 14:53:20 INFO i.a.w.g.DefaultReplicationWorker(run):150 - configured sync modes: {inquiryreferralservice.referral=full_refresh - overwrite, inquiryreferralservice.relation_to_patient=full_refresh - overwrite, inquiryreferralservice.relation_subcategory=full_refresh - overwrite, inquiryreferralservice.ad_tracking=full_refresh - overwrite, inquiryreferralservice.relation_to_patient_type=full_refresh - overwrite, inquiryreferralservice.information_source=full_refresh - overwrite, inquiryreferralservice.equip_source=full_refresh - overwrite, inquiryreferralservice.inquiry=full_refresh - overwrite, inquiryreferralservice.referral_carer=full_refresh - overwrite, inquiryreferralservice.patient=full_refresh - overwrite, inquiryreferralservice.referral_affiliation=full_refresh - overwrite, inquiryreferralservice.affiliation=full_refresh - overwrite} 2023-02-14 14:53:20 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START REPLICATION ----- 2023-02-14 14:53:20 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-02-14 14:53:20 INFO i.a.w.i.DefaultAirbyteDestination(start):72 - Running destination... 2023-02-14 14:53:20 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-s3:0.3.17 exists... 2023-02-14 14:53:20 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-s3:0.3.17 was found locally. 2023-02-14 14:53:20 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-s3-write-7455-0-pplco with resources io.airbyte.config.ResourceRequirements@79a55c14[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2023-02-14 14:53:20 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/7455/0 --log-driver none --name destination-s3-write-7455-0-pplco --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_CONNECTOR_IMAGE=airbyte/destination-s3:0.3.17 -e WORKER_JOB_ATTEMPT=0 -e AUTO_DETECT_SCHEMA=false -e AIRBYTE_VERSION=0.40.23 -e WORKER_JOB_ID=7455 airbyte/destination-s3:0.3.17 write --config destination_config.json --catalog destination_catalog.json 2023-02-14 14:53:20 INFO i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):33 - Writing messages to protocol version 0.2.0 2023-02-14 14:53:20 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):97 - Reading messages from protocol version 0.2.0 2023-02-14 14:53:20 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-postgres:1.0.28 exists... 2023-02-14 14:53:20 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-postgres:1.0.28 was found locally. 2023-02-14 14:53:20 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-postgres-read-7455-0-oujhw with resources io.airbyte.config.ResourceRequirements@de1b309[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2023-02-14 14:53:20 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/7455/0 --log-driver none --name source-postgres-read-7455-0-oujhw --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:1.0.28 -e WORKER_JOB_ATTEMPT=0 -e AUTO_DETECT_SCHEMA=false -e AIRBYTE_VERSION=0.40.23 -e WORKER_JOB_ID=7455 airbyte/source-postgres:1.0.28 read --config source_config.json --catalog source_catalog.json --state input_state.json 2023-02-14 14:53:20 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):97 - Reading messages from protocol version 0.2.0 2023-02-14 14:53:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromDstRunnable$4):243 - Destination output thread started. 2023-02-14 14:53:20 INFO i.a.w.g.DefaultReplicationWorker(replicate):217 - Waiting for source and destination threads to complete. 2023-02-14 14:53:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):291 - Replication thread started. 2023-02-14 14:53:26 source > Running source under deployment mode: OSS 2023-02-14 14:53:26 destination > Running destination under deployment mode: OSS 2023-02-14 14:53:26 destination > Starting destination: io.airbyte.integrations.destination.s3.S3Destination 2023-02-14 14:53:26 source > Starting source: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-02-14 14:53:26 destination > integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2023-02-14 14:53:26 destination > Running integration: io.airbyte.integrations.destination.s3.S3Destination 2023-02-14 14:53:26 destination > Command: WRITE 2023-02-14 14:53:26 destination > Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2023-02-14 14:53:26 source > integration args: {read=null, catalog=source_catalog.json, state=input_state.json, config=source_config.json} 2023-02-14 14:53:26 source > Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource 2023-02-14 14:53:26 source > Command: READ 2023-02-14 14:53:26 source > Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='input_state.json'} 2023-02-14 14:53:27 source > Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-02-14 14:53:27 source > Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-02-14 14:53:27 destination > Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-02-14 14:53:27 destination > Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-02-14 14:53:27 destination > S3 format config: {"format_type":"Parquet","page_size_kb":1024,"block_size_mb":128,"compression_codec":"SNAPPY","dictionary_encoding":true,"max_padding_size_mb":8,"dictionary_page_size_kb":1024} 2023-02-14 14:53:27 destination > Creating S3 client... 2023-02-14 14:53:27 source > Starting connection with method: NO_TUNNEL 2023-02-14 14:53:27 source > using CDC: false 2023-02-14 14:53:28 source > HikariPool-1 - Starting... 2023-02-14 14:53:28 source > HikariPool-1 - Start completed. 2023-02-14 14:53:28 destination > S3 format config: S3ParquetFormatConfig{compressionCodec=SNAPPY, blockSize=134217728, maxPaddingSize=8388608, pageSize=1048576, dictionaryPageSize=1048576, dictionaryEncoding=true, } 2023-02-14 14:53:28 destination > Write config: WriteConfig{streamName=relation_to_patient, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient/2023_02_14_1676386407423_, syncMode=overwrite} 2023-02-14 14:53:28 destination > Write config: WriteConfig{streamName=referral, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/referral/2023_02_14_1676386407423_, syncMode=overwrite} 2023-02-14 14:53:28 destination > Write config: WriteConfig{streamName=patient, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/patient/2023_02_14_1676386407423_, syncMode=overwrite} 2023-02-14 14:53:28 destination > Write config: WriteConfig{streamName=relation_subcategory, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/relation_subcategory/2023_02_14_1676386407423_, syncMode=overwrite} 2023-02-14 14:53:28 destination > Write config: WriteConfig{streamName=referral_affiliation, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/referral_affiliation/2023_02_14_1676386407423_, syncMode=overwrite} 2023-02-14 14:53:28 destination > Write config: WriteConfig{streamName=inquiry, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/inquiry/2023_02_14_1676386407423_, syncMode=overwrite} 2023-02-14 14:53:28 destination > Write config: WriteConfig{streamName=affiliation, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/affiliation/2023_02_14_1676386407423_, syncMode=overwrite} 2023-02-14 14:53:28 destination > Write config: WriteConfig{streamName=referral_carer, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/referral_carer/2023_02_14_1676386407423_, syncMode=overwrite} 2023-02-14 14:53:28 destination > Write config: WriteConfig{streamName=information_source, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/information_source/2023_02_14_1676386407423_, syncMode=overwrite} 2023-02-14 14:53:28 destination > Write config: WriteConfig{streamName=ad_tracking, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_, syncMode=overwrite} 2023-02-14 14:53:28 destination > Write config: WriteConfig{streamName=relation_to_patient_type, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient_type/2023_02_14_1676386407423_, syncMode=overwrite} 2023-02-14 14:53:28 destination > Write config: WriteConfig{streamName=equip_source, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/equip_source/2023_02_14_1676386407423_, syncMode=overwrite} 2023-02-14 14:53:28 destination > class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2023-02-14 14:53:28 destination > Preparing bucket in destination started for 12 streams 2023-02-14 14:53:28 destination > Clearing storage area in destination started for namespace inquiryreferralservice stream relation_to_patient bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2023-02-14 14:53:29 source > using CDC: false 2023-02-14 14:53:29 source > Attempting to get metadata from the database to see if we can connect. 2023-02-14 14:53:29 source > HikariPool-1 - Shutdown initiated... 2023-02-14 14:53:29 source > HikariPool-1 - Shutdown completed. 2023-02-14 14:53:29 source > using CDC: false 2023-02-14 14:53:29 source > using CDC: false 2023-02-14 14:53:29 source > Stream state manager selected to manage state object with type LEGACY. 2023-02-14 14:53:29 source > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_equip_source, New Cursor Field: null. Resetting cursor value 2023-02-14 14:53:29 source > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_inquiry, New Cursor Field: null. Resetting cursor value 2023-02-14 14:53:29 source > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_referral_carer, New Cursor Field: null. Resetting cursor value 2023-02-14 14:53:29 source > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_affiliation, New Cursor Field: null. Resetting cursor value 2023-02-14 14:53:29 source > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_ad_tracking, New Cursor Field: null. Resetting cursor value 2023-02-14 14:53:29 source > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_information_source, New Cursor Field: null. Resetting cursor value 2023-02-14 14:53:29 source > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_referral, New Cursor Field: null. Resetting cursor value 2023-02-14 14:53:29 source > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_patient, New Cursor Field: null. Resetting cursor value 2023-02-14 14:53:29 source > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_relation_to_patient_type, New Cursor Field: null. Resetting cursor value 2023-02-14 14:53:29 source > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_relation_subcategory, New Cursor Field: null. Resetting cursor value 2023-02-14 14:53:29 source > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_relation_to_patient, New Cursor Field: null. Resetting cursor value 2023-02-14 14:53:29 source > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_referral_affiliation, New Cursor Field: null. Resetting cursor value 2023-02-14 14:53:29 source > HikariPool-2 - Starting... 2023-02-14 14:53:29 source > HikariPool-2 - Start completed. 2023-02-14 14:53:29 source > Checking schema: inquiryreferralservice 2023-02-14 14:53:29 source > Internal schemas to exclude: [catalog_history, information_schema, pg_catalog, pg_internal] 2023-02-14 14:53:29 source > Set initial fetch size: 10 rows 2023-02-14 14:53:29 source > Max memory limit: 6249512960, JDBC buffer size: 1073741824 2023-02-14 14:53:29 source > Table referral_carer_backup column carer_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table referral_carer_backup column carer_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_carer_backup column carer_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_carer_backup column carer_phone (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_carer_backup column carer_mobile (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_carer_backup column carer_email (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_carer_backup column carer_preferred_contact (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_carer_backup column carer_first_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_carer_backup column carer_last_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_carer_backup column relation_to_patient (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table flyway_schema_history column installed_rank (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table flyway_schema_history column version (type varchar[50], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table flyway_schema_history column description (type varchar[200], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table flyway_schema_history column type (type varchar[20], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table flyway_schema_history column script (type varchar[1000], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table flyway_schema_history column checksum (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table flyway_schema_history column installed_by (type varchar[100], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table flyway_schema_history column installed_on (type timestamp[29], nullable false) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone}) 2023-02-14 14:53:29 source > Table flyway_schema_history column execution_time (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table flyway_schema_history column success (type bool[1], nullable false) -> JsonSchemaType({type=boolean}) 2023-02-14 14:53:29 source > Table relation_to_patient column relation_to_patient_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table relation_to_patient column relation_to_patient_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table relation_to_patient column is_active (type bool[1], nullable false) -> JsonSchemaType({type=boolean}) 2023-02-14 14:53:29 source > Table relation_to_patient column relation_to_patient_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table relation_to_patient column relation_to_patient_type_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table relation_to_patient column relation_subcategory_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table referral column referral_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table referral column referral_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral column task_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral column referral_created_date (type timestamptz[32], nullable false) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone}) 2023-02-14 14:53:29 source > Table referral column referrer_first_name (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral column referrer_last_name (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral column referrer_phone (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral column referrer_mobile (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral column referrer_email (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral column relation_with_patient (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral column preferred_contact (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral column notes (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral column equip_source_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table referral column patient_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table referral column carer_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table referral column tell_us_more (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral column information_source (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral column extension (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral column linked_patient (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table patient column patient_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table patient column patient_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table patient column patient_first_name (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table patient column patient_last_name (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table patient column patient_state (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table patient column patient_birth_date (type date[13], nullable false) -> JsonSchemaType({type=string, format=date}) 2023-02-14 14:53:29 source > Table patient column patient_age (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table patient column patient_phone (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table patient column patient_mobile (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table patient column patient_email (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table patient column patient_preferred_contact (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table patient column contact_patient_directly (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table relation_subcategory column subcategory_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table relation_subcategory column subcategory_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table relation_subcategory column subcategory_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_affiliation column referral_affiliation_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table referral_affiliation column referral_affiliation_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_affiliation column referral_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table referral_affiliation column referral_affiliation_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_affiliation column referral_affiliation_latitude (type numeric[0], nullable false) -> JsonSchemaType({type=number}) 2023-02-14 14:53:29 source > Table referral_affiliation column referral_affiliation_longitude (type numeric[0], nullable false) -> JsonSchemaType({type=number}) 2023-02-14 14:53:29 source > Table referral_affiliation column referral_affiliation_address_line1 (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_affiliation column referral_affiliation_address_line2 (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_affiliation column referral_affiliation_city (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_affiliation column referral_affiliation_state (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_affiliation column referral_affiliation_zip_code (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table inquiry column inquiry_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table inquiry column inquiry_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table inquiry column task_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table inquiry column inquiry_created_date (type timestamptz[32], nullable false) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone}) 2023-02-14 14:53:29 source > Table inquiry column inquirer_first_name (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table inquiry column inquirer_last_name (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table inquiry column inquirer_phone (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table inquiry column inquirer_mobile (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table inquiry column inquirer_email (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table inquiry column inquiry_about (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table inquiry column relation_with_patient (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table inquiry column preferred_contact (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table inquiry column notes (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table inquiry column equip_source_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table inquiry column patient_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table inquiry column tell_us_more (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table inquiry column information_source (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table inquiry column payor_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table inquiry column referrer_first_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table inquiry column referrer_last_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table inquiry column referrer_affiliation_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table inquiry column linked_patient (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table affiliation column affiliation_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table affiliation column name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table affiliation column latitude (type float4[8], nullable false) -> JsonSchemaType({type=number}) 2023-02-14 14:53:29 source > Table affiliation column longitude (type float4[8], nullable false) -> JsonSchemaType({type=number}) 2023-02-14 14:53:29 source > Table affiliation column address_line_1 (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table affiliation column address_line_2 (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table affiliation column city (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table affiliation column state (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table affiliation column zip_code (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_carer column carer_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table referral_carer column carer_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_carer column carer_phone (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_carer column carer_mobile (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_carer column carer_email (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_carer column carer_preferred_contact (type varchar[255], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_carer column carer_first_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_carer column carer_last_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table referral_carer column relation_to_patient (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table information_source column information_source_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table information_source column information_source_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table information_source column information_source_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table information_source column is_active (type bool[1], nullable false) -> JsonSchemaType({type=boolean}) 2023-02-14 14:53:29 source > Table ad_tracking column ad_tracking_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table ad_tracking column inquiry_referral (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table ad_tracking column utm_source (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table ad_tracking column utm_medium (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table ad_tracking column utm_campaign (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table ad_tracking column utm_adgroup (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table ad_tracking column utm_term (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table ad_tracking column inquiry_referral_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table ad_tracking column utm_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table ad_tracking column gcl_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table relation_to_patient_type column relation_to_patient_type_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table relation_to_patient_type column relation_to_patient_type_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table equip_source column equip_source_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer}) 2023-02-14 14:53:29 source > Table equip_source column equip_source_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Table equip_source column equip_source_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string}) 2023-02-14 14:53:29 source > Found table: inquiryreferralservice.referral_carer_backup 2023-02-14 14:53:29 source > Found table: inquiryreferralservice.flyway_schema_history 2023-02-14 14:53:29 source > Found table: inquiryreferralservice.relation_to_patient 2023-02-14 14:53:29 source > Found table: inquiryreferralservice.referral 2023-02-14 14:53:29 source > Found table: inquiryreferralservice.patient 2023-02-14 14:53:29 source > Found table: inquiryreferralservice.relation_subcategory 2023-02-14 14:53:29 source > Found table: inquiryreferralservice.referral_affiliation 2023-02-14 14:53:29 source > Found table: inquiryreferralservice.inquiry 2023-02-14 14:53:29 source > Found table: inquiryreferralservice.affiliation 2023-02-14 14:53:29 source > Found table: inquiryreferralservice.referral_carer 2023-02-14 14:53:29 source > Found table: inquiryreferralservice.information_source 2023-02-14 14:53:29 source > Found table: inquiryreferralservice.ad_tracking 2023-02-14 14:53:29 source > Found table: inquiryreferralservice.relation_to_patient_type 2023-02-14 14:53:29 source > Found table: inquiryreferralservice.equip_source 2023-02-14 14:53:29 source > using CDC: false 2023-02-14 14:53:29 source > using CDC: false 2023-02-14 14:53:29 source > Queueing query for table: relation_to_patient 2023-02-14 14:53:29 source > Queueing query for table: referral 2023-02-14 14:53:29 source > Queueing query for table: patient 2023-02-14 14:53:29 source > Queueing query for table: relation_subcategory 2023-02-14 14:53:29 source > Queueing query for table: referral_affiliation 2023-02-14 14:53:29 source > Queueing query for table: inquiry 2023-02-14 14:53:29 source > Queueing query for table: affiliation 2023-02-14 14:53:29 source > Queueing query for table: referral_carer 2023-02-14 14:53:29 source > Queueing query for table: information_source 2023-02-14 14:53:29 source > Queueing query for table: ad_tracking 2023-02-14 14:53:29 source > Queueing query for table: relation_to_patient_type 2023-02-14 14:53:29 source > Queueing query for table: equip_source 2023-02-14 14:53:29 source > Set initial fetch size: 10 rows 2023-02-14 14:53:29 source > Max memory limit: 6249512960, JDBC buffer size: 1073741824 2023-02-14 14:53:29 source > Set initial fetch size: 10 rows 2023-02-14 14:53:29 destination > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient/2023_02_14_1676379681925_0.parquet 2023-02-14 14:53:29 source > Max memory limit: 6249512960, JDBC buffer size: 1073741824 2023-02-14 14:53:30 destination > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (1 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2023-02-14 14:53:30 destination > Clearing storage area in destination completed for namespace inquiryreferralservice stream relation_to_patient bucketObject lakehouse/staging/equip_v2 2023-02-14 14:53:30 destination > Clearing storage area in destination started for namespace inquiryreferralservice stream referral bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2023-02-14 14:53:30 destination > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/referral/2023_02_14_1676379681925_0.parquet 2023-02-14 14:53:30 destination > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (1 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/referral/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2023-02-14 14:53:30 destination > Clearing storage area in destination completed for namespace inquiryreferralservice stream referral bucketObject lakehouse/staging/equip_v2 2023-02-14 14:53:30 destination > Clearing storage area in destination started for namespace inquiryreferralservice stream patient bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2023-02-14 14:53:30 destination > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/patient/2023_02_14_1676379681925_0.parquet 2023-02-14 14:53:30 destination > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (1 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/patient/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2023-02-14 14:53:30 destination > Clearing storage area in destination completed for namespace inquiryreferralservice stream patient bucketObject lakehouse/staging/equip_v2 2023-02-14 14:53:30 destination > Clearing storage area in destination started for namespace inquiryreferralservice stream relation_subcategory bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2023-02-14 14:53:31 destination > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/relation_subcategory/2023_02_14_1676379681925_0.parquet 2023-02-14 14:53:31 destination > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (1 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/relation_subcategory/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2023-02-14 14:53:31 destination > Clearing storage area in destination completed for namespace inquiryreferralservice stream relation_subcategory bucketObject lakehouse/staging/equip_v2 2023-02-14 14:53:31 destination > Clearing storage area in destination started for namespace inquiryreferralservice stream referral_affiliation bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2023-02-14 14:53:32 destination > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/referral_affiliation/2023_02_14_1676379681925_0.parquet 2023-02-14 14:53:32 destination > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (1 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/referral_affiliation/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2023-02-14 14:53:32 destination > Clearing storage area in destination completed for namespace inquiryreferralservice stream referral_affiliation bucketObject lakehouse/staging/equip_v2 2023-02-14 14:53:32 destination > Clearing storage area in destination started for namespace inquiryreferralservice stream inquiry bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2023-02-14 14:53:32 destination > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/inquiry/2023_02_14_1676379681925_0.parquet 2023-02-14 14:53:32 destination > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (1 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/inquiry/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2023-02-14 14:53:32 destination > Clearing storage area in destination completed for namespace inquiryreferralservice stream inquiry bucketObject lakehouse/staging/equip_v2 2023-02-14 14:53:32 destination > Clearing storage area in destination started for namespace inquiryreferralservice stream affiliation bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2023-02-14 14:53:33 destination > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/affiliation/2023_02_14_1676379681925_0.parquet 2023-02-14 14:53:33 destination > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (1 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/affiliation/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2023-02-14 14:53:33 destination > Clearing storage area in destination completed for namespace inquiryreferralservice stream affiliation bucketObject lakehouse/staging/equip_v2 2023-02-14 14:53:33 destination > Clearing storage area in destination started for namespace inquiryreferralservice stream referral_carer bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2023-02-14 14:53:33 destination > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/referral_carer/2023_02_14_1676379681925_0.parquet 2023-02-14 14:53:33 destination > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (1 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/referral_carer/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2023-02-14 14:53:33 destination > Clearing storage area in destination completed for namespace inquiryreferralservice stream referral_carer bucketObject lakehouse/staging/equip_v2 2023-02-14 14:53:33 destination > Clearing storage area in destination started for namespace inquiryreferralservice stream information_source bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2023-02-14 14:53:33 destination > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/information_source/2023_02_14_1676379681925_0.parquet 2023-02-14 14:53:33 destination > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (1 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/information_source/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2023-02-14 14:53:33 destination > Clearing storage area in destination completed for namespace inquiryreferralservice stream information_source bucketObject lakehouse/staging/equip_v2 2023-02-14 14:53:33 destination > Clearing storage area in destination started for namespace inquiryreferralservice stream ad_tracking bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2023-02-14 14:53:33 destination > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676379681925_0.parquet, lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676379681925_1.parquet 2023-02-14 14:53:33 destination > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (2 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2023-02-14 14:53:33 destination > Clearing storage area in destination completed for namespace inquiryreferralservice stream ad_tracking bucketObject lakehouse/staging/equip_v2 2023-02-14 14:53:33 destination > Clearing storage area in destination started for namespace inquiryreferralservice stream relation_to_patient_type bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2023-02-14 14:53:34 destination > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (0 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient_type/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2023-02-14 14:53:34 destination > Clearing storage area in destination completed for namespace inquiryreferralservice stream relation_to_patient_type bucketObject lakehouse/staging/equip_v2 2023-02-14 14:53:34 destination > Clearing storage area in destination started for namespace inquiryreferralservice stream equip_source bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_ 2023-02-14 14:53:34 destination > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (0 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/equip_source/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)... 2023-02-14 14:53:34 destination > Clearing storage area in destination completed for namespace inquiryreferralservice stream equip_source bucketObject lakehouse/staging/equip_v2 2023-02-14 14:53:34 destination > Preparing storage area in destination completed. 2023-02-14 14:53:34 destination > Starting a new buffer for stream relation_to_patient (current state: 0 bytes in 0 buffers) 2023-02-14 14:53:34 destination > Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-14 14:53:35 destination > Got brand-new compressor [.snappy] 2023-02-14 14:53:35 destination > Starting a new buffer for stream referral (current state: 5 KB in 1 buffers) 2023-02-14 14:53:35 destination > Got brand-new compressor [.snappy] 2023-02-14 14:53:36 source > Set initial fetch size: 10 rows 2023-02-14 14:53:36 source > Max memory limit: 6249512960, JDBC buffer size: 1073741824 2023-02-14 14:53:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 1000 (600 KB) 2023-02-14 14:53:37 destination > Starting a new buffer for stream patient (current state: 301 KB in 2 buffers) 2023-02-14 14:53:37 destination > Got brand-new compressor [.snappy] 2023-02-14 14:53:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 2000 (943 KB) 2023-02-14 14:53:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 3000 (1 MB) 2023-02-14 14:53:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 4000 (1 MB) 2023-02-14 14:53:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 5000 (1 MB) 2023-02-14 14:53:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 6000 (2 MB) 2023-02-14 14:53:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 7000 (2 MB) 2023-02-14 14:53:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 8000 (2 MB) 2023-02-14 14:53:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 9000 (3 MB) 2023-02-14 14:53:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 10000 (3 MB) 2023-02-14 14:53:40 source > Reading stream patient. Records read: 10000 2023-02-14 14:53:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 11000 (3 MB) 2023-02-14 14:53:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 12000 (4 MB) 2023-02-14 14:53:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 13000 (4 MB) 2023-02-14 14:53:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 14000 (4 MB) 2023-02-14 14:53:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 15000 (5 MB) 2023-02-14 14:53:42 source > Set initial fetch size: 10 rows 2023-02-14 14:53:42 source > Set initial fetch size: 10 rows 2023-02-14 14:53:42 source > Max memory limit: 6249512960, JDBC buffer size: 1073741824 2023-02-14 14:53:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 16000 (5 MB) 2023-02-14 14:53:42 destination > Starting a new buffer for stream relation_subcategory (current state: 2 MB in 3 buffers) 2023-02-14 14:53:42 destination > Got brand-new compressor [.snappy] 2023-02-14 14:53:42 destination > Starting a new buffer for stream referral_affiliation (current state: 2 MB in 4 buffers) 2023-02-14 14:53:42 destination > Got brand-new compressor [.snappy] 2023-02-14 14:53:42 source > Set initial fetch size: 10 rows 2023-02-14 14:53:42 source > Max memory limit: 6249512960, JDBC buffer size: 1073741824 2023-02-14 14:53:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 17000 (6 MB) 2023-02-14 14:53:43 destination > Starting a new buffer for stream inquiry (current state: 2 MB in 5 buffers) 2023-02-14 14:53:43 destination > Got brand-new compressor [.snappy] 2023-02-14 14:53:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 18000 (6 MB) 2023-02-14 14:53:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 19000 (7 MB) 2023-02-14 14:53:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 20000 (8 MB) 2023-02-14 14:53:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 21000 (9 MB) 2023-02-14 14:53:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 22000 (9 MB) 2023-02-14 14:53:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 23000 (10 MB) 2023-02-14 14:53:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 24000 (11 MB) 2023-02-14 14:53:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 25000 (11 MB) 2023-02-14 14:53:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 26000 (12 MB) 2023-02-14 14:53:48 source > Reading stream inquiry. Records read: 10000 2023-02-14 14:53:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 27000 (13 MB) 2023-02-14 14:53:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 28000 (14 MB) 2023-02-14 14:53:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 29000 (14 MB) 2023-02-14 14:53:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 30000 (15 MB) 2023-02-14 14:53:49 source > Set initial fetch size: 10 rows 2023-02-14 14:53:49 source > Max memory limit: 6249512960, JDBC buffer size: 1073741824 2023-02-14 14:53:49 source > Set initial fetch size: 10 rows 2023-02-14 14:53:49 source > Max memory limit: 6249512960, JDBC buffer size: 1073741824 2023-02-14 14:53:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 31000 (15 MB) 2023-02-14 14:53:50 destination > Starting a new buffer for stream affiliation (current state: 7 MB in 6 buffers) 2023-02-14 14:53:50 destination > Got brand-new compressor [.snappy] 2023-02-14 14:53:50 source > Set initial fetch size: 10 rows 2023-02-14 14:53:50 source > Set initial fetch size: 10 rows 2023-02-14 14:53:50 source > Max memory limit: 6249512960, JDBC buffer size: 1073741824 2023-02-14 14:53:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 32000 (16 MB) 2023-02-14 14:53:50 destination > Starting a new buffer for stream referral_carer (current state: 7 MB in 7 buffers) 2023-02-14 14:53:50 destination > Got brand-new compressor [.snappy] 2023-02-14 14:53:50 destination > Starting a new buffer for stream information_source (current state: 7 MB in 8 buffers) 2023-02-14 14:53:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 33000 (16 MB) 2023-02-14 14:53:50 destination > Got brand-new compressor [.snappy] 2023-02-14 14:53:50 destination > Starting a new buffer for stream ad_tracking (current state: 7 MB in 9 buffers) 2023-02-14 14:53:50 destination > Got brand-new compressor [.snappy] 2023-02-14 14:53:50 destination > Flushing all 10 current buffers (7 MB in total) 2023-02-14 14:53:50 destination > Flushing buffer of stream inquiry (4 MB) 2023-02-14 14:53:50 destination > Flushing buffer for stream inquiry (4 MB) to storage 2023-02-14 14:53:50 destination > Finished writing data to 774b10ad-90a2-498c-a038-734ea05be17210185968676128176647.parquet (4 MB) 2023-02-14 14:53:51 destination > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/inquiry/2023_02_14_1676386407423_0.parquet with full ID xd9cp6.eBMKURDXhzCouXirhHR6ErXobSK48LUfxPLmfApSpYOUiYvm3ASK3h7JdcVqqE4GBtJWq05XmIJQBRh.UGD8pdK5ujtyduvjF7tF2yu37o9A05D.x0FP4bUHI 2023-02-14 14:53:51 destination > Called close() on [MultipartOutputStream for parts 1 - 10000] 2023-02-14 14:53:51 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/inquiry/2023_02_14_1676386407423_0.parquet with id xd9cp6.eB...x0FP4bUHI]: Uploading leftover stream [Part number 1 containing 2.54 MB] 2023-02-14 14:53:51 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/inquiry/2023_02_14_1676386407423_0.parquet with id xd9cp6.eB...x0FP4bUHI]: Finished uploading [Part number 1 containing 2.54 MB] 2023-02-14 14:53:51 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/inquiry/2023_02_14_1676386407423_0.parquet with id xd9cp6.eB...x0FP4bUHI]: Completed 2023-02-14 14:53:51 destination > Uploaded buffer file to storage: 774b10ad-90a2-498c-a038-734ea05be17210185968676128176647.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/inquiry/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet) 2023-02-14 14:53:51 destination > Flushing buffer of stream referral_carer (122 KB) 2023-02-14 14:53:51 destination > Flushing buffer for stream referral_carer (122 KB) to storage 2023-02-14 14:53:51 destination > Finished writing data to 2953a62a-0df1-43ba-8563-429c17ef25b816901098946626500574.parquet (122 KB) 2023-02-14 14:53:51 destination > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral_carer/2023_02_14_1676386407423_0.parquet with full ID oQKeMVfeToYdIe2gMtmuXLL3SdltbwhuNaX.f_xoS8h98t8gvFP1l7udiW1qlNDbk1Ski9PM4c4jrqfYJOT_S8MtJLbWViOlzHmy82JTuA.Q.xblFyPXoqld45vmFQGm 2023-02-14 14:53:51 destination > Called close() on [MultipartOutputStream for parts 1 - 10000] 2023-02-14 14:53:51 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral_carer/2023_02_14_1676386407423_0.parquet with id oQKeMVfeT...d45vmFQGm]: Uploading leftover stream [Part number 1 containing 0.09 MB] 2023-02-14 14:53:51 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral_carer/2023_02_14_1676386407423_0.parquet with id oQKeMVfeT...d45vmFQGm]: Finished uploading [Part number 1 containing 0.09 MB] 2023-02-14 14:53:51 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral_carer/2023_02_14_1676386407423_0.parquet with id oQKeMVfeT...d45vmFQGm]: Completed 2023-02-14 14:53:51 destination > Uploaded buffer file to storage: 2953a62a-0df1-43ba-8563-429c17ef25b816901098946626500574.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/referral_carer/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet) 2023-02-14 14:53:51 destination > Flushing buffer of stream ad_tracking (111 bytes) 2023-02-14 14:53:51 destination > Flushing buffer for stream ad_tracking (111 bytes) to storage 2023-02-14 14:53:51 destination > Finished writing data to 1d8bcd16-d267-4419-8431-9827c786db6815749118089994437332.parquet (111 bytes) 2023-02-14 14:53:51 destination > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_0.parquet with full ID xzKrP156GKcmg.239pEt7X94JV.XRNgRDOlVglqXlFFzpRo6tcX7yjyEUUtgHHSlG8rxfv371cdnUU3dPO92H7c5utvR175jgW88ofTanxyiwyu2xw4RLZ565kJ2ksiF 2023-02-14 14:53:51 destination > Called close() on [MultipartOutputStream for parts 1 - 10000] 2023-02-14 14:53:51 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_0.parquet with id xzKrP156G...65kJ2ksiF]: Uploading leftover stream [Part number 1 containing 0.00 MB] 2023-02-14 14:53:51 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_0.parquet with id xzKrP156G...65kJ2ksiF]: Finished uploading [Part number 1 containing 0.00 MB] 2023-02-14 14:53:51 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_0.parquet with id xzKrP156G...65kJ2ksiF]: Completed 2023-02-14 14:53:51 destination > Uploaded buffer file to storage: 1d8bcd16-d267-4419-8431-9827c786db6815749118089994437332.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet) 2023-02-14 14:53:51 destination > Flushing buffer of stream affiliation (58 KB) 2023-02-14 14:53:51 destination > Flushing buffer for stream affiliation (58 KB) to storage 2023-02-14 14:53:51 destination > Finished writing data to 173fedf4-35ee-42b3-9e02-8481275b803c4557154538545956888.parquet (58 KB) 2023-02-14 14:53:51 destination > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/affiliation/2023_02_14_1676386407423_0.parquet with full ID Uv_jLNrv70VBsierpQ_SPU6ratqiNowJgznML7FwZspV5YcZVmZo0so8QoQOnsB7wViv20RR.yD6TrgrlKMZ45u23cn.twaw6VZ8Qio4gqrB6DELroJWGkQtg7Pf9QkD 2023-02-14 14:53:51 destination > Called close() on [MultipartOutputStream for parts 1 - 10000] 2023-02-14 14:53:51 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/affiliation/2023_02_14_1676386407423_0.parquet with id Uv_jLNrv7...tg7Pf9QkD]: Uploading leftover stream [Part number 1 containing 0.04 MB] 2023-02-14 14:53:51 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/affiliation/2023_02_14_1676386407423_0.parquet with id Uv_jLNrv7...tg7Pf9QkD]: Finished uploading [Part number 1 containing 0.04 MB] 2023-02-14 14:53:52 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/affiliation/2023_02_14_1676386407423_0.parquet with id Uv_jLNrv7...tg7Pf9QkD]: Completed 2023-02-14 14:53:52 destination > Uploaded buffer file to storage: 173fedf4-35ee-42b3-9e02-8481275b803c4557154538545956888.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/affiliation/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet) 2023-02-14 14:53:52 destination > Flushing buffer of stream information_source (725 bytes) 2023-02-14 14:53:52 destination > Flushing buffer for stream information_source (725 bytes) to storage 2023-02-14 14:53:52 destination > Finished writing data to faf4f988-b35e-4dcd-a8e2-64716d80d9b016288611543441553628.parquet (725 bytes) 2023-02-14 14:53:52 destination > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/information_source/2023_02_14_1676386407423_0.parquet with full ID LIOddLkyv27MuJgSLRMAgau8rhknk1EjkYIyy8VnyGI2dQmH1NnFGC2TRVII.v4r06928CTEYwmAISHz2onDRPnOy6WL5uHlhhrh6S2A4Kb09sK2A64LWzSA.BRAS8eb 2023-02-14 14:53:52 destination > Called close() on [MultipartOutputStream for parts 1 - 10000] 2023-02-14 14:53:52 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/information_source/2023_02_14_1676386407423_0.parquet with id LIOddLkyv...A.BRAS8eb]: Uploading leftover stream [Part number 1 containing 0.00 MB] 2023-02-14 14:53:52 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/information_source/2023_02_14_1676386407423_0.parquet with id LIOddLkyv...A.BRAS8eb]: Finished uploading [Part number 1 containing 0.00 MB] 2023-02-14 14:53:52 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/information_source/2023_02_14_1676386407423_0.parquet with id LIOddLkyv...A.BRAS8eb]: Completed 2023-02-14 14:53:52 destination > Uploaded buffer file to storage: faf4f988-b35e-4dcd-a8e2-64716d80d9b016288611543441553628.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/information_source/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet) 2023-02-14 14:53:52 destination > Flushing buffer of stream patient (2 MB) 2023-02-14 14:53:52 destination > Flushing buffer for stream patient (2 MB) to storage 2023-02-14 14:53:52 destination > Finished writing data to 611a270b-b28e-4a62-9cd5-89e14cd7ca8b1759880930242739434.parquet (2 MB) 2023-02-14 14:53:52 destination > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/patient/2023_02_14_1676386407423_0.parquet with full ID ove8G9LlTAv_jKe_2_zQnhX6Hh1DtIZEz7h.VOAgxjqAArvkUyNSiApHLnvhARmoL6B3TJmzyRv9AlWD5G9VQRA17B.fLaM.hmDxACmmF.oQ2JSJg46lYZStqpbv3Fhs 2023-02-14 14:53:52 destination > Called close() on [MultipartOutputStream for parts 1 - 10000] 2023-02-14 14:53:52 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/patient/2023_02_14_1676386407423_0.parquet with id ove8G9LlT...tqpbv3Fhs]: Uploading leftover stream [Part number 1 containing 1.49 MB] 2023-02-14 14:53:52 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/patient/2023_02_14_1676386407423_0.parquet with id ove8G9LlT...tqpbv3Fhs]: Finished uploading [Part number 1 containing 1.49 MB] 2023-02-14 14:53:52 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/patient/2023_02_14_1676386407423_0.parquet with id ove8G9LlT...tqpbv3Fhs]: Completed 2023-02-14 14:53:52 destination > Uploaded buffer file to storage: 611a270b-b28e-4a62-9cd5-89e14cd7ca8b1759880930242739434.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/patient/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet) 2023-02-14 14:53:52 destination > Flushing buffer of stream referral (296 KB) 2023-02-14 14:53:52 destination > Flushing buffer for stream referral (296 KB) to storage 2023-02-14 14:53:52 destination > Finished writing data to 5f9f4966-3699-4f13-a161-a2fce19bfcb818148906066841842607.parquet (296 KB) 2023-02-14 14:53:52 destination > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral/2023_02_14_1676386407423_0.parquet with full ID ZJPY9DESVb35pZnqxvobF2Wkt.UGp65hPZ2tu98vmgvbEAsf99WKQkINRlKzyO39rUTUC2ZqhLobkKoX276gzoRP.BXQ5d8.1ffgHkq4x8BFlsBuqk5hajvGLGuFNrQ3 2023-02-14 14:53:52 destination > Called close() on [MultipartOutputStream for parts 1 - 10000] 2023-02-14 14:53:52 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral/2023_02_14_1676386407423_0.parquet with id ZJPY9DESV...GLGuFNrQ3]: Uploading leftover stream [Part number 1 containing 0.19 MB] 2023-02-14 14:53:52 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral/2023_02_14_1676386407423_0.parquet with id ZJPY9DESV...GLGuFNrQ3]: Finished uploading [Part number 1 containing 0.19 MB] 2023-02-14 14:53:52 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral/2023_02_14_1676386407423_0.parquet with id ZJPY9DESV...GLGuFNrQ3]: Completed 2023-02-14 14:53:52 destination > Uploaded buffer file to storage: 5f9f4966-3699-4f13-a161-a2fce19bfcb818148906066841842607.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/referral/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet) 2023-02-14 14:53:52 destination > Flushing buffer of stream relation_subcategory (336 bytes) 2023-02-14 14:53:52 destination > Flushing buffer for stream relation_subcategory (336 bytes) to storage 2023-02-14 14:53:52 destination > Finished writing data to 60d7dfe7-9d7b-4071-9931-20f596ee18f69492348688288955367.parquet (336 bytes) 2023-02-14 14:53:52 destination > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/relation_subcategory/2023_02_14_1676386407423_0.parquet with full ID c8zAyr2LqQBGDGAXYMZb0Sy0VQ0TR.AnUxq9ey0tNoJk0OQvsZSG.mbwosLi.AxjmyWEAnnXmteMBVMS9YX6MENu2uXqIlXAfG5HWDVwi1C03y09sNGYBpYPVqcFbdqw 2023-02-14 14:53:52 destination > Called close() on [MultipartOutputStream for parts 1 - 10000] 2023-02-14 14:53:52 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/relation_subcategory/2023_02_14_1676386407423_0.parquet with id c8zAyr2Lq...PVqcFbdqw]: Uploading leftover stream [Part number 1 containing 0.00 MB] 2023-02-14 14:53:52 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/relation_subcategory/2023_02_14_1676386407423_0.parquet with id c8zAyr2Lq...PVqcFbdqw]: Finished uploading [Part number 1 containing 0.00 MB] 2023-02-14 14:53:52 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/relation_subcategory/2023_02_14_1676386407423_0.parquet with id c8zAyr2Lq...PVqcFbdqw]: Completed 2023-02-14 14:53:52 destination > Uploaded buffer file to storage: 60d7dfe7-9d7b-4071-9931-20f596ee18f69492348688288955367.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/relation_subcategory/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet) 2023-02-14 14:53:52 destination > Flushing buffer of stream relation_to_patient (5 KB) 2023-02-14 14:53:52 destination > Flushing buffer for stream relation_to_patient (5 KB) to storage 2023-02-14 14:53:52 destination > Finished writing data to d19031da-6ecf-4dd0-88ea-4323c87224725650270854799836070.parquet (5 KB) 2023-02-14 14:53:52 destination > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient/2023_02_14_1676386407423_0.parquet with full ID ArGVPDDLE6l4nFbT1qqNHw08hpEErghCas8W4vLWMSsFN3Ue5LiQqSSeIlr._XN7vh2MGcwMrJefH5e0sF9GFh7TJksno1fuYo18P4cDE8lPEg2QcdLb3UUkl7JfZyxN 2023-02-14 14:53:52 destination > Called close() on [MultipartOutputStream for parts 1 - 10000] 2023-02-14 14:53:52 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient/2023_02_14_1676386407423_0.parquet with id ArGVPDDLE...kl7JfZyxN]: Uploading leftover stream [Part number 1 containing 0.01 MB] 2023-02-14 14:53:53 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient/2023_02_14_1676386407423_0.parquet with id ArGVPDDLE...kl7JfZyxN]: Finished uploading [Part number 1 containing 0.01 MB] 2023-02-14 14:53:53 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient/2023_02_14_1676386407423_0.parquet with id ArGVPDDLE...kl7JfZyxN]: Completed 2023-02-14 14:53:53 destination > Uploaded buffer file to storage: d19031da-6ecf-4dd0-88ea-4323c87224725650270854799836070.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet) 2023-02-14 14:53:53 destination > Flushing buffer of stream referral_affiliation (158 KB) 2023-02-14 14:53:53 destination > Flushing buffer for stream referral_affiliation (158 KB) to storage 2023-02-14 14:53:53 destination > Finished writing data to 292226b4-c8dd-4ce0-aed2-a43474f1e89c17172175859213669798.parquet (158 KB) 2023-02-14 14:53:53 destination > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral_affiliation/2023_02_14_1676386407423_0.parquet with full ID mFiKtkc_3grAu1fbEfbkJo6JIt51XDqs.Vk3.NseauPB_WxE1hviaPWl6rbmvtHzdYr._jNCilo10JbX.qEzrF1XZzZBHLvUIJuslwfrY.3S2WTKZQJe01FwGvrgHtny 2023-02-14 14:53:53 destination > Called close() on [MultipartOutputStream for parts 1 - 10000] 2023-02-14 14:53:53 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral_affiliation/2023_02_14_1676386407423_0.parquet with id mFiKtkc_3...wGvrgHtny]: Uploading leftover stream [Part number 1 containing 0.10 MB] 2023-02-14 14:53:53 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral_affiliation/2023_02_14_1676386407423_0.parquet with id mFiKtkc_3...wGvrgHtny]: Finished uploading [Part number 1 containing 0.10 MB] 2023-02-14 14:53:53 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral_affiliation/2023_02_14_1676386407423_0.parquet with id mFiKtkc_3...wGvrgHtny]: Completed 2023-02-14 14:53:53 destination > Uploaded buffer file to storage: 292226b4-c8dd-4ce0-aed2-a43474f1e89c17172175859213669798.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/referral_affiliation/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet) 2023-02-14 14:53:53 destination > Closing buffer for stream inquiry 2023-02-14 14:53:53 destination > Closing buffer for stream referral_carer 2023-02-14 14:53:53 destination > Closing buffer for stream ad_tracking 2023-02-14 14:53:53 destination > Closing buffer for stream affiliation 2023-02-14 14:53:53 destination > Closing buffer for stream information_source 2023-02-14 14:53:53 destination > Closing buffer for stream patient 2023-02-14 14:53:53 destination > Closing buffer for stream referral 2023-02-14 14:53:53 destination > Closing buffer for stream relation_subcategory 2023-02-14 14:53:53 destination > Closing buffer for stream relation_to_patient 2023-02-14 14:53:53 destination > Closing buffer for stream referral_affiliation 2023-02-14 14:53:53 destination > Starting a new buffer for stream ad_tracking (current state: 0 bytes in 0 buffers) 2023-02-14 14:53:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 34000 (16 MB) 2023-02-14 14:53:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 35000 (16 MB) 2023-02-14 14:53:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 36000 (16 MB) 2023-02-14 14:53:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 37000 (17 MB) 2023-02-14 14:53:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):333 - Total records read: 37269 (17 MB) 2023-02-14 14:53:54 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):336 - Schema validation errors found for stream inquiryreferralservice_inquiry. Error messages: [$.referrer_last_name is of an incorrect type. Expected it to be string, $.tell_us_more is of an incorrect type. Expected it to be string, $.linked_patient is of an incorrect type. Expected it to be string, $.payor_external_id is of an incorrect type. Expected it to be string, $.referrer_first_name is of an incorrect type. Expected it to be string, $.referrer_affiliation_id is of an incorrect type. Expected it to be number] 2023-02-14 14:53:54 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):336 - Schema validation errors found for stream inquiryreferralservice_referral_carer. Error messages: [$.carer_phone is of an incorrect type. Expected it to be string] 2023-02-14 14:53:54 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):336 - Schema validation errors found for stream inquiryreferralservice_ad_tracking. Error messages: [$.utm_term is of an incorrect type. Expected it to be string, $.gcl_id is of an incorrect type. Expected it to be string, $.utm_adgroup is of an incorrect type. Expected it to be string, $.utm_id is of an incorrect type. Expected it to be string] 2023-02-14 14:53:54 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):336 - Schema validation errors found for stream inquiryreferralservice_referral. Error messages: [$.extension is of an incorrect type. Expected it to be string, $.linked_patient is of an incorrect type. Expected it to be string, $.preferred_contact is of an incorrect type. Expected it to be string] 2023-02-14 14:53:54 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):336 - Schema validation errors found for stream inquiryreferralservice_patient. Error messages: [$.patient_birth_date is of an incorrect type. Expected it to be string, $.patient_age is of an incorrect type. Expected it to be number] 2023-02-14 14:53:54 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):336 - Schema validation errors found for stream inquiryreferralservice_relation_to_patient. Error messages: [$.relation_subcategory_id is of an incorrect type. Expected it to be number] 2023-02-14 14:53:54 WARN i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):336 - Schema validation errors found for stream inquiryreferralservice_referral_affiliation. Error messages: [$.referral_affiliation_address_line2 is of an incorrect type. Expected it to be string] 2023-02-14 14:53:54 INFO i.a.w.g.DefaultReplicationWorker(replicate):222 - One of source or destination thread complete. Waiting on the other. 2023-02-14 14:53:54 destination > Airbyte message consumer: succeeded. 2023-02-14 14:53:54 destination > executing on success close procedure. 2023-02-14 14:53:54 destination > Flushing all 1 current buffers (741 KB in total) 2023-02-14 14:53:54 destination > Flushing buffer of stream ad_tracking (741 KB) 2023-02-14 14:53:54 destination > Flushing buffer for stream ad_tracking (741 KB) to storage 2023-02-14 14:53:54 destination > Finished writing data to 39f3af26-bbf1-41e5-b95a-42ac44d95a747295093493129026089.parquet (741 KB) 2023-02-14 14:53:54 destination > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_1.parquet with full ID lH1ofDGFLdAy5weCkC0fuU6ZgDppUjk6TSgnHujXrEzqzFulBUE4Tj1KjtM7twHjmwhP9wfX3nIpV1Y.LZWsW0WPm0pPYi1ypj_sWRyeH_56aI4Z3nC.Uc9R6B6.BLz1 2023-02-14 14:53:54 destination > Called close() on [MultipartOutputStream for parts 1 - 10000] 2023-02-14 14:53:54 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_1.parquet with id lH1ofDGFL...R6B6.BLz1]: Uploading leftover stream [Part number 1 containing 0.25 MB] 2023-02-14 14:53:54 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_1.parquet with id lH1ofDGFL...R6B6.BLz1]: Finished uploading [Part number 1 containing 0.25 MB] 2023-02-14 14:53:54 destination > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_1.parquet with id lH1ofDGFL...R6B6.BLz1]: Completed 2023-02-14 14:53:54 destination > Uploaded buffer file to storage: 39f3af26-bbf1-41e5-b95a-42ac44d95a747295093493129026089.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_1.parquet (filename: 2023_02_14_1676386407423_1.parquet) 2023-02-14 14:53:54 destination > Closing buffer for stream ad_tracking 2023-02-14 14:53:54 destination > Completed integration: io.airbyte.integrations.destination.s3.S3Destination 2023-02-14 14:53:54 destination > Completed destination: io.airbyte.integrations.destination.s3.S3Destination 2023-02-14 14:53:54 INFO i.a.w.g.DefaultReplicationWorker(replicate):224 - Source and destination threads complete. 2023-02-14 14:53:54 INFO i.a.w.g.DefaultReplicationWorker(prepStateForLaterSaving):477 - Source did not output any state messages 2023-02-14 14:53:54 WARN i.a.w.g.DefaultReplicationWorker(prepStateForLaterSaving):485 - State capture: No new state, falling back on input state: io.airbyte.config.State@5777a2b2[state={}] 2023-02-14 14:53:54 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):408 - sync summary: { "status" : "completed", "recordsSynced" : 37269, "bytesSynced" : 18108306, "startTime" : 1676386400316, "endTime" : 1676386434705, "totalStats" : { "recordsEmitted" : 37269, "bytesEmitted" : 18108306, "sourceStateMessagesEmitted" : 0, "destinationStateMessagesEmitted" : 0, "recordsCommitted" : 37269, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0, "replicationStartTime" : 1676386400316, "replicationEndTime" : 1676386434705, "sourceReadStartTime" : 1676386400510, "sourceReadEndTime" : 1676386434024, "destinationWriteStartTime" : 1676386400617, "destinationWriteEndTime" : 1676386434704 }, "streamStats" : [ { "streamName" : "inquiry", "streamNamespace" : "inquiryreferralservice", "stats" : { "recordsEmitted" : 13911, "bytesEmitted" : 10196713, "recordsCommitted" : 13911 } }, { "streamName" : "referral_carer", "streamNamespace" : "inquiryreferralservice", "stats" : { "recordsEmitted" : 841, "bytesEmitted" : 219441, "recordsCommitted" : 841 } }, { "streamName" : "affiliation", "streamNamespace" : "inquiryreferralservice", "stats" : { "recordsEmitted" : 383, "bytesEmitted" : 82249, "recordsCommitted" : 383 } }, { "streamName" : "ad_tracking", "streamNamespace" : "inquiryreferralservice", "stats" : { "recordsEmitted" : 5660, "bytesEmitted" : 1399433, "recordsCommitted" : 5660 } }, { "streamName" : "information_source", "streamNamespace" : "inquiryreferralservice", "stats" : { "recordsEmitted" : 7, "bytesEmitted" : 1071, "recordsCommitted" : 7 } }, { "streamName" : "referral", "streamNamespace" : "inquiryreferralservice", "stats" : { "recordsEmitted" : 841, "bytesEmitted" : 564709, "recordsCommitted" : 841 } }, { "streamName" : "patient", "streamNamespace" : "inquiryreferralservice", "stats" : { "recordsEmitted" : 14752, "bytesEmitted" : 5238141, "recordsCommitted" : 14752 } }, { "streamName" : "relation_subcategory", "streamNamespace" : "inquiryreferralservice", "stats" : { "recordsEmitted" : 3, "bytesEmitted" : 369, "recordsCommitted" : 3 } }, { "streamName" : "relation_to_patient", "streamNamespace" : "inquiryreferralservice", "stats" : { "recordsEmitted" : 44, "bytesEmitted" : 9981, "recordsCommitted" : 44 } }, { "streamName" : "referral_affiliation", "streamNamespace" : "inquiryreferralservice", "stats" : { "recordsEmitted" : 827, "bytesEmitted" : 396199, "recordsCommitted" : 827 } } ] } 2023-02-14 14:53:54 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):409 - failures: [ ] 2023-02-14 14:53:54 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-02-14 14:53:54 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-02-14 14:53:54 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END REPLICATION ----- 2023-02-14 14:53:54 INFO i.a.c.i.LineGobbler(voidCall):114 - 2023-02-14 14:53:54 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):198 - sync summary: io.airbyte.config.StandardSyncOutput@635ede2d[standardSyncSummary=io.airbyte.config.StandardSyncSummary@28a9d9f4[status=completed,recordsSynced=37269,bytesSynced=18108306,startTime=1676386400316,endTime=1676386434705,totalStats=io.airbyte.config.SyncStats@5c62d06b[recordsEmitted=37269,bytesEmitted=18108306,sourceStateMessagesEmitted=0,destinationStateMessagesEmitted=0,recordsCommitted=37269,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,replicationStartTime=1676386400316,replicationEndTime=1676386434705,sourceReadStartTime=1676386400510,sourceReadEndTime=1676386434024,destinationWriteStartTime=1676386400617,destinationWriteEndTime=1676386434704,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@1a15f7b8[streamName=inquiry,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@fafed61[recordsEmitted=13911,bytesEmitted=10196713,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=13911,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@69aff319[streamName=referral_carer,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@230497cf[recordsEmitted=841,bytesEmitted=219441,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=841,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@16190c20[streamName=affiliation,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@66ad3f67[recordsEmitted=383,bytesEmitted=82249,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=383,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@708c2f90[streamName=ad_tracking,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@773164a1[recordsEmitted=5660,bytesEmitted=1399433,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=5660,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@29170e6b[streamName=information_source,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@26ce4a29[recordsEmitted=7,bytesEmitted=1071,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=7,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@37af11cf[streamName=referral,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@4bc77ff7[recordsEmitted=841,bytesEmitted=564709,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=841,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@5ab254b2[streamName=patient,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@e79d2cf[recordsEmitted=14752,bytesEmitted=5238141,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=14752,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@41978ba6[streamName=relation_subcategory,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@315f7ca4[recordsEmitted=3,bytesEmitted=369,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=3,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@7900b9f9[streamName=relation_to_patient,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@39afe3bc[recordsEmitted=44,bytesEmitted=9981,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=44,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@44988594[streamName=referral_affiliation,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@e686bff[recordsEmitted=827,bytesEmitted=396199,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=827,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]]]],normalizationSummary=,webhookOperationSummary=,state=io.airbyte.config.State@5777a2b2[state={}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@725bd4ba[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@342f7b4e[stream=io.airbyte.protocol.models.AirbyteStream@341bec7a[name=relation_to_patient,jsonSchema={"type":"object","properties":{"is_active":{"type":"boolean"},"relation_to_patient_id":{"type":"number","airbyte_type":"integer"},"relation_subcategory_id":{"type":"number","airbyte_type":"integer"},"relation_to_patient_name":{"type":"string"},"relation_to_patient_type_id":{"type":"number","airbyte_type":"integer"},"relation_to_patient_external_id":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[relation_to_patient_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[relation_to_patient_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@79615e95[stream=io.airbyte.protocol.models.AirbyteStream@55b3bb07[name=referral,jsonSchema={"type":"object","properties":{"notes":{"type":"string"},"carer_id":{"type":"number","airbyte_type":"integer"},"extension":{"type":"string"},"patient_id":{"type":"number","airbyte_type":"integer"},"referral_id":{"type":"number","airbyte_type":"integer"},"tell_us_more":{"type":"string"},"linked_patient":{"type":"string"},"referrer_email":{"type":"string"},"referrer_phone":{"type":"string"},"equip_source_id":{"type":"number","airbyte_type":"integer"},"referrer_mobile":{"type":"string"},"task_external_id":{"type":"string"},"preferred_contact":{"type":"string"},"information_source":{"type":"string"},"referrer_last_name":{"type":"string"},"referrer_first_name":{"type":"string"},"referral_external_id":{"type":"string"},"referral_created_date":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"relation_with_patient":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[referral_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[referral_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@1a095ff4[stream=io.airbyte.protocol.models.AirbyteStream@711a08f3[name=patient,jsonSchema={"type":"object","properties":{"patient_id":{"type":"number","airbyte_type":"integer"},"patient_age":{"type":"number","airbyte_type":"integer"},"patient_email":{"type":"string"},"patient_phone":{"type":"string"},"patient_state":{"type":"string"},"patient_mobile":{"type":"string"},"patient_last_name":{"type":"string"},"patient_birth_date":{"type":"string","format":"date"},"patient_first_name":{"type":"string"},"patient_external_id":{"type":"string"},"contact_patient_directly":{"type":"string"},"patient_preferred_contact":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[patient_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[patient_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@27c75b3[stream=io.airbyte.protocol.models.AirbyteStream@4a5f9d78[name=relation_subcategory,jsonSchema={"type":"object","properties":{"subcategory_id":{"type":"number","airbyte_type":"integer"},"subcategory_name":{"type":"string"},"subcategory_external_id":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[subcategory_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[subcategory_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@1a799d38[stream=io.airbyte.protocol.models.AirbyteStream@3b054314[name=referral_affiliation,jsonSchema={"type":"object","properties":{"referral_id":{"type":"number","airbyte_type":"integer"},"referral_affiliation_id":{"type":"number","airbyte_type":"integer"},"referral_affiliation_city":{"type":"string"},"referral_affiliation_name":{"type":"string"},"referral_affiliation_state":{"type":"string"},"referral_affiliation_latitude":{"type":"number"},"referral_affiliation_zip_code":{"type":"string"},"referral_affiliation_longitude":{"type":"number"},"referral_affiliation_external_id":{"type":"string"},"referral_affiliation_address_line1":{"type":"string"},"referral_affiliation_address_line2":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[referral_affiliation_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[referral_affiliation_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5a35682a[stream=io.airbyte.protocol.models.AirbyteStream@6c378a49[name=inquiry,jsonSchema={"type":"object","properties":{"notes":{"type":"string"},"inquiry_id":{"type":"number","airbyte_type":"integer"},"patient_id":{"type":"number","airbyte_type":"integer"},"tell_us_more":{"type":"string"},"inquiry_about":{"type":"string"},"inquirer_email":{"type":"string"},"inquirer_phone":{"type":"string"},"linked_patient":{"type":"string"},"equip_source_id":{"type":"number","airbyte_type":"integer"},"inquirer_mobile":{"type":"string"},"task_external_id":{"type":"string"},"payor_external_id":{"type":"string"},"preferred_contact":{"type":"string"},"information_source":{"type":"string"},"inquirer_last_name":{"type":"string"},"referrer_last_name":{"type":"string"},"inquirer_first_name":{"type":"string"},"inquiry_external_id":{"type":"string"},"referrer_first_name":{"type":"string"},"inquiry_created_date":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"relation_with_patient":{"type":"string"},"referrer_affiliation_id":{"type":"number","airbyte_type":"integer"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[inquiry_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[inquiry_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@3af15aaa[stream=io.airbyte.protocol.models.AirbyteStream@2b7db303[name=affiliation,jsonSchema={"type":"object","properties":{"city":{"type":"string"},"name":{"type":"string"},"state":{"type":"string"},"latitude":{"type":"number"},"zip_code":{"type":"string"},"longitude":{"type":"number"},"address_line_1":{"type":"string"},"address_line_2":{"type":"string"},"affiliation_id":{"type":"number","airbyte_type":"integer"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[affiliation_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[affiliation_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5af8fa7e[stream=io.airbyte.protocol.models.AirbyteStream@acd46aa[name=referral_carer,jsonSchema={"type":"object","properties":{"carer_id":{"type":"number","airbyte_type":"integer"},"carer_email":{"type":"string"},"carer_phone":{"type":"string"},"carer_mobile":{"type":"string"},"carer_last_name":{"type":"string"},"carer_first_name":{"type":"string"},"carer_external_id":{"type":"string"},"relation_to_patient":{"type":"string"},"carer_preferred_contact":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[carer_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[carer_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@3ad97953[stream=io.airbyte.protocol.models.AirbyteStream@7cfa20a0[name=information_source,jsonSchema={"type":"object","properties":{"is_active":{"type":"boolean"},"information_source_id":{"type":"number","airbyte_type":"integer"},"information_source_name":{"type":"string"},"information_source_external_id":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[information_source_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[information_source_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@61cc0e4b[stream=io.airbyte.protocol.models.AirbyteStream@1d4ecce[name=ad_tracking,jsonSchema={"type":"object","properties":{"gcl_id":{"type":"string"},"utm_id":{"type":"string"},"utm_term":{"type":"string"},"utm_medium":{"type":"string"},"utm_source":{"type":"string"},"utm_adgroup":{"type":"string"},"utm_campaign":{"type":"string"},"ad_tracking_id":{"type":"number","airbyte_type":"integer"},"inquiry_referral":{"type":"string"},"inquiry_referral_id":{"type":"number","airbyte_type":"integer"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[ad_tracking_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[ad_tracking_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@70b60e46[stream=io.airbyte.protocol.models.AirbyteStream@5de4cfd0[name=relation_to_patient_type,jsonSchema={"type":"object","properties":{"relation_to_patient_type_id":{"type":"number","airbyte_type":"integer"},"relation_to_patient_type_name":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[relation_to_patient_type_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[relation_to_patient_type_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5c5b2c71[stream=io.airbyte.protocol.models.AirbyteStream@7acf09a8[name=equip_source,jsonSchema={"type":"object","properties":{"equip_source_id":{"type":"number","airbyte_type":"integer"},"equip_source_name":{"type":"string"},"equip_source_external_id":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[equip_source_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[equip_source_id]],additionalProperties={}]],additionalProperties={}],failures=[]] 2023-02-14 14:53:54 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):203 - Sync summary length: 18890 2023-02-14 14:53:54 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):283 - Stopping temporal heartbeating... 2023-02-14 14:53:54 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get state 2023-02-14 14:53:54 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):56 - Using default value for environment variable NEED_STATE_VALIDATION: 'true' 2023-02-14 14:53:54 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to create or update state 2023-02-14 14:53:54 WARN i.a.p.j.JobNotifier(notifyJob):113 - Failed to successfully notify success: io.airbyte.config.Notification@d974ffc[notificationType=slack,sendOnSuccess=false,sendOnFailure=true,slackConfiguration=io.airbyte.config.SlackNotificationConfiguration@56b122e9[webhook=https://hooks.slack.com/services/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],customerioConfiguration=,additionalProperties={}] 2023-02-14 14:53:54 INFO i.a.v.j.JsonSchemaValidator(test):130 - JSON schema validation failed. errors: $.format_type: does not have a value in the enumeration [Avro], $.compression_codec: should be valid to one and only one of schema, but more than one are valid: {"title":"No Compression","required":["codec"],"properties":{"codec":{"enum":["no compression"],"type":"string","default":"no compression"}}}{"title":"Deflate","required":["codec","compression_level"],"properties":{"codec":{"enum":["Deflate"],"type":"string","default":"Deflate"},"compression_level":{"type":"integer","title":"Deflate Level","default":0,"maximum":9,"minimum":0,"description":"0: no compression & fastest, 9: best compression & slowest."}}}{"title":"bzip2","required":["codec"],"properties":{"codec":{"enum":["bzip2"],"type":"string","default":"bzip2"}}}{"title":"xz","required":["codec","compression_level"],"properties":{"codec":{"enum":["xz"],"type":"string","default":"xz"},"compression_level":{"type":"integer","title":"Compression Level","default":6,"maximum":9,"minimum":0,"description":"See here for details."}}}{"title":"zstandard","required":["codec","compression_level"],"properties":{"codec":{"enum":["zstandard"],"type":"string","default":"zstandard"},"include_checksum":{"type":"boolean","title":"Include Checksum","default":false,"description":"If true, include a checksum with each data block."},"compression_level":{"type":"integer","title":"Compression Level","default":3,"maximum":22,"minimum":-5,"description":"Negative levels are 'fast' modes akin to lz4 or snappy, levels above 9 are generally for archival purposes, and levels above 18 use a lot of memory."}}}{"title":"snappy","required":["codec"],"properties":{"codec":{"enum":["snappy"],"type":"string","default":"snappy"}}}, $.compression_codec: string found, object expected 2023-02-14 14:53:54 INFO i.a.v.j.JsonSchemaValidator(test):130 - JSON schema validation failed. errors: $.flattening: is missing but it is required, $.format_type: does not have a value in the enumeration [CSV] 2023-02-14 14:53:54 INFO i.a.v.j.JsonSchemaValidator(test):130 - JSON schema validation failed. errors: $.format_type: does not have a value in the enumeration [JSONL] 2023-02-14 14:53:54 INFO i.a.c.t.StreamResetRecordsHelper(deleteStreamResetRecordsForJob):50 - deleteStreamResetRecordsForJob was called for job 7455 with config type sync. Returning, as config type is not resetConnection.