2023-02-14 14:53:20 [32mINFO[m i.a.v.j.JsonSchemaValidator(test):130 - JSON schema validation failed.
errors: $.format_type: does not have a value in the enumeration [Avro], $.compression_codec: should be valid to one and only one of schema, but more than one are valid: {"title":"No Compression","required":["codec"],"properties":{"codec":{"enum":["no compression"],"type":"string","default":"no compression"}}}{"title":"Deflate","required":["codec","compression_level"],"properties":{"codec":{"enum":["Deflate"],"type":"string","default":"Deflate"},"compression_level":{"type":"integer","title":"Deflate Level","default":0,"maximum":9,"minimum":0,"description":"0: no compression & fastest, 9: best compression & slowest."}}}{"title":"bzip2","required":["codec"],"properties":{"codec":{"enum":["bzip2"],"type":"string","default":"bzip2"}}}{"title":"xz","required":["codec","compression_level"],"properties":{"codec":{"enum":["xz"],"type":"string","default":"xz"},"compression_level":{"type":"integer","title":"Compression Level","default":6,"maximum":9,"minimum":0,"description":"See here for details."}}}{"title":"zstandard","required":["codec","compression_level"],"properties":{"codec":{"enum":["zstandard"],"type":"string","default":"zstandard"},"include_checksum":{"type":"boolean","title":"Include Checksum","default":false,"description":"If true, include a checksum with each data block."},"compression_level":{"type":"integer","title":"Compression Level","default":3,"maximum":22,"minimum":-5,"description":"Negative levels are 'fast' modes akin to lz4 or snappy, levels above 9 are generally for archival purposes, and levels above 18 use a lot of memory."}}}{"title":"snappy","required":["codec"],"properties":{"codec":{"enum":["snappy"],"type":"string","default":"snappy"}}}, $.compression_codec: string found, object expected
2023-02-14 14:53:20 [32mINFO[m i.a.v.j.JsonSchemaValidator(test):130 - JSON schema validation failed.
errors: $.flattening: is missing but it is required, $.format_type: does not have a value in the enumeration [CSV]
2023-02-14 14:53:20 [32mINFO[m i.a.v.j.JsonSchemaValidator(test):130 - JSON schema validation failed.
errors: $.format_type: does not have a value in the enumeration [JSONL]
2023-02-14 14:53:20 [32mINFO[m i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/7455/0/logs.log
2023-02-14 14:53:20 [32mINFO[m i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.40.23
2023-02-14 14:53:20 [32mINFO[m i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation
2023-02-14 14:53:20 [32mINFO[m i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):56 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false'
2023-02-14 14:53:20 [32mINFO[m i.a.c.EnvConfigs(getEnvOrDefault):1094 - Using default value for environment variable METRIC_CLIENT: ''
2023-02-14 14:53:20 [33mWARN[m i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to
2023-02-14 14:53:20 [32mINFO[m i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):56 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false'
2023-02-14 14:53:20 [32mINFO[m i.a.w.g.DefaultReplicationWorker(run):135 - start sync worker. job id: 7455 attempt id: 0
2023-02-14 14:53:20 [32mINFO[m i.a.c.i.LineGobbler(voidCall):114 -
2023-02-14 14:53:20 [32mINFO[m i.a.w.g.DefaultReplicationWorker(run):150 - configured sync modes: {inquiryreferralservice.referral=full_refresh - overwrite, inquiryreferralservice.relation_to_patient=full_refresh - overwrite, inquiryreferralservice.relation_subcategory=full_refresh - overwrite, inquiryreferralservice.ad_tracking=full_refresh - overwrite, inquiryreferralservice.relation_to_patient_type=full_refresh - overwrite, inquiryreferralservice.information_source=full_refresh - overwrite, inquiryreferralservice.equip_source=full_refresh - overwrite, inquiryreferralservice.inquiry=full_refresh - overwrite, inquiryreferralservice.referral_carer=full_refresh - overwrite, inquiryreferralservice.patient=full_refresh - overwrite, inquiryreferralservice.referral_affiliation=full_refresh - overwrite, inquiryreferralservice.affiliation=full_refresh - overwrite}
2023-02-14 14:53:20 [32mINFO[m i.a.c.i.LineGobbler(voidCall):114 - ----- START REPLICATION -----
2023-02-14 14:53:20 [32mINFO[m i.a.c.i.LineGobbler(voidCall):114 -
2023-02-14 14:53:20 [32mINFO[m i.a.w.i.DefaultAirbyteDestination(start):72 - Running destination...
2023-02-14 14:53:20 [32mINFO[m i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-s3:0.3.17 exists...
2023-02-14 14:53:20 [32mINFO[m i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-s3:0.3.17 was found locally.
2023-02-14 14:53:20 [32mINFO[m i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-s3-write-7455-0-pplco with resources io.airbyte.config.ResourceRequirements@79a55c14[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=]
2023-02-14 14:53:20 [32mINFO[m i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/7455/0 --log-driver none --name destination-s3-write-7455-0-pplco --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_CONNECTOR_IMAGE=airbyte/destination-s3:0.3.17 -e WORKER_JOB_ATTEMPT=0 -e AUTO_DETECT_SCHEMA=false -e AIRBYTE_VERSION=0.40.23 -e WORKER_JOB_ID=7455 airbyte/destination-s3:0.3.17 write --config destination_config.json --catalog destination_catalog.json
2023-02-14 14:53:20 [32mINFO[m i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):33 - Writing messages to protocol version 0.2.0
2023-02-14 14:53:20 [32mINFO[m i.a.w.i.VersionedAirbyteStreamFactory(create):97 - Reading messages from protocol version 0.2.0
2023-02-14 14:53:20 [32mINFO[m i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-postgres:1.0.28 exists...
2023-02-14 14:53:20 [32mINFO[m i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-postgres:1.0.28 was found locally.
2023-02-14 14:53:20 [32mINFO[m i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-postgres-read-7455-0-oujhw with resources io.airbyte.config.ResourceRequirements@de1b309[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=]
2023-02-14 14:53:20 [32mINFO[m i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/7455/0 --log-driver none --name source-postgres-read-7455-0-oujhw --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:1.0.28 -e WORKER_JOB_ATTEMPT=0 -e AUTO_DETECT_SCHEMA=false -e AIRBYTE_VERSION=0.40.23 -e WORKER_JOB_ID=7455 airbyte/source-postgres:1.0.28 read --config source_config.json --catalog source_catalog.json --state input_state.json
2023-02-14 14:53:20 [32mINFO[m i.a.w.i.VersionedAirbyteStreamFactory(create):97 - Reading messages from protocol version 0.2.0
2023-02-14 14:53:20 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromDstRunnable$4):243 - Destination output thread started.
2023-02-14 14:53:20 [32mINFO[m i.a.w.g.DefaultReplicationWorker(replicate):217 - Waiting for source and destination threads to complete.
2023-02-14 14:53:20 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):291 - Replication thread started.
2023-02-14 14:53:26 [44msource[0m > Running source under deployment mode: OSS
2023-02-14 14:53:26 [43mdestination[0m > Running destination under deployment mode: OSS
2023-02-14 14:53:26 [43mdestination[0m > Starting destination: io.airbyte.integrations.destination.s3.S3Destination
2023-02-14 14:53:26 [44msource[0m > Starting source: io.airbyte.integrations.base.ssh.SshWrappedSource
2023-02-14 14:53:26 [43mdestination[0m > integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2023-02-14 14:53:26 [43mdestination[0m > Running integration: io.airbyte.integrations.destination.s3.S3Destination
2023-02-14 14:53:26 [43mdestination[0m > Command: WRITE
2023-02-14 14:53:26 [43mdestination[0m > Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2023-02-14 14:53:26 [44msource[0m > integration args: {read=null, catalog=source_catalog.json, state=input_state.json, config=source_config.json}
2023-02-14 14:53:26 [44msource[0m > Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2023-02-14 14:53:26 [44msource[0m > Command: READ
2023-02-14 14:53:26 [44msource[0m > Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='input_state.json'}
2023-02-14 14:53:27 [44msource[0m > Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-02-14 14:53:27 [44msource[0m > Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-02-14 14:53:27 [43mdestination[0m > Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-02-14 14:53:27 [43mdestination[0m > Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-02-14 14:53:27 [43mdestination[0m > S3 format config: {"format_type":"Parquet","page_size_kb":1024,"block_size_mb":128,"compression_codec":"SNAPPY","dictionary_encoding":true,"max_padding_size_mb":8,"dictionary_page_size_kb":1024}
2023-02-14 14:53:27 [43mdestination[0m > Creating S3 client...
2023-02-14 14:53:27 [44msource[0m > Starting connection with method: NO_TUNNEL
2023-02-14 14:53:27 [44msource[0m > using CDC: false
2023-02-14 14:53:28 [44msource[0m > HikariPool-1 - Starting...
2023-02-14 14:53:28 [44msource[0m > HikariPool-1 - Start completed.
2023-02-14 14:53:28 [43mdestination[0m > S3 format config: S3ParquetFormatConfig{compressionCodec=SNAPPY, blockSize=134217728, maxPaddingSize=8388608, pageSize=1048576, dictionaryPageSize=1048576, dictionaryEncoding=true, }
2023-02-14 14:53:28 [43mdestination[0m > Write config: WriteConfig{streamName=relation_to_patient, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient/2023_02_14_1676386407423_, syncMode=overwrite}
2023-02-14 14:53:28 [43mdestination[0m > Write config: WriteConfig{streamName=referral, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/referral/2023_02_14_1676386407423_, syncMode=overwrite}
2023-02-14 14:53:28 [43mdestination[0m > Write config: WriteConfig{streamName=patient, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/patient/2023_02_14_1676386407423_, syncMode=overwrite}
2023-02-14 14:53:28 [43mdestination[0m > Write config: WriteConfig{streamName=relation_subcategory, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/relation_subcategory/2023_02_14_1676386407423_, syncMode=overwrite}
2023-02-14 14:53:28 [43mdestination[0m > Write config: WriteConfig{streamName=referral_affiliation, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/referral_affiliation/2023_02_14_1676386407423_, syncMode=overwrite}
2023-02-14 14:53:28 [43mdestination[0m > Write config: WriteConfig{streamName=inquiry, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/inquiry/2023_02_14_1676386407423_, syncMode=overwrite}
2023-02-14 14:53:28 [43mdestination[0m > Write config: WriteConfig{streamName=affiliation, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/affiliation/2023_02_14_1676386407423_, syncMode=overwrite}
2023-02-14 14:53:28 [43mdestination[0m > Write config: WriteConfig{streamName=referral_carer, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/referral_carer/2023_02_14_1676386407423_, syncMode=overwrite}
2023-02-14 14:53:28 [43mdestination[0m > Write config: WriteConfig{streamName=information_source, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/information_source/2023_02_14_1676386407423_, syncMode=overwrite}
2023-02-14 14:53:28 [43mdestination[0m > Write config: WriteConfig{streamName=ad_tracking, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_, syncMode=overwrite}
2023-02-14 14:53:28 [43mdestination[0m > Write config: WriteConfig{streamName=relation_to_patient_type, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient_type/2023_02_14_1676386407423_, syncMode=overwrite}
2023-02-14 14:53:28 [43mdestination[0m > Write config: WriteConfig{streamName=equip_source, namespace=inquiryreferralservice, outputBucketPath=lakehouse/staging/equip_v2, pathFormat=lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_, fullOutputPath=lakehouse/staging/equip_v2/inquiryreferralservice/equip_source/2023_02_14_1676386407423_, syncMode=overwrite}
2023-02-14 14:53:28 [43mdestination[0m > class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started.
2023-02-14 14:53:28 [43mdestination[0m > Preparing bucket in destination started for 12 streams
2023-02-14 14:53:28 [43mdestination[0m > Clearing storage area in destination started for namespace inquiryreferralservice stream relation_to_patient bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_
2023-02-14 14:53:29 [44msource[0m > using CDC: false
2023-02-14 14:53:29 [44msource[0m > Attempting to get metadata from the database to see if we can connect.
2023-02-14 14:53:29 [44msource[0m > HikariPool-1 - Shutdown initiated...
2023-02-14 14:53:29 [44msource[0m > HikariPool-1 - Shutdown completed.
2023-02-14 14:53:29 [44msource[0m > using CDC: false
2023-02-14 14:53:29 [44msource[0m > using CDC: false
2023-02-14 14:53:29 [44msource[0m > Stream state manager selected to manage state object with type LEGACY.
2023-02-14 14:53:29 [44msource[0m > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_equip_source, New Cursor Field: null. Resetting cursor value
2023-02-14 14:53:29 [44msource[0m > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_inquiry, New Cursor Field: null. Resetting cursor value
2023-02-14 14:53:29 [44msource[0m > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_referral_carer, New Cursor Field: null. Resetting cursor value
2023-02-14 14:53:29 [44msource[0m > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_affiliation, New Cursor Field: null. Resetting cursor value
2023-02-14 14:53:29 [44msource[0m > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_ad_tracking, New Cursor Field: null. Resetting cursor value
2023-02-14 14:53:29 [44msource[0m > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_information_source, New Cursor Field: null. Resetting cursor value
2023-02-14 14:53:29 [44msource[0m > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_referral, New Cursor Field: null. Resetting cursor value
2023-02-14 14:53:29 [44msource[0m > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_patient, New Cursor Field: null. Resetting cursor value
2023-02-14 14:53:29 [44msource[0m > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_relation_to_patient_type, New Cursor Field: null. Resetting cursor value
2023-02-14 14:53:29 [44msource[0m > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_relation_subcategory, New Cursor Field: null. Resetting cursor value
2023-02-14 14:53:29 [44msource[0m > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_relation_to_patient, New Cursor Field: null. Resetting cursor value
2023-02-14 14:53:29 [44msource[0m > No cursor field set in catalog but not present in state. Stream: inquiryreferralservice_referral_affiliation, New Cursor Field: null. Resetting cursor value
2023-02-14 14:53:29 [44msource[0m > HikariPool-2 - Starting...
2023-02-14 14:53:29 [44msource[0m > HikariPool-2 - Start completed.
2023-02-14 14:53:29 [44msource[0m > Checking schema: inquiryreferralservice
2023-02-14 14:53:29 [44msource[0m > Internal schemas to exclude: [catalog_history, information_schema, pg_catalog, pg_internal]
2023-02-14 14:53:29 [44msource[0m > Set initial fetch size: 10 rows
2023-02-14 14:53:29 [44msource[0m > Max memory limit: 6249512960, JDBC buffer size: 1073741824
2023-02-14 14:53:29 [44msource[0m > Table referral_carer_backup column carer_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table referral_carer_backup column carer_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_carer_backup column carer_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_carer_backup column carer_phone (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_carer_backup column carer_mobile (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_carer_backup column carer_email (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_carer_backup column carer_preferred_contact (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_carer_backup column carer_first_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_carer_backup column carer_last_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_carer_backup column relation_to_patient (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table flyway_schema_history column installed_rank (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table flyway_schema_history column version (type varchar[50], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table flyway_schema_history column description (type varchar[200], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table flyway_schema_history column type (type varchar[20], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table flyway_schema_history column script (type varchar[1000], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table flyway_schema_history column checksum (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table flyway_schema_history column installed_by (type varchar[100], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table flyway_schema_history column installed_on (type timestamp[29], nullable false) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_without_timezone})
2023-02-14 14:53:29 [44msource[0m > Table flyway_schema_history column execution_time (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table flyway_schema_history column success (type bool[1], nullable false) -> JsonSchemaType({type=boolean})
2023-02-14 14:53:29 [44msource[0m > Table relation_to_patient column relation_to_patient_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table relation_to_patient column relation_to_patient_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table relation_to_patient column is_active (type bool[1], nullable false) -> JsonSchemaType({type=boolean})
2023-02-14 14:53:29 [44msource[0m > Table relation_to_patient column relation_to_patient_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table relation_to_patient column relation_to_patient_type_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table relation_to_patient column relation_subcategory_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table referral column referral_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table referral column referral_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral column task_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral column referral_created_date (type timestamptz[32], nullable false) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2023-02-14 14:53:29 [44msource[0m > Table referral column referrer_first_name (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral column referrer_last_name (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral column referrer_phone (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral column referrer_mobile (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral column referrer_email (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral column relation_with_patient (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral column preferred_contact (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral column notes (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral column equip_source_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table referral column patient_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table referral column carer_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table referral column tell_us_more (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral column information_source (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral column extension (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral column linked_patient (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table patient column patient_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table patient column patient_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table patient column patient_first_name (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table patient column patient_last_name (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table patient column patient_state (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table patient column patient_birth_date (type date[13], nullable false) -> JsonSchemaType({type=string, format=date})
2023-02-14 14:53:29 [44msource[0m > Table patient column patient_age (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table patient column patient_phone (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table patient column patient_mobile (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table patient column patient_email (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table patient column patient_preferred_contact (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table patient column contact_patient_directly (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table relation_subcategory column subcategory_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table relation_subcategory column subcategory_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table relation_subcategory column subcategory_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_affiliation column referral_affiliation_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table referral_affiliation column referral_affiliation_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_affiliation column referral_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table referral_affiliation column referral_affiliation_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_affiliation column referral_affiliation_latitude (type numeric[0], nullable false) -> JsonSchemaType({type=number})
2023-02-14 14:53:29 [44msource[0m > Table referral_affiliation column referral_affiliation_longitude (type numeric[0], nullable false) -> JsonSchemaType({type=number})
2023-02-14 14:53:29 [44msource[0m > Table referral_affiliation column referral_affiliation_address_line1 (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_affiliation column referral_affiliation_address_line2 (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_affiliation column referral_affiliation_city (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_affiliation column referral_affiliation_state (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_affiliation column referral_affiliation_zip_code (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column inquiry_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column inquiry_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column task_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column inquiry_created_date (type timestamptz[32], nullable false) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column inquirer_first_name (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column inquirer_last_name (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column inquirer_phone (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column inquirer_mobile (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column inquirer_email (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column inquiry_about (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column relation_with_patient (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column preferred_contact (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column notes (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column equip_source_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column patient_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column tell_us_more (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column information_source (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column payor_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column referrer_first_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column referrer_last_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column referrer_affiliation_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table inquiry column linked_patient (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table affiliation column affiliation_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table affiliation column name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table affiliation column latitude (type float4[8], nullable false) -> JsonSchemaType({type=number})
2023-02-14 14:53:29 [44msource[0m > Table affiliation column longitude (type float4[8], nullable false) -> JsonSchemaType({type=number})
2023-02-14 14:53:29 [44msource[0m > Table affiliation column address_line_1 (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table affiliation column address_line_2 (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table affiliation column city (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table affiliation column state (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table affiliation column zip_code (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_carer column carer_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table referral_carer column carer_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_carer column carer_phone (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_carer column carer_mobile (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_carer column carer_email (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_carer column carer_preferred_contact (type varchar[255], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_carer column carer_first_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_carer column carer_last_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table referral_carer column relation_to_patient (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table information_source column information_source_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table information_source column information_source_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table information_source column information_source_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table information_source column is_active (type bool[1], nullable false) -> JsonSchemaType({type=boolean})
2023-02-14 14:53:29 [44msource[0m > Table ad_tracking column ad_tracking_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table ad_tracking column inquiry_referral (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table ad_tracking column utm_source (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table ad_tracking column utm_medium (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table ad_tracking column utm_campaign (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table ad_tracking column utm_adgroup (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table ad_tracking column utm_term (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table ad_tracking column inquiry_referral_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table ad_tracking column utm_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table ad_tracking column gcl_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table relation_to_patient_type column relation_to_patient_type_id (type serial[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table relation_to_patient_type column relation_to_patient_type_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table equip_source column equip_source_id (type int4[10], nullable false) -> JsonSchemaType({type=number, airbyte_type=integer})
2023-02-14 14:53:29 [44msource[0m > Table equip_source column equip_source_external_id (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Table equip_source column equip_source_name (type varchar[2147483647], nullable false) -> JsonSchemaType({type=string})
2023-02-14 14:53:29 [44msource[0m > Found table: inquiryreferralservice.referral_carer_backup
2023-02-14 14:53:29 [44msource[0m > Found table: inquiryreferralservice.flyway_schema_history
2023-02-14 14:53:29 [44msource[0m > Found table: inquiryreferralservice.relation_to_patient
2023-02-14 14:53:29 [44msource[0m > Found table: inquiryreferralservice.referral
2023-02-14 14:53:29 [44msource[0m > Found table: inquiryreferralservice.patient
2023-02-14 14:53:29 [44msource[0m > Found table: inquiryreferralservice.relation_subcategory
2023-02-14 14:53:29 [44msource[0m > Found table: inquiryreferralservice.referral_affiliation
2023-02-14 14:53:29 [44msource[0m > Found table: inquiryreferralservice.inquiry
2023-02-14 14:53:29 [44msource[0m > Found table: inquiryreferralservice.affiliation
2023-02-14 14:53:29 [44msource[0m > Found table: inquiryreferralservice.referral_carer
2023-02-14 14:53:29 [44msource[0m > Found table: inquiryreferralservice.information_source
2023-02-14 14:53:29 [44msource[0m > Found table: inquiryreferralservice.ad_tracking
2023-02-14 14:53:29 [44msource[0m > Found table: inquiryreferralservice.relation_to_patient_type
2023-02-14 14:53:29 [44msource[0m > Found table: inquiryreferralservice.equip_source
2023-02-14 14:53:29 [44msource[0m > using CDC: false
2023-02-14 14:53:29 [44msource[0m > using CDC: false
2023-02-14 14:53:29 [44msource[0m > Queueing query for table: relation_to_patient
2023-02-14 14:53:29 [44msource[0m > Queueing query for table: referral
2023-02-14 14:53:29 [44msource[0m > Queueing query for table: patient
2023-02-14 14:53:29 [44msource[0m > Queueing query for table: relation_subcategory
2023-02-14 14:53:29 [44msource[0m > Queueing query for table: referral_affiliation
2023-02-14 14:53:29 [44msource[0m > Queueing query for table: inquiry
2023-02-14 14:53:29 [44msource[0m > Queueing query for table: affiliation
2023-02-14 14:53:29 [44msource[0m > Queueing query for table: referral_carer
2023-02-14 14:53:29 [44msource[0m > Queueing query for table: information_source
2023-02-14 14:53:29 [44msource[0m > Queueing query for table: ad_tracking
2023-02-14 14:53:29 [44msource[0m > Queueing query for table: relation_to_patient_type
2023-02-14 14:53:29 [44msource[0m > Queueing query for table: equip_source
2023-02-14 14:53:29 [44msource[0m > Set initial fetch size: 10 rows
2023-02-14 14:53:29 [44msource[0m > Max memory limit: 6249512960, JDBC buffer size: 1073741824
2023-02-14 14:53:29 [44msource[0m > Set initial fetch size: 10 rows
2023-02-14 14:53:29 [43mdestination[0m > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient/2023_02_14_1676379681925_0.parquet
2023-02-14 14:53:29 [44msource[0m > Max memory limit: 6249512960, JDBC buffer size: 1073741824
2023-02-14 14:53:30 [43mdestination[0m > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (1 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)...
2023-02-14 14:53:30 [43mdestination[0m > Clearing storage area in destination completed for namespace inquiryreferralservice stream relation_to_patient bucketObject lakehouse/staging/equip_v2
2023-02-14 14:53:30 [43mdestination[0m > Clearing storage area in destination started for namespace inquiryreferralservice stream referral bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_
2023-02-14 14:53:30 [43mdestination[0m > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/referral/2023_02_14_1676379681925_0.parquet
2023-02-14 14:53:30 [43mdestination[0m > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (1 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/referral/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)...
2023-02-14 14:53:30 [43mdestination[0m > Clearing storage area in destination completed for namespace inquiryreferralservice stream referral bucketObject lakehouse/staging/equip_v2
2023-02-14 14:53:30 [43mdestination[0m > Clearing storage area in destination started for namespace inquiryreferralservice stream patient bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_
2023-02-14 14:53:30 [43mdestination[0m > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/patient/2023_02_14_1676379681925_0.parquet
2023-02-14 14:53:30 [43mdestination[0m > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (1 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/patient/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)...
2023-02-14 14:53:30 [43mdestination[0m > Clearing storage area in destination completed for namespace inquiryreferralservice stream patient bucketObject lakehouse/staging/equip_v2
2023-02-14 14:53:30 [43mdestination[0m > Clearing storage area in destination started for namespace inquiryreferralservice stream relation_subcategory bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_
2023-02-14 14:53:31 [43mdestination[0m > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/relation_subcategory/2023_02_14_1676379681925_0.parquet
2023-02-14 14:53:31 [43mdestination[0m > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (1 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/relation_subcategory/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)...
2023-02-14 14:53:31 [43mdestination[0m > Clearing storage area in destination completed for namespace inquiryreferralservice stream relation_subcategory bucketObject lakehouse/staging/equip_v2
2023-02-14 14:53:31 [43mdestination[0m > Clearing storage area in destination started for namespace inquiryreferralservice stream referral_affiliation bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_
2023-02-14 14:53:32 [43mdestination[0m > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/referral_affiliation/2023_02_14_1676379681925_0.parquet
2023-02-14 14:53:32 [43mdestination[0m > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (1 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/referral_affiliation/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)...
2023-02-14 14:53:32 [43mdestination[0m > Clearing storage area in destination completed for namespace inquiryreferralservice stream referral_affiliation bucketObject lakehouse/staging/equip_v2
2023-02-14 14:53:32 [43mdestination[0m > Clearing storage area in destination started for namespace inquiryreferralservice stream inquiry bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_
2023-02-14 14:53:32 [43mdestination[0m > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/inquiry/2023_02_14_1676379681925_0.parquet
2023-02-14 14:53:32 [43mdestination[0m > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (1 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/inquiry/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)...
2023-02-14 14:53:32 [43mdestination[0m > Clearing storage area in destination completed for namespace inquiryreferralservice stream inquiry bucketObject lakehouse/staging/equip_v2
2023-02-14 14:53:32 [43mdestination[0m > Clearing storage area in destination started for namespace inquiryreferralservice stream affiliation bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_
2023-02-14 14:53:33 [43mdestination[0m > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/affiliation/2023_02_14_1676379681925_0.parquet
2023-02-14 14:53:33 [43mdestination[0m > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (1 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/affiliation/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)...
2023-02-14 14:53:33 [43mdestination[0m > Clearing storage area in destination completed for namespace inquiryreferralservice stream affiliation bucketObject lakehouse/staging/equip_v2
2023-02-14 14:53:33 [43mdestination[0m > Clearing storage area in destination started for namespace inquiryreferralservice stream referral_carer bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_
2023-02-14 14:53:33 [43mdestination[0m > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/referral_carer/2023_02_14_1676379681925_0.parquet
2023-02-14 14:53:33 [43mdestination[0m > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (1 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/referral_carer/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)...
2023-02-14 14:53:33 [43mdestination[0m > Clearing storage area in destination completed for namespace inquiryreferralservice stream referral_carer bucketObject lakehouse/staging/equip_v2
2023-02-14 14:53:33 [43mdestination[0m > Clearing storage area in destination started for namespace inquiryreferralservice stream information_source bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_
2023-02-14 14:53:33 [43mdestination[0m > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/information_source/2023_02_14_1676379681925_0.parquet
2023-02-14 14:53:33 [43mdestination[0m > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (1 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/information_source/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)...
2023-02-14 14:53:33 [43mdestination[0m > Clearing storage area in destination completed for namespace inquiryreferralservice stream information_source bucketObject lakehouse/staging/equip_v2
2023-02-14 14:53:33 [43mdestination[0m > Clearing storage area in destination started for namespace inquiryreferralservice stream ad_tracking bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_
2023-02-14 14:53:33 [43mdestination[0m > Deleting objects lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676379681925_0.parquet, lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676379681925_1.parquet
2023-02-14 14:53:33 [43mdestination[0m > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (2 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)...
2023-02-14 14:53:33 [43mdestination[0m > Clearing storage area in destination completed for namespace inquiryreferralservice stream ad_tracking bucketObject lakehouse/staging/equip_v2
2023-02-14 14:53:33 [43mdestination[0m > Clearing storage area in destination started for namespace inquiryreferralservice stream relation_to_patient_type bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_
2023-02-14 14:53:34 [43mdestination[0m > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (0 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient_type/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)...
2023-02-14 14:53:34 [43mdestination[0m > Clearing storage area in destination completed for namespace inquiryreferralservice stream relation_to_patient_type bucketObject lakehouse/staging/equip_v2
2023-02-14 14:53:34 [43mdestination[0m > Clearing storage area in destination started for namespace inquiryreferralservice stream equip_source bucketObject lakehouse/staging/equip_v2 pathFormat lakehouse/staging/equip_v2/${NAMESPACE}/${STREAM_NAME}/${YEAR}_${MONTH}_${DAY}_${EPOCH}_
2023-02-14 14:53:34 [43mdestination[0m > Storage bucket lakehouse/staging/equip_v2 has been cleaned-up (0 objects matching lakehouse/staging/equip_v2/inquiryreferralservice/equip_source/[0-9]{4}_[0-9]{2}_[0-9]{2}_[0-9]+_.* were deleted)...
2023-02-14 14:53:34 [43mdestination[0m > Clearing storage area in destination completed for namespace inquiryreferralservice stream equip_source bucketObject lakehouse/staging/equip_v2
2023-02-14 14:53:34 [43mdestination[0m > Preparing storage area in destination completed.
2023-02-14 14:53:34 [43mdestination[0m > Starting a new buffer for stream relation_to_patient (current state: 0 bytes in 0 buffers)
2023-02-14 14:53:34 [43mdestination[0m > Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
2023-02-14 14:53:35 [43mdestination[0m > Got brand-new compressor [.snappy]
2023-02-14 14:53:35 [43mdestination[0m > Starting a new buffer for stream referral (current state: 5 KB in 1 buffers)
2023-02-14 14:53:35 [43mdestination[0m > Got brand-new compressor [.snappy]
2023-02-14 14:53:36 [44msource[0m > Set initial fetch size: 10 rows
2023-02-14 14:53:36 [44msource[0m > Max memory limit: 6249512960, JDBC buffer size: 1073741824
2023-02-14 14:53:36 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 1000 (600 KB)
2023-02-14 14:53:37 [43mdestination[0m > Starting a new buffer for stream patient (current state: 301 KB in 2 buffers)
2023-02-14 14:53:37 [43mdestination[0m > Got brand-new compressor [.snappy]
2023-02-14 14:53:37 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 2000 (943 KB)
2023-02-14 14:53:37 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 3000 (1 MB)
2023-02-14 14:53:38 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 4000 (1 MB)
2023-02-14 14:53:38 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 5000 (1 MB)
2023-02-14 14:53:39 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 6000 (2 MB)
2023-02-14 14:53:39 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 7000 (2 MB)
2023-02-14 14:53:39 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 8000 (2 MB)
2023-02-14 14:53:40 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 9000 (3 MB)
2023-02-14 14:53:40 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 10000 (3 MB)
2023-02-14 14:53:40 [44msource[0m > Reading stream patient. Records read: 10000
2023-02-14 14:53:40 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 11000 (3 MB)
2023-02-14 14:53:41 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 12000 (4 MB)
2023-02-14 14:53:41 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 13000 (4 MB)
2023-02-14 14:53:41 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 14000 (4 MB)
2023-02-14 14:53:42 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 15000 (5 MB)
2023-02-14 14:53:42 [44msource[0m > Set initial fetch size: 10 rows
2023-02-14 14:53:42 [44msource[0m > Set initial fetch size: 10 rows
2023-02-14 14:53:42 [44msource[0m > Max memory limit: 6249512960, JDBC buffer size: 1073741824
2023-02-14 14:53:42 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 16000 (5 MB)
2023-02-14 14:53:42 [43mdestination[0m > Starting a new buffer for stream relation_subcategory (current state: 2 MB in 3 buffers)
2023-02-14 14:53:42 [43mdestination[0m > Got brand-new compressor [.snappy]
2023-02-14 14:53:42 [43mdestination[0m > Starting a new buffer for stream referral_affiliation (current state: 2 MB in 4 buffers)
2023-02-14 14:53:42 [43mdestination[0m > Got brand-new compressor [.snappy]
2023-02-14 14:53:42 [44msource[0m > Set initial fetch size: 10 rows
2023-02-14 14:53:42 [44msource[0m > Max memory limit: 6249512960, JDBC buffer size: 1073741824
2023-02-14 14:53:43 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 17000 (6 MB)
2023-02-14 14:53:43 [43mdestination[0m > Starting a new buffer for stream inquiry (current state: 2 MB in 5 buffers)
2023-02-14 14:53:43 [43mdestination[0m > Got brand-new compressor [.snappy]
2023-02-14 14:53:43 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 18000 (6 MB)
2023-02-14 14:53:44 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 19000 (7 MB)
2023-02-14 14:53:45 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 20000 (8 MB)
2023-02-14 14:53:45 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 21000 (9 MB)
2023-02-14 14:53:46 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 22000 (9 MB)
2023-02-14 14:53:46 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 23000 (10 MB)
2023-02-14 14:53:47 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 24000 (11 MB)
2023-02-14 14:53:47 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 25000 (11 MB)
2023-02-14 14:53:47 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 26000 (12 MB)
2023-02-14 14:53:48 [44msource[0m > Reading stream inquiry. Records read: 10000
2023-02-14 14:53:48 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 27000 (13 MB)
2023-02-14 14:53:48 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 28000 (14 MB)
2023-02-14 14:53:49 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 29000 (14 MB)
2023-02-14 14:53:49 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 30000 (15 MB)
2023-02-14 14:53:49 [44msource[0m > Set initial fetch size: 10 rows
2023-02-14 14:53:49 [44msource[0m > Max memory limit: 6249512960, JDBC buffer size: 1073741824
2023-02-14 14:53:49 [44msource[0m > Set initial fetch size: 10 rows
2023-02-14 14:53:49 [44msource[0m > Max memory limit: 6249512960, JDBC buffer size: 1073741824
2023-02-14 14:53:49 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 31000 (15 MB)
2023-02-14 14:53:50 [43mdestination[0m > Starting a new buffer for stream affiliation (current state: 7 MB in 6 buffers)
2023-02-14 14:53:50 [43mdestination[0m > Got brand-new compressor [.snappy]
2023-02-14 14:53:50 [44msource[0m > Set initial fetch size: 10 rows
2023-02-14 14:53:50 [44msource[0m > Set initial fetch size: 10 rows
2023-02-14 14:53:50 [44msource[0m > Max memory limit: 6249512960, JDBC buffer size: 1073741824
2023-02-14 14:53:50 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 32000 (16 MB)
2023-02-14 14:53:50 [43mdestination[0m > Starting a new buffer for stream referral_carer (current state: 7 MB in 7 buffers)
2023-02-14 14:53:50 [43mdestination[0m > Got brand-new compressor [.snappy]
2023-02-14 14:53:50 [43mdestination[0m > Starting a new buffer for stream information_source (current state: 7 MB in 8 buffers)
2023-02-14 14:53:50 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 33000 (16 MB)
2023-02-14 14:53:50 [43mdestination[0m > Got brand-new compressor [.snappy]
2023-02-14 14:53:50 [43mdestination[0m > Starting a new buffer for stream ad_tracking (current state: 7 MB in 9 buffers)
2023-02-14 14:53:50 [43mdestination[0m > Got brand-new compressor [.snappy]
2023-02-14 14:53:50 [43mdestination[0m > Flushing all 10 current buffers (7 MB in total)
2023-02-14 14:53:50 [43mdestination[0m > Flushing buffer of stream inquiry (4 MB)
2023-02-14 14:53:50 [43mdestination[0m > Flushing buffer for stream inquiry (4 MB) to storage
2023-02-14 14:53:50 [43mdestination[0m > Finished writing data to 774b10ad-90a2-498c-a038-734ea05be17210185968676128176647.parquet (4 MB)
2023-02-14 14:53:51 [43mdestination[0m > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/inquiry/2023_02_14_1676386407423_0.parquet with full ID xd9cp6.eBMKURDXhzCouXirhHR6ErXobSK48LUfxPLmfApSpYOUiYvm3ASK3h7JdcVqqE4GBtJWq05XmIJQBRh.UGD8pdK5ujtyduvjF7tF2yu37o9A05D.x0FP4bUHI
2023-02-14 14:53:51 [43mdestination[0m > Called close() on [MultipartOutputStream for parts 1 - 10000]
2023-02-14 14:53:51 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/inquiry/2023_02_14_1676386407423_0.parquet with id xd9cp6.eB...x0FP4bUHI]: Uploading leftover stream [Part number 1 containing 2.54 MB]
2023-02-14 14:53:51 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/inquiry/2023_02_14_1676386407423_0.parquet with id xd9cp6.eB...x0FP4bUHI]: Finished uploading [Part number 1 containing 2.54 MB]
2023-02-14 14:53:51 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/inquiry/2023_02_14_1676386407423_0.parquet with id xd9cp6.eB...x0FP4bUHI]: Completed
2023-02-14 14:53:51 [43mdestination[0m > Uploaded buffer file to storage: 774b10ad-90a2-498c-a038-734ea05be17210185968676128176647.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/inquiry/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet)
2023-02-14 14:53:51 [43mdestination[0m > Flushing buffer of stream referral_carer (122 KB)
2023-02-14 14:53:51 [43mdestination[0m > Flushing buffer for stream referral_carer (122 KB) to storage
2023-02-14 14:53:51 [43mdestination[0m > Finished writing data to 2953a62a-0df1-43ba-8563-429c17ef25b816901098946626500574.parquet (122 KB)
2023-02-14 14:53:51 [43mdestination[0m > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral_carer/2023_02_14_1676386407423_0.parquet with full ID oQKeMVfeToYdIe2gMtmuXLL3SdltbwhuNaX.f_xoS8h98t8gvFP1l7udiW1qlNDbk1Ski9PM4c4jrqfYJOT_S8MtJLbWViOlzHmy82JTuA.Q.xblFyPXoqld45vmFQGm
2023-02-14 14:53:51 [43mdestination[0m > Called close() on [MultipartOutputStream for parts 1 - 10000]
2023-02-14 14:53:51 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral_carer/2023_02_14_1676386407423_0.parquet with id oQKeMVfeT...d45vmFQGm]: Uploading leftover stream [Part number 1 containing 0.09 MB]
2023-02-14 14:53:51 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral_carer/2023_02_14_1676386407423_0.parquet with id oQKeMVfeT...d45vmFQGm]: Finished uploading [Part number 1 containing 0.09 MB]
2023-02-14 14:53:51 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral_carer/2023_02_14_1676386407423_0.parquet with id oQKeMVfeT...d45vmFQGm]: Completed
2023-02-14 14:53:51 [43mdestination[0m > Uploaded buffer file to storage: 2953a62a-0df1-43ba-8563-429c17ef25b816901098946626500574.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/referral_carer/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet)
2023-02-14 14:53:51 [43mdestination[0m > Flushing buffer of stream ad_tracking (111 bytes)
2023-02-14 14:53:51 [43mdestination[0m > Flushing buffer for stream ad_tracking (111 bytes) to storage
2023-02-14 14:53:51 [43mdestination[0m > Finished writing data to 1d8bcd16-d267-4419-8431-9827c786db6815749118089994437332.parquet (111 bytes)
2023-02-14 14:53:51 [43mdestination[0m > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_0.parquet with full ID xzKrP156GKcmg.239pEt7X94JV.XRNgRDOlVglqXlFFzpRo6tcX7yjyEUUtgHHSlG8rxfv371cdnUU3dPO92H7c5utvR175jgW88ofTanxyiwyu2xw4RLZ565kJ2ksiF
2023-02-14 14:53:51 [43mdestination[0m > Called close() on [MultipartOutputStream for parts 1 - 10000]
2023-02-14 14:53:51 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_0.parquet with id xzKrP156G...65kJ2ksiF]: Uploading leftover stream [Part number 1 containing 0.00 MB]
2023-02-14 14:53:51 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_0.parquet with id xzKrP156G...65kJ2ksiF]: Finished uploading [Part number 1 containing 0.00 MB]
2023-02-14 14:53:51 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_0.parquet with id xzKrP156G...65kJ2ksiF]: Completed
2023-02-14 14:53:51 [43mdestination[0m > Uploaded buffer file to storage: 1d8bcd16-d267-4419-8431-9827c786db6815749118089994437332.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet)
2023-02-14 14:53:51 [43mdestination[0m > Flushing buffer of stream affiliation (58 KB)
2023-02-14 14:53:51 [43mdestination[0m > Flushing buffer for stream affiliation (58 KB) to storage
2023-02-14 14:53:51 [43mdestination[0m > Finished writing data to 173fedf4-35ee-42b3-9e02-8481275b803c4557154538545956888.parquet (58 KB)
2023-02-14 14:53:51 [43mdestination[0m > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/affiliation/2023_02_14_1676386407423_0.parquet with full ID Uv_jLNrv70VBsierpQ_SPU6ratqiNowJgznML7FwZspV5YcZVmZo0so8QoQOnsB7wViv20RR.yD6TrgrlKMZ45u23cn.twaw6VZ8Qio4gqrB6DELroJWGkQtg7Pf9QkD
2023-02-14 14:53:51 [43mdestination[0m > Called close() on [MultipartOutputStream for parts 1 - 10000]
2023-02-14 14:53:51 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/affiliation/2023_02_14_1676386407423_0.parquet with id Uv_jLNrv7...tg7Pf9QkD]: Uploading leftover stream [Part number 1 containing 0.04 MB]
2023-02-14 14:53:51 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/affiliation/2023_02_14_1676386407423_0.parquet with id Uv_jLNrv7...tg7Pf9QkD]: Finished uploading [Part number 1 containing 0.04 MB]
2023-02-14 14:53:52 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/affiliation/2023_02_14_1676386407423_0.parquet with id Uv_jLNrv7...tg7Pf9QkD]: Completed
2023-02-14 14:53:52 [43mdestination[0m > Uploaded buffer file to storage: 173fedf4-35ee-42b3-9e02-8481275b803c4557154538545956888.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/affiliation/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet)
2023-02-14 14:53:52 [43mdestination[0m > Flushing buffer of stream information_source (725 bytes)
2023-02-14 14:53:52 [43mdestination[0m > Flushing buffer for stream information_source (725 bytes) to storage
2023-02-14 14:53:52 [43mdestination[0m > Finished writing data to faf4f988-b35e-4dcd-a8e2-64716d80d9b016288611543441553628.parquet (725 bytes)
2023-02-14 14:53:52 [43mdestination[0m > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/information_source/2023_02_14_1676386407423_0.parquet with full ID LIOddLkyv27MuJgSLRMAgau8rhknk1EjkYIyy8VnyGI2dQmH1NnFGC2TRVII.v4r06928CTEYwmAISHz2onDRPnOy6WL5uHlhhrh6S2A4Kb09sK2A64LWzSA.BRAS8eb
2023-02-14 14:53:52 [43mdestination[0m > Called close() on [MultipartOutputStream for parts 1 - 10000]
2023-02-14 14:53:52 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/information_source/2023_02_14_1676386407423_0.parquet with id LIOddLkyv...A.BRAS8eb]: Uploading leftover stream [Part number 1 containing 0.00 MB]
2023-02-14 14:53:52 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/information_source/2023_02_14_1676386407423_0.parquet with id LIOddLkyv...A.BRAS8eb]: Finished uploading [Part number 1 containing 0.00 MB]
2023-02-14 14:53:52 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/information_source/2023_02_14_1676386407423_0.parquet with id LIOddLkyv...A.BRAS8eb]: Completed
2023-02-14 14:53:52 [43mdestination[0m > Uploaded buffer file to storage: faf4f988-b35e-4dcd-a8e2-64716d80d9b016288611543441553628.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/information_source/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet)
2023-02-14 14:53:52 [43mdestination[0m > Flushing buffer of stream patient (2 MB)
2023-02-14 14:53:52 [43mdestination[0m > Flushing buffer for stream patient (2 MB) to storage
2023-02-14 14:53:52 [43mdestination[0m > Finished writing data to 611a270b-b28e-4a62-9cd5-89e14cd7ca8b1759880930242739434.parquet (2 MB)
2023-02-14 14:53:52 [43mdestination[0m > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/patient/2023_02_14_1676386407423_0.parquet with full ID ove8G9LlTAv_jKe_2_zQnhX6Hh1DtIZEz7h.VOAgxjqAArvkUyNSiApHLnvhARmoL6B3TJmzyRv9AlWD5G9VQRA17B.fLaM.hmDxACmmF.oQ2JSJg46lYZStqpbv3Fhs
2023-02-14 14:53:52 [43mdestination[0m > Called close() on [MultipartOutputStream for parts 1 - 10000]
2023-02-14 14:53:52 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/patient/2023_02_14_1676386407423_0.parquet with id ove8G9LlT...tqpbv3Fhs]: Uploading leftover stream [Part number 1 containing 1.49 MB]
2023-02-14 14:53:52 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/patient/2023_02_14_1676386407423_0.parquet with id ove8G9LlT...tqpbv3Fhs]: Finished uploading [Part number 1 containing 1.49 MB]
2023-02-14 14:53:52 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/patient/2023_02_14_1676386407423_0.parquet with id ove8G9LlT...tqpbv3Fhs]: Completed
2023-02-14 14:53:52 [43mdestination[0m > Uploaded buffer file to storage: 611a270b-b28e-4a62-9cd5-89e14cd7ca8b1759880930242739434.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/patient/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet)
2023-02-14 14:53:52 [43mdestination[0m > Flushing buffer of stream referral (296 KB)
2023-02-14 14:53:52 [43mdestination[0m > Flushing buffer for stream referral (296 KB) to storage
2023-02-14 14:53:52 [43mdestination[0m > Finished writing data to 5f9f4966-3699-4f13-a161-a2fce19bfcb818148906066841842607.parquet (296 KB)
2023-02-14 14:53:52 [43mdestination[0m > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral/2023_02_14_1676386407423_0.parquet with full ID ZJPY9DESVb35pZnqxvobF2Wkt.UGp65hPZ2tu98vmgvbEAsf99WKQkINRlKzyO39rUTUC2ZqhLobkKoX276gzoRP.BXQ5d8.1ffgHkq4x8BFlsBuqk5hajvGLGuFNrQ3
2023-02-14 14:53:52 [43mdestination[0m > Called close() on [MultipartOutputStream for parts 1 - 10000]
2023-02-14 14:53:52 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral/2023_02_14_1676386407423_0.parquet with id ZJPY9DESV...GLGuFNrQ3]: Uploading leftover stream [Part number 1 containing 0.19 MB]
2023-02-14 14:53:52 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral/2023_02_14_1676386407423_0.parquet with id ZJPY9DESV...GLGuFNrQ3]: Finished uploading [Part number 1 containing 0.19 MB]
2023-02-14 14:53:52 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral/2023_02_14_1676386407423_0.parquet with id ZJPY9DESV...GLGuFNrQ3]: Completed
2023-02-14 14:53:52 [43mdestination[0m > Uploaded buffer file to storage: 5f9f4966-3699-4f13-a161-a2fce19bfcb818148906066841842607.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/referral/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet)
2023-02-14 14:53:52 [43mdestination[0m > Flushing buffer of stream relation_subcategory (336 bytes)
2023-02-14 14:53:52 [43mdestination[0m > Flushing buffer for stream relation_subcategory (336 bytes) to storage
2023-02-14 14:53:52 [43mdestination[0m > Finished writing data to 60d7dfe7-9d7b-4071-9931-20f596ee18f69492348688288955367.parquet (336 bytes)
2023-02-14 14:53:52 [43mdestination[0m > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/relation_subcategory/2023_02_14_1676386407423_0.parquet with full ID c8zAyr2LqQBGDGAXYMZb0Sy0VQ0TR.AnUxq9ey0tNoJk0OQvsZSG.mbwosLi.AxjmyWEAnnXmteMBVMS9YX6MENu2uXqIlXAfG5HWDVwi1C03y09sNGYBpYPVqcFbdqw
2023-02-14 14:53:52 [43mdestination[0m > Called close() on [MultipartOutputStream for parts 1 - 10000]
2023-02-14 14:53:52 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/relation_subcategory/2023_02_14_1676386407423_0.parquet with id c8zAyr2Lq...PVqcFbdqw]: Uploading leftover stream [Part number 1 containing 0.00 MB]
2023-02-14 14:53:52 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/relation_subcategory/2023_02_14_1676386407423_0.parquet with id c8zAyr2Lq...PVqcFbdqw]: Finished uploading [Part number 1 containing 0.00 MB]
2023-02-14 14:53:52 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/relation_subcategory/2023_02_14_1676386407423_0.parquet with id c8zAyr2Lq...PVqcFbdqw]: Completed
2023-02-14 14:53:52 [43mdestination[0m > Uploaded buffer file to storage: 60d7dfe7-9d7b-4071-9931-20f596ee18f69492348688288955367.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/relation_subcategory/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet)
2023-02-14 14:53:52 [43mdestination[0m > Flushing buffer of stream relation_to_patient (5 KB)
2023-02-14 14:53:52 [43mdestination[0m > Flushing buffer for stream relation_to_patient (5 KB) to storage
2023-02-14 14:53:52 [43mdestination[0m > Finished writing data to d19031da-6ecf-4dd0-88ea-4323c87224725650270854799836070.parquet (5 KB)
2023-02-14 14:53:52 [43mdestination[0m > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient/2023_02_14_1676386407423_0.parquet with full ID ArGVPDDLE6l4nFbT1qqNHw08hpEErghCas8W4vLWMSsFN3Ue5LiQqSSeIlr._XN7vh2MGcwMrJefH5e0sF9GFh7TJksno1fuYo18P4cDE8lPEg2QcdLb3UUkl7JfZyxN
2023-02-14 14:53:52 [43mdestination[0m > Called close() on [MultipartOutputStream for parts 1 - 10000]
2023-02-14 14:53:52 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient/2023_02_14_1676386407423_0.parquet with id ArGVPDDLE...kl7JfZyxN]: Uploading leftover stream [Part number 1 containing 0.01 MB]
2023-02-14 14:53:53 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient/2023_02_14_1676386407423_0.parquet with id ArGVPDDLE...kl7JfZyxN]: Finished uploading [Part number 1 containing 0.01 MB]
2023-02-14 14:53:53 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient/2023_02_14_1676386407423_0.parquet with id ArGVPDDLE...kl7JfZyxN]: Completed
2023-02-14 14:53:53 [43mdestination[0m > Uploaded buffer file to storage: d19031da-6ecf-4dd0-88ea-4323c87224725650270854799836070.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/relation_to_patient/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet)
2023-02-14 14:53:53 [43mdestination[0m > Flushing buffer of stream referral_affiliation (158 KB)
2023-02-14 14:53:53 [43mdestination[0m > Flushing buffer for stream referral_affiliation (158 KB) to storage
2023-02-14 14:53:53 [43mdestination[0m > Finished writing data to 292226b4-c8dd-4ce0-aed2-a43474f1e89c17172175859213669798.parquet (158 KB)
2023-02-14 14:53:53 [43mdestination[0m > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral_affiliation/2023_02_14_1676386407423_0.parquet with full ID mFiKtkc_3grAu1fbEfbkJo6JIt51XDqs.Vk3.NseauPB_WxE1hviaPWl6rbmvtHzdYr._jNCilo10JbX.qEzrF1XZzZBHLvUIJuslwfrY.3S2WTKZQJe01FwGvrgHtny
2023-02-14 14:53:53 [43mdestination[0m > Called close() on [MultipartOutputStream for parts 1 - 10000]
2023-02-14 14:53:53 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral_affiliation/2023_02_14_1676386407423_0.parquet with id mFiKtkc_3...wGvrgHtny]: Uploading leftover stream [Part number 1 containing 0.10 MB]
2023-02-14 14:53:53 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral_affiliation/2023_02_14_1676386407423_0.parquet with id mFiKtkc_3...wGvrgHtny]: Finished uploading [Part number 1 containing 0.10 MB]
2023-02-14 14:53:53 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/referral_affiliation/2023_02_14_1676386407423_0.parquet with id mFiKtkc_3...wGvrgHtny]: Completed
2023-02-14 14:53:53 [43mdestination[0m > Uploaded buffer file to storage: 292226b4-c8dd-4ce0-aed2-a43474f1e89c17172175859213669798.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/referral_affiliation/2023_02_14_1676386407423_0.parquet (filename: 2023_02_14_1676386407423_0.parquet)
2023-02-14 14:53:53 [43mdestination[0m > Closing buffer for stream inquiry
2023-02-14 14:53:53 [43mdestination[0m > Closing buffer for stream referral_carer
2023-02-14 14:53:53 [43mdestination[0m > Closing buffer for stream ad_tracking
2023-02-14 14:53:53 [43mdestination[0m > Closing buffer for stream affiliation
2023-02-14 14:53:53 [43mdestination[0m > Closing buffer for stream information_source
2023-02-14 14:53:53 [43mdestination[0m > Closing buffer for stream patient
2023-02-14 14:53:53 [43mdestination[0m > Closing buffer for stream referral
2023-02-14 14:53:53 [43mdestination[0m > Closing buffer for stream relation_subcategory
2023-02-14 14:53:53 [43mdestination[0m > Closing buffer for stream relation_to_patient
2023-02-14 14:53:53 [43mdestination[0m > Closing buffer for stream referral_affiliation
2023-02-14 14:53:53 [43mdestination[0m > Starting a new buffer for stream ad_tracking (current state: 0 bytes in 0 buffers)
2023-02-14 14:53:53 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 34000 (16 MB)
2023-02-14 14:53:53 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 35000 (16 MB)
2023-02-14 14:53:53 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 36000 (16 MB)
2023-02-14 14:53:53 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):321 - Records read: 37000 (17 MB)
2023-02-14 14:53:54 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$6):333 - Total records read: 37269 (17 MB)
2023-02-14 14:53:54 [33mWARN[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):336 - Schema validation errors found for stream inquiryreferralservice_inquiry. Error messages: [$.referrer_last_name is of an incorrect type. Expected it to be string, $.tell_us_more is of an incorrect type. Expected it to be string, $.linked_patient is of an incorrect type. Expected it to be string, $.payor_external_id is of an incorrect type. Expected it to be string, $.referrer_first_name is of an incorrect type. Expected it to be string, $.referrer_affiliation_id is of an incorrect type. Expected it to be number]
2023-02-14 14:53:54 [33mWARN[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):336 - Schema validation errors found for stream inquiryreferralservice_referral_carer. Error messages: [$.carer_phone is of an incorrect type. Expected it to be string]
2023-02-14 14:53:54 [33mWARN[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):336 - Schema validation errors found for stream inquiryreferralservice_ad_tracking. Error messages: [$.utm_term is of an incorrect type. Expected it to be string, $.gcl_id is of an incorrect type. Expected it to be string, $.utm_adgroup is of an incorrect type. Expected it to be string, $.utm_id is of an incorrect type. Expected it to be string]
2023-02-14 14:53:54 [33mWARN[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):336 - Schema validation errors found for stream inquiryreferralservice_referral. Error messages: [$.extension is of an incorrect type. Expected it to be string, $.linked_patient is of an incorrect type. Expected it to be string, $.preferred_contact is of an incorrect type. Expected it to be string]
2023-02-14 14:53:54 [33mWARN[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):336 - Schema validation errors found for stream inquiryreferralservice_patient. Error messages: [$.patient_birth_date is of an incorrect type. Expected it to be string, $.patient_age is of an incorrect type. Expected it to be number]
2023-02-14 14:53:54 [33mWARN[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):336 - Schema validation errors found for stream inquiryreferralservice_relation_to_patient. Error messages: [$.relation_subcategory_id is of an incorrect type. Expected it to be number]
2023-02-14 14:53:54 [33mWARN[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):336 - Schema validation errors found for stream inquiryreferralservice_referral_affiliation. Error messages: [$.referral_affiliation_address_line2 is of an incorrect type. Expected it to be string]
2023-02-14 14:53:54 [32mINFO[m i.a.w.g.DefaultReplicationWorker(replicate):222 - One of source or destination thread complete. Waiting on the other.
2023-02-14 14:53:54 [43mdestination[0m > Airbyte message consumer: succeeded.
2023-02-14 14:53:54 [43mdestination[0m > executing on success close procedure.
2023-02-14 14:53:54 [43mdestination[0m > Flushing all 1 current buffers (741 KB in total)
2023-02-14 14:53:54 [43mdestination[0m > Flushing buffer of stream ad_tracking (741 KB)
2023-02-14 14:53:54 [43mdestination[0m > Flushing buffer for stream ad_tracking (741 KB) to storage
2023-02-14 14:53:54 [43mdestination[0m > Finished writing data to 39f3af26-bbf1-41e5-b95a-42ac44d95a747295093493129026089.parquet (741 KB)
2023-02-14 14:53:54 [43mdestination[0m > Initiated multipart upload to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_1.parquet with full ID lH1ofDGFLdAy5weCkC0fuU6ZgDppUjk6TSgnHujXrEzqzFulBUE4Tj1KjtM7twHjmwhP9wfX3nIpV1Y.LZWsW0WPm0pPYi1ypj_sWRyeH_56aI4Z3nC.Uc9R6B6.BLz1
2023-02-14 14:53:54 [43mdestination[0m > Called close() on [MultipartOutputStream for parts 1 - 10000]
2023-02-14 14:53:54 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_1.parquet with id lH1ofDGFL...R6B6.BLz1]: Uploading leftover stream [Part number 1 containing 0.25 MB]
2023-02-14 14:53:54 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_1.parquet with id lH1ofDGFL...R6B6.BLz1]: Finished uploading [Part number 1 containing 0.25 MB]
2023-02-14 14:53:54 [43mdestination[0m > [Manager uploading to equip-data/lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_1.parquet with id lH1ofDGFL...R6B6.BLz1]: Completed
2023-02-14 14:53:54 [43mdestination[0m > Uploaded buffer file to storage: 39f3af26-bbf1-41e5-b95a-42ac44d95a747295093493129026089.parquet -> lakehouse/staging/equip_v2/inquiryreferralservice/ad_tracking/2023_02_14_1676386407423_1.parquet (filename: 2023_02_14_1676386407423_1.parquet)
2023-02-14 14:53:54 [43mdestination[0m > Closing buffer for stream ad_tracking
2023-02-14 14:53:54 [43mdestination[0m > Completed integration: io.airbyte.integrations.destination.s3.S3Destination
2023-02-14 14:53:54 [43mdestination[0m > Completed destination: io.airbyte.integrations.destination.s3.S3Destination
2023-02-14 14:53:54 [32mINFO[m i.a.w.g.DefaultReplicationWorker(replicate):224 - Source and destination threads complete.
2023-02-14 14:53:54 [32mINFO[m i.a.w.g.DefaultReplicationWorker(prepStateForLaterSaving):477 - Source did not output any state messages
2023-02-14 14:53:54 [33mWARN[m i.a.w.g.DefaultReplicationWorker(prepStateForLaterSaving):485 - State capture: No new state, falling back on input state: io.airbyte.config.State@5777a2b2[state={}]
2023-02-14 14:53:54 [32mINFO[m i.a.w.g.DefaultReplicationWorker(getReplicationOutput):408 - sync summary: {
"status" : "completed",
"recordsSynced" : 37269,
"bytesSynced" : 18108306,
"startTime" : 1676386400316,
"endTime" : 1676386434705,
"totalStats" : {
"recordsEmitted" : 37269,
"bytesEmitted" : 18108306,
"sourceStateMessagesEmitted" : 0,
"destinationStateMessagesEmitted" : 0,
"recordsCommitted" : 37269,
"meanSecondsBeforeSourceStateMessageEmitted" : 0,
"maxSecondsBeforeSourceStateMessageEmitted" : 0,
"maxSecondsBetweenStateMessageEmittedandCommitted" : 0,
"meanSecondsBetweenStateMessageEmittedandCommitted" : 0,
"replicationStartTime" : 1676386400316,
"replicationEndTime" : 1676386434705,
"sourceReadStartTime" : 1676386400510,
"sourceReadEndTime" : 1676386434024,
"destinationWriteStartTime" : 1676386400617,
"destinationWriteEndTime" : 1676386434704
},
"streamStats" : [ {
"streamName" : "inquiry",
"streamNamespace" : "inquiryreferralservice",
"stats" : {
"recordsEmitted" : 13911,
"bytesEmitted" : 10196713,
"recordsCommitted" : 13911
}
}, {
"streamName" : "referral_carer",
"streamNamespace" : "inquiryreferralservice",
"stats" : {
"recordsEmitted" : 841,
"bytesEmitted" : 219441,
"recordsCommitted" : 841
}
}, {
"streamName" : "affiliation",
"streamNamespace" : "inquiryreferralservice",
"stats" : {
"recordsEmitted" : 383,
"bytesEmitted" : 82249,
"recordsCommitted" : 383
}
}, {
"streamName" : "ad_tracking",
"streamNamespace" : "inquiryreferralservice",
"stats" : {
"recordsEmitted" : 5660,
"bytesEmitted" : 1399433,
"recordsCommitted" : 5660
}
}, {
"streamName" : "information_source",
"streamNamespace" : "inquiryreferralservice",
"stats" : {
"recordsEmitted" : 7,
"bytesEmitted" : 1071,
"recordsCommitted" : 7
}
}, {
"streamName" : "referral",
"streamNamespace" : "inquiryreferralservice",
"stats" : {
"recordsEmitted" : 841,
"bytesEmitted" : 564709,
"recordsCommitted" : 841
}
}, {
"streamName" : "patient",
"streamNamespace" : "inquiryreferralservice",
"stats" : {
"recordsEmitted" : 14752,
"bytesEmitted" : 5238141,
"recordsCommitted" : 14752
}
}, {
"streamName" : "relation_subcategory",
"streamNamespace" : "inquiryreferralservice",
"stats" : {
"recordsEmitted" : 3,
"bytesEmitted" : 369,
"recordsCommitted" : 3
}
}, {
"streamName" : "relation_to_patient",
"streamNamespace" : "inquiryreferralservice",
"stats" : {
"recordsEmitted" : 44,
"bytesEmitted" : 9981,
"recordsCommitted" : 44
}
}, {
"streamName" : "referral_affiliation",
"streamNamespace" : "inquiryreferralservice",
"stats" : {
"recordsEmitted" : 827,
"bytesEmitted" : 396199,
"recordsCommitted" : 827
}
} ]
}
2023-02-14 14:53:54 [32mINFO[m i.a.w.g.DefaultReplicationWorker(getReplicationOutput):409 - failures: [ ]
2023-02-14 14:53:54 [32mINFO[m i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2023-02-14 14:53:54 [32mINFO[m i.a.c.i.LineGobbler(voidCall):114 -
2023-02-14 14:53:54 [32mINFO[m i.a.c.i.LineGobbler(voidCall):114 - ----- END REPLICATION -----
2023-02-14 14:53:54 [32mINFO[m i.a.c.i.LineGobbler(voidCall):114 -
2023-02-14 14:53:54 [32mINFO[m i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):198 - sync summary: io.airbyte.config.StandardSyncOutput@635ede2d[standardSyncSummary=io.airbyte.config.StandardSyncSummary@28a9d9f4[status=completed,recordsSynced=37269,bytesSynced=18108306,startTime=1676386400316,endTime=1676386434705,totalStats=io.airbyte.config.SyncStats@5c62d06b[recordsEmitted=37269,bytesEmitted=18108306,sourceStateMessagesEmitted=0,destinationStateMessagesEmitted=0,recordsCommitted=37269,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,replicationStartTime=1676386400316,replicationEndTime=1676386434705,sourceReadStartTime=1676386400510,sourceReadEndTime=1676386434024,destinationWriteStartTime=1676386400617,destinationWriteEndTime=1676386434704,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@1a15f7b8[streamName=inquiry,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@fafed61[recordsEmitted=13911,bytesEmitted=10196713,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=13911,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@69aff319[streamName=referral_carer,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@230497cf[recordsEmitted=841,bytesEmitted=219441,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=841,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@16190c20[streamName=affiliation,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@66ad3f67[recordsEmitted=383,bytesEmitted=82249,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=383,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@708c2f90[streamName=ad_tracking,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@773164a1[recordsEmitted=5660,bytesEmitted=1399433,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=5660,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@29170e6b[streamName=information_source,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@26ce4a29[recordsEmitted=7,bytesEmitted=1071,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=7,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@37af11cf[streamName=referral,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@4bc77ff7[recordsEmitted=841,bytesEmitted=564709,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=841,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@5ab254b2[streamName=patient,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@e79d2cf[recordsEmitted=14752,bytesEmitted=5238141,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=14752,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@41978ba6[streamName=relation_subcategory,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@315f7ca4[recordsEmitted=3,bytesEmitted=369,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=3,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@7900b9f9[streamName=relation_to_patient,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@39afe3bc[recordsEmitted=44,bytesEmitted=9981,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=44,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@44988594[streamName=referral_affiliation,streamNamespace=inquiryreferralservice,stats=io.airbyte.config.SyncStats@e686bff[recordsEmitted=827,bytesEmitted=396199,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=827,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,replicationStartTime=,replicationEndTime=,sourceReadStartTime=,sourceReadEndTime=,destinationWriteStartTime=,destinationWriteEndTime=,additionalProperties={}]]]],normalizationSummary=,webhookOperationSummary=,state=io.airbyte.config.State@5777a2b2[state={}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@725bd4ba[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@342f7b4e[stream=io.airbyte.protocol.models.AirbyteStream@341bec7a[name=relation_to_patient,jsonSchema={"type":"object","properties":{"is_active":{"type":"boolean"},"relation_to_patient_id":{"type":"number","airbyte_type":"integer"},"relation_subcategory_id":{"type":"number","airbyte_type":"integer"},"relation_to_patient_name":{"type":"string"},"relation_to_patient_type_id":{"type":"number","airbyte_type":"integer"},"relation_to_patient_external_id":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[relation_to_patient_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[relation_to_patient_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@79615e95[stream=io.airbyte.protocol.models.AirbyteStream@55b3bb07[name=referral,jsonSchema={"type":"object","properties":{"notes":{"type":"string"},"carer_id":{"type":"number","airbyte_type":"integer"},"extension":{"type":"string"},"patient_id":{"type":"number","airbyte_type":"integer"},"referral_id":{"type":"number","airbyte_type":"integer"},"tell_us_more":{"type":"string"},"linked_patient":{"type":"string"},"referrer_email":{"type":"string"},"referrer_phone":{"type":"string"},"equip_source_id":{"type":"number","airbyte_type":"integer"},"referrer_mobile":{"type":"string"},"task_external_id":{"type":"string"},"preferred_contact":{"type":"string"},"information_source":{"type":"string"},"referrer_last_name":{"type":"string"},"referrer_first_name":{"type":"string"},"referral_external_id":{"type":"string"},"referral_created_date":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"relation_with_patient":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[referral_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[referral_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@1a095ff4[stream=io.airbyte.protocol.models.AirbyteStream@711a08f3[name=patient,jsonSchema={"type":"object","properties":{"patient_id":{"type":"number","airbyte_type":"integer"},"patient_age":{"type":"number","airbyte_type":"integer"},"patient_email":{"type":"string"},"patient_phone":{"type":"string"},"patient_state":{"type":"string"},"patient_mobile":{"type":"string"},"patient_last_name":{"type":"string"},"patient_birth_date":{"type":"string","format":"date"},"patient_first_name":{"type":"string"},"patient_external_id":{"type":"string"},"contact_patient_directly":{"type":"string"},"patient_preferred_contact":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[patient_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[patient_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@27c75b3[stream=io.airbyte.protocol.models.AirbyteStream@4a5f9d78[name=relation_subcategory,jsonSchema={"type":"object","properties":{"subcategory_id":{"type":"number","airbyte_type":"integer"},"subcategory_name":{"type":"string"},"subcategory_external_id":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[subcategory_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[subcategory_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@1a799d38[stream=io.airbyte.protocol.models.AirbyteStream@3b054314[name=referral_affiliation,jsonSchema={"type":"object","properties":{"referral_id":{"type":"number","airbyte_type":"integer"},"referral_affiliation_id":{"type":"number","airbyte_type":"integer"},"referral_affiliation_city":{"type":"string"},"referral_affiliation_name":{"type":"string"},"referral_affiliation_state":{"type":"string"},"referral_affiliation_latitude":{"type":"number"},"referral_affiliation_zip_code":{"type":"string"},"referral_affiliation_longitude":{"type":"number"},"referral_affiliation_external_id":{"type":"string"},"referral_affiliation_address_line1":{"type":"string"},"referral_affiliation_address_line2":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[referral_affiliation_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[referral_affiliation_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5a35682a[stream=io.airbyte.protocol.models.AirbyteStream@6c378a49[name=inquiry,jsonSchema={"type":"object","properties":{"notes":{"type":"string"},"inquiry_id":{"type":"number","airbyte_type":"integer"},"patient_id":{"type":"number","airbyte_type":"integer"},"tell_us_more":{"type":"string"},"inquiry_about":{"type":"string"},"inquirer_email":{"type":"string"},"inquirer_phone":{"type":"string"},"linked_patient":{"type":"string"},"equip_source_id":{"type":"number","airbyte_type":"integer"},"inquirer_mobile":{"type":"string"},"task_external_id":{"type":"string"},"payor_external_id":{"type":"string"},"preferred_contact":{"type":"string"},"information_source":{"type":"string"},"inquirer_last_name":{"type":"string"},"referrer_last_name":{"type":"string"},"inquirer_first_name":{"type":"string"},"inquiry_external_id":{"type":"string"},"referrer_first_name":{"type":"string"},"inquiry_created_date":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"relation_with_patient":{"type":"string"},"referrer_affiliation_id":{"type":"number","airbyte_type":"integer"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[inquiry_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[inquiry_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@3af15aaa[stream=io.airbyte.protocol.models.AirbyteStream@2b7db303[name=affiliation,jsonSchema={"type":"object","properties":{"city":{"type":"string"},"name":{"type":"string"},"state":{"type":"string"},"latitude":{"type":"number"},"zip_code":{"type":"string"},"longitude":{"type":"number"},"address_line_1":{"type":"string"},"address_line_2":{"type":"string"},"affiliation_id":{"type":"number","airbyte_type":"integer"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[affiliation_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[affiliation_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5af8fa7e[stream=io.airbyte.protocol.models.AirbyteStream@acd46aa[name=referral_carer,jsonSchema={"type":"object","properties":{"carer_id":{"type":"number","airbyte_type":"integer"},"carer_email":{"type":"string"},"carer_phone":{"type":"string"},"carer_mobile":{"type":"string"},"carer_last_name":{"type":"string"},"carer_first_name":{"type":"string"},"carer_external_id":{"type":"string"},"relation_to_patient":{"type":"string"},"carer_preferred_contact":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[carer_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[carer_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@3ad97953[stream=io.airbyte.protocol.models.AirbyteStream@7cfa20a0[name=information_source,jsonSchema={"type":"object","properties":{"is_active":{"type":"boolean"},"information_source_id":{"type":"number","airbyte_type":"integer"},"information_source_name":{"type":"string"},"information_source_external_id":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[information_source_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[information_source_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@61cc0e4b[stream=io.airbyte.protocol.models.AirbyteStream@1d4ecce[name=ad_tracking,jsonSchema={"type":"object","properties":{"gcl_id":{"type":"string"},"utm_id":{"type":"string"},"utm_term":{"type":"string"},"utm_medium":{"type":"string"},"utm_source":{"type":"string"},"utm_adgroup":{"type":"string"},"utm_campaign":{"type":"string"},"ad_tracking_id":{"type":"number","airbyte_type":"integer"},"inquiry_referral":{"type":"string"},"inquiry_referral_id":{"type":"number","airbyte_type":"integer"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[ad_tracking_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[ad_tracking_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@70b60e46[stream=io.airbyte.protocol.models.AirbyteStream@5de4cfd0[name=relation_to_patient_type,jsonSchema={"type":"object","properties":{"relation_to_patient_type_id":{"type":"number","airbyte_type":"integer"},"relation_to_patient_type_name":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[relation_to_patient_type_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[relation_to_patient_type_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5c5b2c71[stream=io.airbyte.protocol.models.AirbyteStream@7acf09a8[name=equip_source,jsonSchema={"type":"object","properties":{"equip_source_id":{"type":"number","airbyte_type":"integer"},"equip_source_name":{"type":"string"},"equip_source_external_id":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[equip_source_id]],namespace=inquiryreferralservice,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[equip_source_id]],additionalProperties={}]],additionalProperties={}],failures=[]]
2023-02-14 14:53:54 [32mINFO[m i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):203 - Sync summary length: 18890
2023-02-14 14:53:54 [32mINFO[m i.a.c.t.TemporalUtils(withBackgroundHeartbeat):283 - Stopping temporal heartbeating...
2023-02-14 14:53:54 [32mINFO[m i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get state
2023-02-14 14:53:54 [32mINFO[m i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):56 - Using default value for environment variable NEED_STATE_VALIDATION: 'true'
2023-02-14 14:53:54 [32mINFO[m i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to create or update state
2023-02-14 14:53:54 [33mWARN[m i.a.p.j.JobNotifier(notifyJob):113 - Failed to successfully notify success: io.airbyte.config.Notification@d974ffc[notificationType=slack,sendOnSuccess=false,sendOnFailure=true,slackConfiguration=io.airbyte.config.SlackNotificationConfiguration@56b122e9[webhook=https://hooks.slack.com/services/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],customerioConfiguration=,additionalProperties={}]
2023-02-14 14:53:54 [32mINFO[m i.a.v.j.JsonSchemaValidator(test):130 - JSON schema validation failed.
errors: $.format_type: does not have a value in the enumeration [Avro], $.compression_codec: should be valid to one and only one of schema, but more than one are valid: {"title":"No Compression","required":["codec"],"properties":{"codec":{"enum":["no compression"],"type":"string","default":"no compression"}}}{"title":"Deflate","required":["codec","compression_level"],"properties":{"codec":{"enum":["Deflate"],"type":"string","default":"Deflate"},"compression_level":{"type":"integer","title":"Deflate Level","default":0,"maximum":9,"minimum":0,"description":"0: no compression & fastest, 9: best compression & slowest."}}}{"title":"bzip2","required":["codec"],"properties":{"codec":{"enum":["bzip2"],"type":"string","default":"bzip2"}}}{"title":"xz","required":["codec","compression_level"],"properties":{"codec":{"enum":["xz"],"type":"string","default":"xz"},"compression_level":{"type":"integer","title":"Compression Level","default":6,"maximum":9,"minimum":0,"description":"See here for details."}}}{"title":"zstandard","required":["codec","compression_level"],"properties":{"codec":{"enum":["zstandard"],"type":"string","default":"zstandard"},"include_checksum":{"type":"boolean","title":"Include Checksum","default":false,"description":"If true, include a checksum with each data block."},"compression_level":{"type":"integer","title":"Compression Level","default":3,"maximum":22,"minimum":-5,"description":"Negative levels are 'fast' modes akin to lz4 or snappy, levels above 9 are generally for archival purposes, and levels above 18 use a lot of memory."}}}{"title":"snappy","required":["codec"],"properties":{"codec":{"enum":["snappy"],"type":"string","default":"snappy"}}}, $.compression_codec: string found, object expected
2023-02-14 14:53:54 [32mINFO[m i.a.v.j.JsonSchemaValidator(test):130 - JSON schema validation failed.
errors: $.flattening: is missing but it is required, $.format_type: does not have a value in the enumeration [CSV]
2023-02-14 14:53:54 [32mINFO[m i.a.v.j.JsonSchemaValidator(test):130 - JSON schema validation failed.
errors: $.format_type: does not have a value in the enumeration [JSONL]
2023-02-14 14:53:54 [32mINFO[m i.a.c.t.StreamResetRecordsHelper(deleteStreamResetRecordsForJob):50 - deleteStreamResetRecordsForJob was called for job 7455 with config type sync. Returning, as config type is not resetConnection.