2022-06-20 16:20:06 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.plugin: is not defined in the schema and the schema does not allow additional properties, $.publication: is not defined in the schema and the schema does not allow additional properties, $.replication_slot: is not defined in the schema and the schema does not allow additional properties, $.method: does not have a value in the enumeration [Standard], $.method: must be a constant value Standard
2022-06-20 16:20:06 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.credential: is not defined in the schema and the schema does not allow additional properties, $.part_size_mb: is not defined in the schema and the schema does not allow additional properties, $.gcs_bucket_name: is not defined in the schema and the schema does not allow additional properties, $.gcs_bucket_path: is not defined in the schema and the schema does not allow additional properties, $.keep_files_in_gcs-bucket: is not defined in the schema and the schema does not allow additional properties, $.method: must be a constant value Standard
2022-06-20 16:20:06 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.credential.hmac_key_access_id: object found, string expected, $.credential.hmac_key_secret: object found, string expected
2022-06-20 16:20:06 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/81417/0/logs.log
2022-06-20 16:20:06 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.19-alpha
2022-06-20 16:20:06 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-postgres:0.4.24 exists...
2022-06-20 16:20:06 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-postgres:0.4.24 was found locally.
2022-06-20 16:20:06 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 81417
2022-06-20 16:20:06 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/81417/0 --log-driver none --name source-postgres-check-81417-0-hjcxu --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:0.4.24 -e AIRBYTE_VERSION=0.39.19-alpha -e WORKER_JOB_ID=81417 airbyte/source-postgres:0.4.24 check --config source_config.json
2022-06-20 16:20:07 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings.
2022-06-20 16:20:07 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:20:07 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:20:07 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2022-06-20 16:20:07 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-06-20 16:20:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:08 INFO i.a.i.s.p.PostgresSource(main):409 - starting source: class io.airbyte.integrations.source.postgres.PostgresSource
2022-06-20 16:20:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:08 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json}
2022-06-20 16:20:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:08 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2022-06-20 16:20:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:08 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK
2022-06-20 16:20:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:08 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}
2022-06-20 16:20:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:08 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:20:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:08 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:20:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:08 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:20:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:08 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:20:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:09 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL
2022-06-20 16:20:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:09 INFO c.z.h.HikariDataSource(<init>):80 - HikariPool-1 - Starting...
2022-06-20 16:20:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:09 INFO c.z.h.HikariDataSource(<init>):82 - HikariPool-1 - Start completed.
2022-06-20 16:20:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:09 INFO i.a.i.s.p.PostgresSource(isCdc):258 - using CDC: true
2022-06-20 16:20:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:09 INFO i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):93 - Attempting to get metadata from the database to see if we can connect.
2022-06-20 16:20:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:09 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$1):173 - Attempting to find the named replication slot using the query: HikariProxyPreparedStatement@1412656257 wrapping SELECT * FROM pg_replication_slots WHERE slot_name = 'airbyte_slot_checkmate' AND plugin = 'wal2json' AND database = 'checkmate'
2022-06-20 16:20:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:09 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows
2022-06-20 16:20:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:09 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$3):191 - Attempting to find the publication using the query: HikariProxyPreparedStatement@1133227388 wrapping SELECT * FROM pg_publication WHERE pubname = 'checkmate_publication'
2022-06-20 16:20:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:09 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows
2022-06-20 16:20:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:09 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated...
2022-06-20 16:20:09 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:09 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed.
2022-06-20 16:20:10 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling...
2022-06-20 16:20:10 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/81417/0/logs.log
2022-06-20 16:20:10 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.19-alpha
2022-06-20 16:20:10 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.8 exists...
2022-06-20 16:20:10 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.8 was found locally.
2022-06-20 16:20:10 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 81417
2022-06-20 16:20:10 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/81417/0 --log-driver none --name destination-bigquery-check-81417-0-gtyvu --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.8 -e AIRBYTE_VERSION=0.39.19-alpha -e WORKER_JOB_ID=81417 airbyte/destination-bigquery:1.1.8 check --config source_config.json
2022-06-20 16:20:10 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings.
2022-06-20 16:20:10 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:20:10 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:20:10 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:20:10 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2022-06-20 16:20:10 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-06-20 16:20:12 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:12 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json}
2022-06-20 16:20:12 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:12 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2022-06-20 16:20:12 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:12 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK
2022-06-20 16:20:12 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:12 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}
2022-06-20 16:20:12 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:12 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:20:12 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:12 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:20:12 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:12 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:20:12 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:12 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):303 - Selected loading method is set to: GCS
2022-06-20 16:20:13 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:13 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"CSV","flattening":"No flattening","part_size_mb":"5"}
2022-06-20 16:20:14 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:14 INFO i.a.i.d.s.S3Destination(testSingleUpload):81 - Started testing if all required credentials assigned to user for single file uploading
2022-06-20 16:20:14 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:14 INFO i.a.i.d.s.S3Destination(testSingleUpload):91 - Finished checking for normal upload mode
2022-06-20 16:20:14 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:14 INFO i.a.i.d.s.S3Destination(testMultipartUpload):95 - Started testing if all required credentials assigned to user for multipart upload
2022-06-20 16:20:14 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:14 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to synctera-data-staging/airbyte/test_1655742014800 with full ID ABPnzm5moqE7S4W2W1QZ5IqcOKawCwUHm8Nk_hT03UzmnsVv0kZBYFZFB4_RMDaps7pI4YU
2022-06-20 16:20:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:15 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000]
2022-06-20 16:20:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:15 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000]
2022-06-20 16:20:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:15 WARN a.m.s.MultiPartOutputStream(close):160 - [MultipartOutputStream for parts 1 - 10000] is already closed
2022-06-20 16:20:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:15 INFO a.m.s.StreamTransferManager(complete):367 - [Manager uploading to synctera-data-staging/airbyte/test_1655742014800 with id ABPnzm5mo...aps7pI4YU]: Uploading leftover stream [Part number 1 containing 3.34 MB]
2022-06-20 16:20:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:15 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to synctera-data-staging/airbyte/test_1655742014800 with id ABPnzm5mo...aps7pI4YU]: Finished uploading [Part number 1 containing 3.34 MB]
2022-06-20 16:20:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:15 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to synctera-data-staging/airbyte/test_1655742014800 with id ABPnzm5mo...aps7pI4YU]: Completed
2022-06-20 16:20:16 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:20:16 INFO i.a.i.d.s.S3Destination(testMultipartUpload):119 - Finished verification for multipart upload mode
2022-06-20 16:20:16 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling...
2022-06-20 16:20:16 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/81417/0/logs.log
2022-06-20 16:20:16 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.19-alpha
2022-06-20 16:20:17 INFO i.a.w.g.DefaultReplicationWorker(run):115 - start sync worker. job id: 81417 attempt id: 0
2022-06-20 16:20:17 INFO i.a.w.g.DefaultReplicationWorker(run):127 - configured sync modes: {public.bank_config=incremental - append_dedup, public.deposit=incremental - append_dedup, public.vendor_config=incremental - append_dedup, public.inbound_file_metadata=incremental - append_dedup}
2022-06-20 16:20:17 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination...
2022-06-20 16:20:17 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.8 exists...
2022-06-20 16:20:17 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.8 was found locally.
2022-06-20 16:20:17 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 81417
2022-06-20 16:20:17 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/81417/0 --log-driver none --name destination-bigquery-write-81417-0-jsbvg --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.8 -e AIRBYTE_VERSION=0.39.19-alpha -e WORKER_JOB_ID=81417 airbyte/destination-bigquery:1.1.8 write --config destination_config.json --catalog destination_catalog.json
2022-06-20 16:20:17 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-postgres:0.4.24 exists...
2022-06-20 16:20:17 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-postgres:0.4.24 was found locally.
2022-06-20 16:20:17 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 81417
2022-06-20 16:20:17 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/81417/0 --log-driver none --name source-postgres-read-81417-0-pufqu --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:0.4.24 -e AIRBYTE_VERSION=0.39.19-alpha -e WORKER_JOB_ID=81417 airbyte/source-postgres:0.4.24 read --config source_config.json --catalog source_catalog.json --state input_state.json
2022-06-20 16:20:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):395 - Destination output thread started.
2022-06-20 16:20:17 INFO i.a.w.g.DefaultReplicationWorker(run):169 - Waiting for source and destination threads to complete.
2022-06-20 16:20:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):298 - Replication thread started.
2022-06-20 16:20:17 destination > SLF4J: Class path contains multiple SLF4J bindings.
2022-06-20 16:20:17 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:20:17 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:20:17 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:20:17 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2022-06-20 16:20:17 source > SLF4J: Class path contains multiple SLF4J bindings.
2022-06-20 16:20:17 source > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:20:17 source > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:20:17 source > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2022-06-20 16:20:18 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-06-20 16:20:18 source > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-06-20 16:20:19 destination > 2022-06-20 16:20:19 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2022-06-20 16:20:19 destination > 2022-06-20 16:20:19 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2022-06-20 16:20:19 destination > 2022-06-20 16:20:19 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE
2022-06-20 16:20:19 destination > 2022-06-20 16:20:19 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2022-06-20 16:20:19 source > 2022-06-20 16:20:19 INFO i.a.i.s.p.PostgresSource(main):409 - starting source: class io.airbyte.integrations.source.postgres.PostgresSource
2022-06-20 16:20:19 source > 2022-06-20 16:20:19 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {read=null, catalog=source_catalog.json, state=input_state.json, config=source_config.json}
2022-06-20 16:20:19 source > 2022-06-20 16:20:19 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2022-06-20 16:20:19 source > 2022-06-20 16:20:19 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: READ
2022-06-20 16:20:19 source > 2022-06-20 16:20:19 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='input_state.json'}
2022-06-20 16:20:20 destination > 2022-06-20 16:20:20 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:20:20 destination > 2022-06-20 16:20:20 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:20:20 destination > 2022-06-20 16:20:20 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:20:20 destination > 2022-06-20 16:20:20 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):303 - Selected loading method is set to: GCS
2022-06-20 16:20:20 source > 2022-06-20 16:20:20 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:20:20 source > 2022-06-20 16:20:20 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:20:20 source > 2022-06-20 16:20:20 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:20:20 source > 2022-06-20 16:20:20 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:20:20 destination > 2022-06-20 16:20:20 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"AVRO","flattening":"No flattening","part_size_mb":"5"}
2022-06-20 16:20:20 destination > 2022-06-20 16:20:20 INFO i.a.i.d.b.BigQueryUtils(isKeepFilesInGcs):319 - All tmp files will be removed from GCS when replication is finished
2022-06-20 16:20:21 source > 2022-06-20 16:20:21 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL
2022-06-20 16:20:21 source > 2022-06-20 16:20:21 INFO c.z.h.HikariDataSource(<init>):80 - HikariPool-1 - Starting...
2022-06-20 16:20:21 source > 2022-06-20 16:20:21 INFO c.z.h.HikariDataSource(<init>):82 - HikariPool-1 - Start completed.
2022-06-20 16:20:21 destination > 2022-06-20 16:20:21 INFO i.a.i.d.b.BigQueryDestination(getGcsRecordConsumer):289 - Creating BigQuery staging message consumer with staging ID d534ec7c-67fc-42d0-8c50-ab56ad143d5e at 2022-06-20T16:20:20.484Z
2022-06-20 16:20:21 destination > 2022-06-20 16:20:21 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$createWriteConfigs$1):86 - BigQuery write config: BigQueryWriteConfig[streamName=bank_config, namespace=raw_checkmate, datasetId=raw_checkmate, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_wxv_bank_config}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_bank_config}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]]
2022-06-20 16:20:21 destination > 2022-06-20 16:20:21 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$createWriteConfigs$1):86 - BigQuery write config: BigQueryWriteConfig[streamName=deposit, namespace=raw_checkmate, datasetId=raw_checkmate, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_hyd_deposit}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_deposit}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]]
2022-06-20 16:20:21 destination > 2022-06-20 16:20:21 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$createWriteConfigs$1):86 - BigQuery write config: BigQueryWriteConfig[streamName=inbound_file_metadata, namespace=raw_checkmate, datasetId=raw_checkmate, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_gtu_inbound_file_metadata}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_inbound_file_metadata}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]]
2022-06-20 16:20:21 destination > 2022-06-20 16:20:21 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$createWriteConfigs$1):86 - BigQuery write config: BigQueryWriteConfig[streamName=vendor_config, namespace=raw_checkmate, datasetId=raw_checkmate, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_vxi_vendor_config}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_vendor_config}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]]
2022-06-20 16:20:21 destination > 2022-06-20 16:20:21 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started.
2022-06-20 16:20:21 destination > 2022-06-20 16:20:21 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):98 - Preparing tmp tables in destination started for 4 streams
2022-06-20 16:20:21 destination > 2022-06-20 16:20:21 INFO i.a.i.d.b.BigQueryGcsOperations(createSchemaIfNotExists):86 - Creating dataset raw_checkmate
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.p.PostgresSource(isCdc):258 - using CDC: true
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):93 - Attempting to get metadata from the database to see if we can connect.
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$1):173 - Attempting to find the named replication slot using the query: HikariProxyPreparedStatement@1237144823 wrapping SELECT * FROM pg_replication_slots WHERE slot_name = 'airbyte_slot_checkmate' AND plugin = 'wal2json' AND database = 'checkmate'
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$3):191 - Attempting to find the publication using the query: HikariProxyPreparedStatement@1425405511 wrapping SELECT * FROM pg_publication WHERE pubname = 'checkmate_publication'
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated...
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed.
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.r.CdcStateManager(<init>):26 - Initialized CDC state with: null
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='bank_config', namespace='public'}, New Cursor Field: timestamp_ch. Resetting cursor value
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='deposit', namespace='public'}, New Cursor Field: timestamp_ch. Resetting cursor value
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='vendor_config', namespace='public'}, New Cursor Field: timestamp_ch. Resetting cursor value
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='inbound_file_metadata', namespace='public'}, New Cursor Field: timestamp_ch. Resetting cursor value
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO c.z.h.HikariDataSource(<init>):80 - HikariPool-2 - Starting...
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO c.z.h.HikariDataSource(<init>):82 - HikariPool-2 - Start completed.
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.p.PostgresSource(discoverInternal):144 - Checking schema: public
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(discoverInternal):121 - Internal schemas to exclude: [catalog_history, information_schema, pg_catalog, pg_internal]
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table schema_migrations column version (type int8[19]) -> JsonSchemaType({type=number})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table schema_migrations column dirty (type bool[1]) -> JsonSchemaType({type=boolean})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column bank_config_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column bank_id (type int2[5]) -> JsonSchemaType({type=number})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column vendor_bank_id (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column name (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column outbound_upload_path (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column inbound_upload_path (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column timestamp_cr (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column timestamp_ch (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column hold_amount_percentage (type int4[10]) -> JsonSchemaType({type=number})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column hold_duration (type int4[10]) -> JsonSchemaType({type=number})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table inbound_file_metadata column inbound_file_metadata_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table inbound_file_metadata column file_name (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table inbound_file_metadata column file_hash (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table inbound_file_metadata column timestamp_cr (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table inbound_file_metadata column timestamp_ch (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table vendor_config column vendor_config_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table vendor_config column name (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table vendor_config column outbound_upload_path (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table vendor_config column inbound_upload_path (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table vendor_config column timestamp_cr (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table vendor_config column timestamp_ch (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column deposit_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column bank_id (type int2[5]) -> JsonSchemaType({type=number})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column partner_id (type int2[5]) -> JsonSchemaType({type=number})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column account_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column transaction_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column party_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column party_type (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column account_number (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column ocr_account_number (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column check_number (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column status (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column vendor_reference_id (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column vendor_info (type jsonb[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column amount (type int8[19]) -> JsonSchemaType({type=number})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column check_amount (type int8[19]) -> JsonSchemaType({type=number})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column currency (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column date_captured (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column date_processed (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column timestamp_cr (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column timestamp_ch (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column timestamp_de (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column front_image_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column back_image_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column micr (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.p.PostgresSource(discoverInternal):148 - Found table: public.schema_migrations
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.p.PostgresSource(discoverInternal):148 - Found table: public.bank_config
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.p.PostgresSource(discoverInternal):148 - Found table: public.inbound_file_metadata
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.p.PostgresSource(discoverInternal):148 - Found table: public.vendor_config
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.p.PostgresSource(discoverInternal):148 - Found table: public.deposit
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.p.PostgresSource(isCdc):258 - using CDC: true
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.s.p.PostgresCdcTargetPosition(targetPosition):45 - identified target lsn: PgLsn{lsn=360862204232}
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO i.a.i.d.AirbyteDebeziumHandler(getIncrementalIterators):72 - using CDC: true
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 INFO o.a.k.c.c.AbstractConfig(logAll):354 - EmbeddedConfig values: 
2022-06-20 16:20:22 source > 	access.control.allow.methods = 
2022-06-20 16:20:22 source > 	access.control.allow.origin = 
2022-06-20 16:20:22 source > 	admin.listeners = null
2022-06-20 16:20:22 source > 	bootstrap.servers = [localhost:9092]
2022-06-20 16:20:22 source > 	client.dns.lookup = use_all_dns_ips
2022-06-20 16:20:22 source > 	config.providers = []
2022-06-20 16:20:22 source > 	connector.client.config.override.policy = None
2022-06-20 16:20:22 source > 	header.converter = class org.apache.kafka.connect.storage.SimpleHeaderConverter
2022-06-20 16:20:22 source > 	internal.key.converter = class org.apache.kafka.connect.json.JsonConverter
2022-06-20 16:20:22 source > 	internal.value.converter = class org.apache.kafka.connect.json.JsonConverter
2022-06-20 16:20:22 source > 	key.converter = class org.apache.kafka.connect.json.JsonConverter
2022-06-20 16:20:22 source > 	listeners = null
2022-06-20 16:20:22 source > 	metric.reporters = []
2022-06-20 16:20:22 source > 	metrics.num.samples = 2
2022-06-20 16:20:22 source > 	metrics.recording.level = INFO
2022-06-20 16:20:22 source > 	metrics.sample.window.ms = 30000
2022-06-20 16:20:22 source > 	offset.flush.interval.ms = 1000
2022-06-20 16:20:22 source > 	offset.flush.timeout.ms = 5000
2022-06-20 16:20:22 source > 	offset.storage.file.filename = /tmp/cdc-state-offset9235015303222034661/offset.dat
2022-06-20 16:20:22 source > 	offset.storage.partitions = null
2022-06-20 16:20:22 source > 	offset.storage.replication.factor = null
2022-06-20 16:20:22 source > 	offset.storage.topic = 
2022-06-20 16:20:22 source > 	plugin.path = null
2022-06-20 16:20:22 source > 	response.http.headers.config = 
2022-06-20 16:20:22 source > 	rest.advertised.host.name = null
2022-06-20 16:20:22 source > 	rest.advertised.listener = null
2022-06-20 16:20:22 source > 	rest.advertised.port = null
2022-06-20 16:20:22 source > 	rest.extension.classes = []
2022-06-20 16:20:22 source > 	rest.host.name = null
2022-06-20 16:20:22 source > 	rest.port = 8083
2022-06-20 16:20:22 source > 	ssl.cipher.suites = null
2022-06-20 16:20:22 source > 	ssl.client.auth = none
2022-06-20 16:20:22 source > 	ssl.enabled.protocols = [TLSv1.2, TLSv1.3]
2022-06-20 16:20:22 source > 	ssl.endpoint.identification.algorithm = https
2022-06-20 16:20:22 source > 	ssl.engine.factory.class = null
2022-06-20 16:20:22 source > 	ssl.key.password = null
2022-06-20 16:20:22 source > 	ssl.keymanager.algorithm = SunX509
2022-06-20 16:20:22 source > 	ssl.keystore.location = null
2022-06-20 16:20:22 source > 	ssl.keystore.password = null
2022-06-20 16:20:22 source > 	ssl.keystore.type = JKS
2022-06-20 16:20:22 source > 	ssl.protocol = TLSv1.3
2022-06-20 16:20:22 source > 	ssl.provider = null
2022-06-20 16:20:22 source > 	ssl.secure.random.implementation = null
2022-06-20 16:20:22 source > 	ssl.trustmanager.algorithm = PKIX
2022-06-20 16:20:22 source > 	ssl.truststore.location = null
2022-06-20 16:20:22 source > 	ssl.truststore.password = null
2022-06-20 16:20:22 source > 	ssl.truststore.type = JKS
2022-06-20 16:20:22 source > 	task.shutdown.graceful.timeout.ms = 5000
2022-06-20 16:20:22 source > 	topic.creation.enable = true
2022-06-20 16:20:22 source > 	topic.tracking.allow.reset = true
2022-06-20 16:20:22 source > 	topic.tracking.enable = true
2022-06-20 16:20:22 source > 	value.converter = class org.apache.kafka.connect.json.JsonConverter
2022-06-20 16:20:22 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $: unknown found, object expected
2022-06-20 16:20:22 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null
2022-06-20 16:20:22 source > 2022-06-20 16:20:22 WARN o.a.k.c.r.WorkerConfig(logPluginPathConfigProviderWarning):420 - Variables cannot be used in the 'plugin.path' property, since the property is used by plugin scanning before the config providers that replace the variables are initialized. The raw value 'null' was used for plugin scanning, as opposed to the transformed value 'null', and this may cause unexpected results.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "table.blacklist" is deprecated and will be removed in future versions. Please use "table.exclude.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "table.blacklist" is deprecated and will be removed in future versions. Please use "table.exclude.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.whitelist" is deprecated and will be removed in future versions. Please use "schema.include.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.blacklist" is deprecated and will be removed in future versions. Please use "schema.exclude.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.whitelist" is deprecated and will be removed in future versions. Please use "schema.include.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.blacklist" is deprecated and will be removed in future versions. Please use "schema.exclude.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(start):100 - Starting PostgresConnectorTask with configuration:
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    connector.class = io.debezium.connector.postgresql.PostgresConnector
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    max.queue.size = 8192
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    slot.name = airbyte_slot_checkmate
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    publication.name = checkmate_publication
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    offset.storage.file.filename = /tmp/cdc-state-offset9235015303222034661/offset.dat
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    decimal.handling.mode = string
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    converters = datetime
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    datetime.type = io.airbyte.integrations.debezium.internals.PostgresConverter
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    publication.autocreate.mode = disabled
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.user = airbyte_checkmate
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.dbname = checkmate
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    offset.storage = org.apache.kafka.connect.storage.FileOffsetBackingStore
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.server.name = checkmate
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    plugin.name = wal2json
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.port = 5432
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    offset.flush.interval.ms = 1000
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    key.converter.schemas.enable = false
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.hostname = 10.58.160.3
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.password = ********
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    name = checkmate
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    value.converter.schemas.enable = false
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    max.batch.size = 2048
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    table.include.list = public.bank_config,public.deposit,public.inbound_file_metadata,public.vendor_config
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    snapshot.mode = exported
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.include.list = checkmate
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.whitelist" is deprecated and will be removed in future versions. Please use "schema.include.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.blacklist" is deprecated and will be removed in future versions. Please use "schema.exclude.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "table.blacklist" is deprecated and will be removed in future versions. Please use "table.exclude.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:20:23 destination > 2022-06-20 16:20:23 INFO i.a.i.d.b.BigQueryGcsOperations(createTmpTableIfNotExists):94 - Creating tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_vxi_vendor_config}}
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.blacklist" is deprecated and will be removed in future versions. Please use "schema.exclude.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "table.blacklist" is deprecated and will be removed in future versions. Please use "table.exclude.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.whitelist" is deprecated and will be removed in future versions. Please use "schema.include.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.blacklist" is deprecated and will be removed in future versions. Please use "schema.exclude.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "table.blacklist" is deprecated and will be removed in future versions. Please use "table.exclude.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.whitelist" is deprecated and will be removed in future versions. Please use "schema.include.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.p.PostgresConnectorTask(start):97 - user 'airbyte_checkmate' connected to database 'checkmate' on PostgreSQL 12.10 on x86_64-pc-linux-gnu, compiled by Debian clang version 12.0.1, 64-bit with roles:
2022-06-20 16:20:23 source > 	role 'cloudsqlsuperuser' [superuser: false, replication: false, inherit: true, create role: true, create db: true, can log in: true]
2022-06-20 16:20:23 source > 	role 'pg_read_all_settings' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: false]
2022-06-20 16:20:23 source > 	role 'pg_stat_scan_tables' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: false]
2022-06-20 16:20:23 source > 	role 'airbyte_checkmate' [superuser: false, replication: true, inherit: true, create role: true, create db: true, can log in: true]
2022-06-20 16:20:23 source > 	role 'pg_monitor' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: false]
2022-06-20 16:20:23 source > 	role 'pg_read_all_stats' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: false]
2022-06-20 16:20:23 source > 	role 'pg_signal_backend' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: false]
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.p.c.PostgresConnection(readReplicationSlotInfo):204 - Obtained valid replication slot ReplicationSlot [active=false, latestFlushedLsn=LSN{53/E11E84E0}, catalogXmin=19514215]
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.p.PostgresConnectorTask(start):106 - No previous offset found
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.p.s.ExportedSnapshotter(shouldSnapshot):38 - Taking exported snapshot for new datasource
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.u.Threads(threadFactory):270 - Requested thread factory for connector PostgresConnector, id = checkmate named = change-event-source-coordinator
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.u.Threads$3(newThread):287 - Creating thread debezium-postgresconnector-checkmate-change-event-source-coordinator
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.p.ChangeEventSourceCoordinator(lambda$start$0):91 - Metrics registered
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.p.ChangeEventSourceCoordinator(lambda$start$0):94 - Context created
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.p.s.ExportedSnapshotter(shouldSnapshot):38 - Taking exported snapshot for new datasource
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.p.PostgresSnapshotChangeEventSource(getSnapshottingTask):69 - According to the connector configuration data will be snapshotted
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):95 - Snapshot step 1 - Preparing
2022-06-20 16:20:23 destination > 2022-06-20 16:20:23 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_vxi_vendor_config}}
2022-06-20 16:20:23 destination > 2022-06-20 16:20:23 INFO i.a.i.d.b.BigQueryGcsOperations(createStageIfNotExists):101 - Creating staging path for stream vendor_config (dataset raw_checkmate): airbyte/raw_checkmate_vendor_config/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):104 - Snapshot step 2 - Determining captured tables
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):111 - Snapshot step 3 - Locking captured tables [public.bank_config, public.deposit, public.inbound_file_metadata, public.vendor_config]
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.p.PostgresSnapshotChangeEventSource(lockTablesForSchemaSnapshot):122 - Step 2: skipping locking each table in an exported snapshot
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):117 - Snapshot step 4 - Determining snapshot offset
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.p.PostgresOffsetContext(initialContext):235 - Creating initial offset context
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.p.PostgresOffsetContext(initialContext):238 - Read xlogStart at 'LSN{54/5104148}' from transaction '19622750'
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.p.PostgresSnapshotChangeEventSource(updateOffsetForSnapshot):155 - Read xlogStart at 'LSN{54/5104148}' from transaction '19622750'
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):120 - Snapshot step 5 - Reading structure of captured tables
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.p.PostgresSnapshotChangeEventSource(readTableStructure):198 - Reading structure of schema 'checkmate'
2022-06-20 16:20:23 destination > 2022-06-20 16:20:23 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):97 - Storage Object synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/ does not exist in bucket; creating...
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):124 - Snapshot step 6 - Persisting schema history
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):136 - Snapshot step 7 - Snapshotting data
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):306 - 	 Exporting data from table 'public.bank_config'
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):314 - 	 For table 'public.bank_config' using select statement: 'select * from "public"."bank_config"'
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):356 - 	 Finished exporting 0 records for table 'public.bank_config'; total duration '00:00:00.004'
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):306 - 	 Exporting data from table 'public.deposit'
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):314 - 	 For table 'public.deposit' using select statement: 'select * from "public"."deposit"'
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):356 - 	 Finished exporting 18 records for table 'public.deposit'; total duration '00:00:00.074'
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):306 - 	 Exporting data from table 'public.inbound_file_metadata'
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):314 - 	 For table 'public.inbound_file_metadata' using select statement: 'select * from "public"."inbound_file_metadata"'
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):356 - 	 Finished exporting 0 records for table 'public.inbound_file_metadata'; total duration '00:00:00.003'
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):306 - 	 Exporting data from table 'public.vendor_config'
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):314 - 	 For table 'public.vendor_config' using select statement: 'select * from "public"."vendor_config"'
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):356 - 	 Finished exporting 1 records for table 'public.vendor_config'; total duration '00:00:00.008'
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.p.s.AbstractSnapshotChangeEventSource(execute):85 - Snapshot - Final stage
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.p.ChangeEventSourceCoordinator(lambda$start$0):106 - Snapshot ended with SnapshotResult [status=COMPLETED, offset=PostgresOffsetContext [sourceInfoSchema=Schema{io.debezium.connector.postgresql.Source:STRUCT}, sourceInfo=source_info[server='checkmate'db='checkmate', lsn=LSN{54/5104148}, txId=19622750, timestamp=2022-06-20T16:20:23.889Z, snapshot=FALSE, schema=public, table=vendor_config], partition={server=checkmate}, lastSnapshotRecord=true, lastCompletelyProcessedLsn=null, lastCommitLsn=null, transactionContext=TransactionContext [currentTransactionId=null, perTableEventCount={}, totalEventCount=0]]]
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.p.m.StreamingChangeEventSourceMetrics(connected):60 - Connected metrics set to 'true'
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.p.ChangeEventSourceCoordinator(streamEvents):139 - Starting streaming
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.p.PostgresStreamingChangeEventSource(execute):104 - Retrieved latest position from stored offset 'LSN{54/5104148}'
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.p.c.WalPositionLocator(<init>):40 - Looking for WAL restart position for last commit LSN 'null' and last change LSN 'LSN{54/5104148}'
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.c.p.c.PostgresConnection(readReplicationSlotInfo):204 - Obtained valid replication slot ReplicationSlot [active=false, latestFlushedLsn=LSN{53/E11E84E0}, catalogXmin=19514215]
2022-06-20 16:20:23 source > 2022-06-20 16:20:23 INFO i.d.j.JdbcConnection(lambda$doClose$3):945 - Connection gracefully closed
2022-06-20 16:20:24 destination > 2022-06-20 16:20:24 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):99 - Storage Object synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/ has been created in bucket.
2022-06-20 16:20:24 destination > 2022-06-20 16:20:24 INFO i.a.i.d.b.BigQueryGcsOperations(createTmpTableIfNotExists):94 - Creating tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_gtu_inbound_file_metadata}}
2022-06-20 16:20:24 source > 2022-06-20 16:20:24 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):116 - REPLICA IDENTITY for 'public.bank_config' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns
2022-06-20 16:20:24 source > 2022-06-20 16:20:24 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):116 - REPLICA IDENTITY for 'public.deposit' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns
2022-06-20 16:20:24 source > 2022-06-20 16:20:24 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):116 - REPLICA IDENTITY for 'public.vendor_config' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns
2022-06-20 16:20:24 source > 2022-06-20 16:20:24 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):116 - REPLICA IDENTITY for 'public.inbound_file_metadata' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns
2022-06-20 16:20:24 source > 2022-06-20 16:20:24 INFO i.d.c.p.PostgresStreamingChangeEventSource(searchWalPosition):268 - Searching for WAL resume position
2022-06-20 16:20:24 destination > 2022-06-20 16:20:24 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_gtu_inbound_file_metadata}}
2022-06-20 16:20:24 destination > 2022-06-20 16:20:24 INFO i.a.i.d.b.BigQueryGcsOperations(createStageIfNotExists):101 - Creating staging path for stream inbound_file_metadata (dataset raw_checkmate): airbyte/raw_checkmate_inbound_file_metadata/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/
2022-06-20 16:20:24 destination > 2022-06-20 16:20:24 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):97 - Storage Object synctera-data-staging/airbyte/raw_checkmate_inbound_file_metadata/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/ does not exist in bucket; creating...
2022-06-20 16:20:24 source > 2022-06-20 16:20:24 INFO i.d.e.EmbeddedEngine(stop):996 - Stopping the embedded engine
2022-06-20 16:20:24 source > 2022-06-20 16:20:24 INFO i.d.e.EmbeddedEngine(stop):1004 - Waiting for PT5M for connector to stop
2022-06-20 16:20:24 destination > 2022-06-20 16:20:24 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):99 - Storage Object synctera-data-staging/airbyte/raw_checkmate_inbound_file_metadata/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/ has been created in bucket.
2022-06-20 16:20:24 destination > 2022-06-20 16:20:24 INFO i.a.i.d.b.BigQueryGcsOperations(createTmpTableIfNotExists):94 - Creating tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_hyd_deposit}}
2022-06-20 16:20:24 destination > 2022-06-20 16:20:24 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_hyd_deposit}}
2022-06-20 16:20:24 destination > 2022-06-20 16:20:24 INFO i.a.i.d.b.BigQueryGcsOperations(createStageIfNotExists):101 - Creating staging path for stream deposit (dataset raw_checkmate): airbyte/raw_checkmate_deposit/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/
2022-06-20 16:20:24 destination > 2022-06-20 16:20:24 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):97 - Storage Object synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/ does not exist in bucket; creating...
2022-06-20 16:20:25 destination > 2022-06-20 16:20:25 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):99 - Storage Object synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/ has been created in bucket.
2022-06-20 16:20:25 destination > 2022-06-20 16:20:25 INFO i.a.i.d.b.BigQueryGcsOperations(createTmpTableIfNotExists):94 - Creating tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_wxv_bank_config}}
2022-06-20 16:20:25 destination > 2022-06-20 16:20:25 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_wxv_bank_config}}
2022-06-20 16:20:25 destination > 2022-06-20 16:20:25 INFO i.a.i.d.b.BigQueryGcsOperations(createStageIfNotExists):101 - Creating staging path for stream bank_config (dataset raw_checkmate): airbyte/raw_checkmate_bank_config/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/
2022-06-20 16:20:25 destination > 2022-06-20 16:20:25 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):97 - Storage Object synctera-data-staging/airbyte/raw_checkmate_bank_config/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/ does not exist in bucket; creating...
2022-06-20 16:20:25 source > 2022-06-20 16:20:25 INFO i.d.c.c.BaseSourceTask(stop):192 - Stopping down connector
2022-06-20 16:20:25 destination > 2022-06-20 16:20:25 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):99 - Storage Object synctera-data-staging/airbyte/raw_checkmate_bank_config/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/ has been created in bucket.
2022-06-20 16:20:25 destination > 2022-06-20 16:20:25 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):107 - Preparing tmp tables in destination completed.
2022-06-20 16:20:25 destination > 2022-06-20 16:20:25 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):55 - Starting a new buffer for stream deposit (current state: 0 bytes in 0 buffers)
2022-06-20 16:20:25 destination > 2022-06-20 16:20:25 INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 - Default schema.
2022-06-20 16:20:25 source > 2022-06-20 16:20:25 INFO i.d.c.p.PostgresStreamingChangeEventSource(searchWalPosition):287 - WAL resume position 'null' discovered
2022-06-20 16:20:25 source > 2022-06-20 16:20:25 INFO i.d.j.JdbcConnection(lambda$doClose$3):945 - Connection gracefully closed
2022-06-20 16:20:25 source > 2022-06-20 16:20:25 INFO i.d.c.p.PostgresStreamingChangeEventSource(processMessages):180 - Processing messages
2022-06-20 16:20:25 source > 2022-06-20 16:20:25 INFO i.d.j.JdbcConnection(lambda$doClose$3):945 - Connection gracefully closed
2022-06-20 16:20:25 source > 2022-06-20 16:20:25 INFO i.d.p.ChangeEventSourceCoordinator(streamEvents):141 - Finished streaming
2022-06-20 16:20:25 source > 2022-06-20 16:20:25 INFO i.d.p.m.StreamingChangeEventSourceMetrics(connected):60 - Connected metrics set to 'false'
2022-06-20 16:20:25 source > 2022-06-20 16:20:25 INFO i.d.j.JdbcConnection(lambda$doClose$3):945 - Connection gracefully closed
2022-06-20 16:20:25 source > 2022-06-20 16:20:25 INFO i.a.i.d.i.DebeziumRecordPublisher(lambda$start$1):85 - Debezium engine shutdown.
2022-06-20 16:20:25 source > 2022-06-20 16:20:25 INFO i.a.i.s.p.PostgresCdcStateHandler(saveState):31 - debezium state: {"{\"schema\":null,\"payload\":[\"checkmate\",{\"server\":\"checkmate\"}]}":"{\"last_snapshot_record\":true,\"lsn\":360862204232,\"txId\":19622750,\"ts_usec\":1655742023889000,\"snapshot\":true}"}
2022-06-20 16:20:25 source > 2022-06-20 16:20:25 INFO i.a.i.s.r.AbstractDbSource(lambda$read$2):130 - Closing database connection pool.
2022-06-20 16:20:25 source > 2022-06-20 16:20:25 INFO c.z.h.HikariDataSource(close):350 - HikariPool-2 - Shutdown initiated...
2022-06-20 16:20:25 source > 2022-06-20 16:20:25 INFO c.z.h.HikariDataSource(close):352 - HikariPool-2 - Shutdown completed.
2022-06-20 16:20:25 source > 2022-06-20 16:20:25 INFO i.a.i.s.r.AbstractDbSource(lambda$read$2):132 - Closed database connection pool.
2022-06-20 16:20:25 source > 2022-06-20 16:20:25 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2022-06-20 16:20:25 source > 2022-06-20 16:20:25 INFO i.a.i.s.p.PostgresSource(main):411 - completed source: class io.airbyte.integrations.source.postgres.PostgresSource
2022-06-20 16:20:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):347 - Source has no more messages, closing connection.
2022-06-20 16:20:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):355 - Total records read: 20 (419 KB)
2022-06-20 16:20:26 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):358 - Schema validation errors found for stream publicdeposit. Error messages: [$.micr is of an incorrect type. Expected it to be string, $.timestamp_de is of an incorrect type. Expected it to be string, $.date_processed is of an incorrect type. Expected it to be date-time, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string]
2022-06-20 16:20:26 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):358 - Schema validation errors found for stream publicvendor_config. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string]
2022-06-20 16:20:26 INFO i.a.w.g.DefaultReplicationWorker(run):174 - One of source or destination thread complete. Waiting on the other.
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):55 - Starting a new buffer for stream vendor_config (current state: 419 KB in 1 buffers)
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 - Default schema.
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded.
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO i.a.i.d.b.BufferedStreamConsumer(close):170 - executing on success close procedure.
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):92 - Flushing all 2 current buffers (419 KB in total)
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$flushAll$2):95 - Flushing buffer of stream vendor_config (331 bytes)
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):115 - Flushing buffer for stream vendor_config (331 bytes) to staging
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 - Finished writing data to 3f00231d-894e-45ca-bda7-003f852d10ec451361898386054765.avro (772 bytes)
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):108 - Uploading records to staging for stream vendor_config (dataset raw_checkmate): airbyte/raw_checkmate_vendor_config/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro with full ID ABPnzm6eRlEfGInUHD3qVKLM8S7wHp5FpjVmy2df5MmBi1LsuSJBWZgxU5IvlqNv0GxUsCk
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000]
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO a.m.s.StreamTransferManager(complete):367 - [Manager uploading to synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro with id ABPnzm6eR...Nv0GxUsCk]: Uploading leftover stream [Part number 1 containing 0.00 MB]
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro with id ABPnzm6eR...Nv0GxUsCk]: Finished uploading [Part number 1 containing 0.00 MB]
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro with id ABPnzm6eR...Nv0GxUsCk]: Completed
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):178 - Uploaded buffer file to storage: 3f00231d-894e-45ca-bda7-003f852d10ec451361898386054765.avro -> airbyte/raw_checkmate_vendor_config/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro (filename: 1.avro)
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):53 - Added staged file: 1.avro
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO i.a.i.d.r.FileBuffer(deleteFile):81 - Deleting tempFile data 3f00231d-894e-45ca-bda7-003f852d10ec451361898386054765.avro
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$flushAll$2):95 - Flushing buffer of stream deposit (420 KB)
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):115 - Flushing buffer for stream deposit (420 KB) to staging
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 - Finished writing data to 7913aecf-cf2a-4865-9e6c-85efbf0e88b713432433835337511934.avro (420 KB)
2022-06-20 16:20:26 destination > 2022-06-20 16:20:26 INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):108 - Uploading records to staging for stream deposit (dataset raw_checkmate): airbyte/raw_checkmate_deposit/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/
2022-06-20 16:20:27 destination > 2022-06-20 16:20:27 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro with full ID ABPnzm4-sGOIb6ys0J4TCGqqvZjIPtuSnmVxbkVBMgYEQ1oBxITqy08Y_ILXT47Gx3J4uvA
2022-06-20 16:20:27 destination > 2022-06-20 16:20:27 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000]
2022-06-20 16:20:27 destination > 2022-06-20 16:20:27 INFO a.m.s.StreamTransferManager(complete):367 - [Manager uploading to synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro with id ABPnzm4-s...7Gx3J4uvA]: Uploading leftover stream [Part number 1 containing 0.41 MB]
2022-06-20 16:20:27 destination > 2022-06-20 16:20:27 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro with id ABPnzm4-s...7Gx3J4uvA]: Finished uploading [Part number 1 containing 0.41 MB]
2022-06-20 16:20:27 destination > 2022-06-20 16:20:27 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro with id ABPnzm4-s...7Gx3J4uvA]: Completed
2022-06-20 16:20:27 destination > 2022-06-20 16:20:27 INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):178 - Uploaded buffer file to storage: 7913aecf-cf2a-4865-9e6c-85efbf0e88b713432433835337511934.avro -> airbyte/raw_checkmate_deposit/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro (filename: 1.avro)
2022-06-20 16:20:27 destination > 2022-06-20 16:20:27 INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):53 - Added staged file: 1.avro
2022-06-20 16:20:27 destination > 2022-06-20 16:20:27 INFO i.a.i.d.r.FileBuffer(deleteFile):81 - Deleting tempFile data 7913aecf-cf2a-4865-9e6c-85efbf0e88b713432433835337511934.avro
2022-06-20 16:20:27 destination > 2022-06-20 16:20:27 INFO i.a.i.d.r.SerializedBufferingStrategy(close):119 - Closing buffer for stream vendor_config
2022-06-20 16:20:27 destination > 2022-06-20 16:20:27 INFO i.a.i.d.r.SerializedBufferingStrategy(close):119 - Closing buffer for stream deposit
2022-06-20 16:20:27 destination > 2022-06-20 16:20:27 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):137 - Copying into tables in destination started for 4 streams
2022-06-20 16:20:27 destination > 2022-06-20 16:20:27 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTmpTableFromStage):122 - Uploading records from staging files to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_vxi_vendor_config}} (dataset raw_checkmate): [1.avro]
2022-06-20 16:20:27 destination > 2022-06-20 16:20:27 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):126 - Uploading staged file: gs://synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro
2022-06-20 16:20:27 destination > 2022-06-20 16:20:27 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):135 - [JobId{project=mainapi-282501, job=500bc040-09e4-45fa-9c0e-88b4c1bc1e19, location=US}] Created a new job to upload records to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_vxi_vendor_config}} (dataset raw_checkmate): Job{job=JobId{project=mainapi-282501, job=500bc040-09e4-45fa-9c0e-88b4c1bc1e19, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655742027757, endTime=null, startTime=1655742027880, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@mainapi-282501.iam.gserviceaccount.com, etag=N1acePQyXULG0xuPLtt7GQ==, generatedId=mainapi-282501:US.500bc040-09e4-45fa-9c0e-88b4c1bc1e19, selfLink=https://www.googleapis.com/bigquery/v2/projects/mainapi-282501/jobs/500bc040-09e4-45fa-9c0e-88b4c1bc1e19?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, projectId=mainapi-282501, tableId=_airbyte_tmp_vxi_vendor_config}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}
2022-06-20 16:20:27 destination > 2022-06-20 16:20:27 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Waiting for job finish Job{job=JobId{project=mainapi-282501, job=500bc040-09e4-45fa-9c0e-88b4c1bc1e19, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655742027757, endTime=null, startTime=1655742027880, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@mainapi-282501.iam.gserviceaccount.com, etag=N1acePQyXULG0xuPLtt7GQ==, generatedId=mainapi-282501:US.500bc040-09e4-45fa-9c0e-88b4c1bc1e19, selfLink=https://www.googleapis.com/bigquery/v2/projects/mainapi-282501/jobs/500bc040-09e4-45fa-9c0e-88b4c1bc1e19?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, projectId=mainapi-282501, tableId=_airbyte_tmp_vxi_vendor_config}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null}
2022-06-20 16:20:33 destination > 2022-06-20 16:20:33 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):329 - Job finish Job{job=JobId{project=mainapi-282501, job=500bc040-09e4-45fa-9c0e-88b4c1bc1e19, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655742027757, endTime=null, startTime=1655742027880, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@mainapi-282501.iam.gserviceaccount.com, etag=N1acePQyXULG0xuPLtt7GQ==, generatedId=mainapi-282501:US.500bc040-09e4-45fa-9c0e-88b4c1bc1e19, selfLink=https://www.googleapis.com/bigquery/v2/projects/mainapi-282501/jobs/500bc040-09e4-45fa-9c0e-88b4c1bc1e19?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, projectId=mainapi-282501, tableId=_airbyte_tmp_vxi_vendor_config}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null}
2022-06-20 16:20:33 destination > 2022-06-20 16:20:33 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):139 - [JobId{project=mainapi-282501, job=500bc040-09e4-45fa-9c0e-88b4c1bc1e19, location=US}] Tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_vxi_vendor_config}} (dataset raw_checkmate) is successfully appended with staging files
2022-06-20 16:20:33 destination > 2022-06-20 16:20:33 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTargetTable):162 - Copying data from tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_vxi_vendor_config}} to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_vendor_config}} (dataset raw_checkmate, sync mode append_dedup)
2022-06-20 16:20:36 destination > 2022-06-20 16:20:36 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_vxi_vendor_config}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_vendor_config}}
2022-06-20 16:20:36 destination > 2022-06-20 16:20:36 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTmpTableFromStage):122 - Uploading records from staging files to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_gtu_inbound_file_metadata}} (dataset raw_checkmate): []
2022-06-20 16:20:36 destination > 2022-06-20 16:20:36 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTargetTable):162 - Copying data from tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_gtu_inbound_file_metadata}} to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_inbound_file_metadata}} (dataset raw_checkmate, sync mode append_dedup)
2022-06-20 16:20:39 destination > 2022-06-20 16:20:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_gtu_inbound_file_metadata}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_inbound_file_metadata}}
2022-06-20 16:20:39 destination > 2022-06-20 16:20:39 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTmpTableFromStage):122 - Uploading records from staging files to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_hyd_deposit}} (dataset raw_checkmate): [1.avro]
2022-06-20 16:20:39 destination > 2022-06-20 16:20:39 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):126 - Uploading staged file: gs://synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro
2022-06-20 16:20:40 destination > 2022-06-20 16:20:40 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):135 - [JobId{project=mainapi-282501, job=8a5983e1-7b92-4e96-985d-d3e76e55c809, location=US}] Created a new job to upload records to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_hyd_deposit}} (dataset raw_checkmate): Job{job=JobId{project=mainapi-282501, job=8a5983e1-7b92-4e96-985d-d3e76e55c809, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655742039975, endTime=null, startTime=1655742040083, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@mainapi-282501.iam.gserviceaccount.com, etag=p2JT9ic7DIvRHVb/PBjwDw==, generatedId=mainapi-282501:US.8a5983e1-7b92-4e96-985d-d3e76e55c809, selfLink=https://www.googleapis.com/bigquery/v2/projects/mainapi-282501/jobs/8a5983e1-7b92-4e96-985d-d3e76e55c809?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, projectId=mainapi-282501, tableId=_airbyte_tmp_hyd_deposit}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}
2022-06-20 16:20:40 destination > 2022-06-20 16:20:40 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Waiting for job finish Job{job=JobId{project=mainapi-282501, job=8a5983e1-7b92-4e96-985d-d3e76e55c809, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655742039975, endTime=null, startTime=1655742040083, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@mainapi-282501.iam.gserviceaccount.com, etag=p2JT9ic7DIvRHVb/PBjwDw==, generatedId=mainapi-282501:US.8a5983e1-7b92-4e96-985d-d3e76e55c809, selfLink=https://www.googleapis.com/bigquery/v2/projects/mainapi-282501/jobs/8a5983e1-7b92-4e96-985d-d3e76e55c809?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, projectId=mainapi-282501, tableId=_airbyte_tmp_hyd_deposit}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null}
2022-06-20 16:20:48 destination > 2022-06-20 16:20:48 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):329 - Job finish Job{job=JobId{project=mainapi-282501, job=8a5983e1-7b92-4e96-985d-d3e76e55c809, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655742039975, endTime=null, startTime=1655742040083, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@mainapi-282501.iam.gserviceaccount.com, etag=p2JT9ic7DIvRHVb/PBjwDw==, generatedId=mainapi-282501:US.8a5983e1-7b92-4e96-985d-d3e76e55c809, selfLink=https://www.googleapis.com/bigquery/v2/projects/mainapi-282501/jobs/8a5983e1-7b92-4e96-985d-d3e76e55c809?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, projectId=mainapi-282501, tableId=_airbyte_tmp_hyd_deposit}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null}
2022-06-20 16:20:48 destination > 2022-06-20 16:20:48 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):139 - [JobId{project=mainapi-282501, job=8a5983e1-7b92-4e96-985d-d3e76e55c809, location=US}] Tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_hyd_deposit}} (dataset raw_checkmate) is successfully appended with staging files
2022-06-20 16:20:48 destination > 2022-06-20 16:20:48 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTargetTable):162 - Copying data from tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_hyd_deposit}} to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_deposit}} (dataset raw_checkmate, sync mode append_dedup)
2022-06-20 16:20:52 destination > 2022-06-20 16:20:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_hyd_deposit}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_deposit}}
2022-06-20 16:20:52 destination > 2022-06-20 16:20:52 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTmpTableFromStage):122 - Uploading records from staging files to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_wxv_bank_config}} (dataset raw_checkmate): []
2022-06-20 16:20:52 destination > 2022-06-20 16:20:52 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTargetTable):162 - Copying data from tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_wxv_bank_config}} to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_bank_config}} (dataset raw_checkmate, sync mode append_dedup)
2022-06-20 16:20:56 destination > 2022-06-20 16:20:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_wxv_bank_config}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_bank_config}}
2022-06-20 16:20:56 destination > 2022-06-20 16:20:56 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):156 - Finalizing tables in destination completed
2022-06-20 16:20:56 destination > 2022-06-20 16:20:56 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):159 - Cleaning up destination started for 4 streams
2022-06-20 16:20:56 destination > 2022-06-20 16:20:56 INFO i.a.i.d.b.BigQueryGcsOperations(dropTableIfExists):172 - Deleting tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_vxi_vendor_config}} (dataset raw_checkmate)
2022-06-20 16:20:56 destination > 2022-06-20 16:20:56 INFO i.a.i.d.b.BigQueryGcsOperations(dropStageIfExists):183 - Cleaning up staging path for stream vendor_config (dataset raw_checkmate): airbyte/raw_checkmate_vendor_config
2022-06-20 16:20:56 destination > 2022-06-20 16:20:56 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object airbyte/raw_checkmate_vendor_config/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/
2022-06-20 16:20:56 destination > 2022-06-20 16:20:56 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object airbyte/raw_checkmate_vendor_config/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro
2022-06-20 16:20:56 destination > 2022-06-20 16:20:56 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):270 - Storage bucket airbyte/raw_checkmate_vendor_config has been cleaned-up (2 objects were deleted)...
2022-06-20 16:20:56 destination > 2022-06-20 16:20:56 INFO i.a.i.d.b.BigQueryGcsOperations(dropTableIfExists):172 - Deleting tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_gtu_inbound_file_metadata}} (dataset raw_checkmate)
2022-06-20 16:20:56 destination > 2022-06-20 16:20:56 INFO i.a.i.d.b.BigQueryGcsOperations(dropStageIfExists):183 - Cleaning up staging path for stream inbound_file_metadata (dataset raw_checkmate): airbyte/raw_checkmate_inbound_file_metadata
2022-06-20 16:20:57 destination > 2022-06-20 16:20:57 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object airbyte/raw_checkmate_inbound_file_metadata/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/
2022-06-20 16:20:57 destination > 2022-06-20 16:20:57 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):270 - Storage bucket airbyte/raw_checkmate_inbound_file_metadata has been cleaned-up (1 objects were deleted)...
2022-06-20 16:20:57 destination > 2022-06-20 16:20:57 INFO i.a.i.d.b.BigQueryGcsOperations(dropTableIfExists):172 - Deleting tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_hyd_deposit}} (dataset raw_checkmate)
2022-06-20 16:20:57 destination > 2022-06-20 16:20:57 INFO i.a.i.d.b.BigQueryGcsOperations(dropStageIfExists):183 - Cleaning up staging path for stream deposit (dataset raw_checkmate): airbyte/raw_checkmate_deposit
2022-06-20 16:20:57 destination > 2022-06-20 16:20:57 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object airbyte/raw_checkmate_deposit/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/
2022-06-20 16:20:57 destination > 2022-06-20 16:20:57 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object airbyte/raw_checkmate_deposit/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/1.avro
2022-06-20 16:20:57 destination > 2022-06-20 16:20:57 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):270 - Storage bucket airbyte/raw_checkmate_deposit has been cleaned-up (2 objects were deleted)...
2022-06-20 16:20:57 destination > 2022-06-20 16:20:57 INFO i.a.i.d.b.BigQueryGcsOperations(dropTableIfExists):172 - Deleting tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_wxv_bank_config}} (dataset raw_checkmate)
2022-06-20 16:20:57 destination > 2022-06-20 16:20:57 INFO i.a.i.d.b.BigQueryGcsOperations(dropStageIfExists):183 - Cleaning up staging path for stream bank_config (dataset raw_checkmate): airbyte/raw_checkmate_bank_config
2022-06-20 16:20:57 destination > 2022-06-20 16:20:57 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object airbyte/raw_checkmate_bank_config/2022/06/20/16/d534ec7c-67fc-42d0-8c50-ab56ad143d5e/
2022-06-20 16:20:58 destination > 2022-06-20 16:20:58 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):270 - Storage bucket airbyte/raw_checkmate_bank_config has been cleaned-up (1 objects were deleted)...
2022-06-20 16:20:58 destination > 2022-06-20 16:20:58 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):164 - Cleaning up destination completed.
2022-06-20 16:20:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):405 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@5450e91d[type=STATE,log=<null>,spec=<null>,connectionStatus=<null>,catalog=<null>,record=<null>,state=io.airbyte.protocol.models.AirbyteStateMessage@5a970de7[stateType=<null>,stream=<null>,global=<null>,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"checkmate\",{\"server\":\"checkmate\"}]}":"{\"last_snapshot_record\":true,\"lsn\":360862204232,\"txId\":19622750,\"ts_usec\":1655742023889000,\"snapshot\":true}"}},"streams":[{"stream_name":"bank_config","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"deposit","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"inbound_file_metadata","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"vendor_config","stream_namespace":"public","cursor_field":["timestamp_ch"]}]},additionalProperties={streams=[]}],trace=<null>,additionalProperties={}]
2022-06-20 16:20:58 destination > 2022-06-20 16:20:58 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2022-06-20 16:20:58 INFO i.a.w.g.DefaultReplicationWorker(run):176 - Source and destination threads complete.
2022-06-20 16:20:58 INFO i.a.w.g.DefaultReplicationWorker(run):239 - sync summary: io.airbyte.config.ReplicationAttemptSummary@7e3aa2ee[status=completed,recordsSynced=19,bytesSynced=429449,startTime=1655742017001,endTime=1655742058228,totalStats=io.airbyte.config.SyncStats@70815734[recordsEmitted=19,bytesEmitted=429449,stateMessagesEmitted=1,recordsCommitted=19],streamStats=[io.airbyte.config.StreamSyncStats@16c518e1[streamName=vendor_config,stats=io.airbyte.config.SyncStats@7829f56[recordsEmitted=1,bytesEmitted=377,stateMessagesEmitted=<null>,recordsCommitted=1]], io.airbyte.config.StreamSyncStats@2c84709a[streamName=deposit,stats=io.airbyte.config.SyncStats@5646aac9[recordsEmitted=18,bytesEmitted=429072,stateMessagesEmitted=<null>,recordsCommitted=18]]]]
2022-06-20 16:20:58 INFO i.a.w.g.DefaultReplicationWorker(run):266 - Source output at least one state message
2022-06-20 16:20:58 INFO i.a.w.g.DefaultReplicationWorker(run):272 - State capture: Updated state to: Optional[io.airbyte.config.State@687ab2f0[state={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"checkmate\",{\"server\":\"checkmate\"}]}":"{\"last_snapshot_record\":true,\"lsn\":360862204232,\"txId\":19622750,\"ts_usec\":1655742023889000,\"snapshot\":true}"}},"streams":[{"stream_name":"bank_config","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"deposit","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"inbound_file_metadata","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"vendor_config","stream_namespace":"public","cursor_field":["timestamp_ch"]}]}]]
2022-06-20 16:20:58 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling...
2022-06-20 16:20:58 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):157 - sync summary: io.airbyte.config.StandardSyncOutput@244f4660[standardSyncSummary=io.airbyte.config.StandardSyncSummary@614ddc8d[status=completed,recordsSynced=19,bytesSynced=429449,startTime=1655742017001,endTime=1655742058228,totalStats=io.airbyte.config.SyncStats@70815734[recordsEmitted=19,bytesEmitted=429449,stateMessagesEmitted=1,recordsCommitted=19],streamStats=[io.airbyte.config.StreamSyncStats@16c518e1[streamName=vendor_config,stats=io.airbyte.config.SyncStats@7829f56[recordsEmitted=1,bytesEmitted=377,stateMessagesEmitted=<null>,recordsCommitted=1]], io.airbyte.config.StreamSyncStats@2c84709a[streamName=deposit,stats=io.airbyte.config.SyncStats@5646aac9[recordsEmitted=18,bytesEmitted=429072,stateMessagesEmitted=<null>,recordsCommitted=18]]]],normalizationSummary=<null>,state=io.airbyte.config.State@687ab2f0[state={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"checkmate\",{\"server\":\"checkmate\"}]}":"{\"last_snapshot_record\":true,\"lsn\":360862204232,\"txId\":19622750,\"ts_usec\":1655742023889000,\"snapshot\":true}"}},"streams":[{"stream_name":"bank_config","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"deposit","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"inbound_file_metadata","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"vendor_config","stream_namespace":"public","cursor_field":["timestamp_ch"]}]}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@7605b219[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@50e61f09[stream=io.airbyte.protocol.models.AirbyteStream@e442f33[name=bank_config,jsonSchema={"type":"object","properties":{"name":{"type":"string"},"bank_id":{"type":"number"},"_ab_cdc_lsn":{"type":"number"},"timestamp_ch":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"timestamp_cr":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"hold_duration":{"type":"number"},"bank_config_id":{"type":"string"},"vendor_bank_id":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"inbound_upload_path":{"type":"string"},"outbound_upload_path":{"type":"string"},"hold_amount_percentage":{"type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[bank_config_id]],namespace=raw_checkmate,additionalProperties={}],syncMode=incremental,cursorField=[timestamp_ch],destinationSyncMode=append_dedup,primaryKey=[[bank_config_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@16223c2[stream=io.airbyte.protocol.models.AirbyteStream@5aaccc8d[name=deposit,jsonSchema={"type":"object","properties":{"micr":{"type":"string"},"amount":{"type":"number"},"status":{"type":"string"},"bank_id":{"type":"number"},"currency":{"type":"string"},"party_id":{"type":"string"},"account_id":{"type":"string"},"deposit_id":{"type":"string"},"partner_id":{"type":"number"},"party_type":{"type":"string"},"_ab_cdc_lsn":{"type":"number"},"vendor_info":{"type":"string"},"check_amount":{"type":"number"},"check_number":{"type":"string"},"timestamp_ch":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"timestamp_cr":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"timestamp_de":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"back_image_id":{"type":"string"},"date_captured":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"account_number":{"type":"string"},"date_processed":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"front_image_id":{"type":"string"},"transaction_id":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"ocr_account_number":{"type":"string"},"vendor_reference_id":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[deposit_id]],namespace=raw_checkmate,additionalProperties={}],syncMode=incremental,cursorField=[timestamp_ch],destinationSyncMode=append_dedup,primaryKey=[[deposit_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@3ad28e86[stream=io.airbyte.protocol.models.AirbyteStream@15400358[name=inbound_file_metadata,jsonSchema={"type":"object","properties":{"file_hash":{"type":"string"},"file_name":{"type":"string"},"_ab_cdc_lsn":{"type":"number"},"timestamp_ch":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"timestamp_cr":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"inbound_file_metadata_id":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[inbound_file_metadata_id]],namespace=raw_checkmate,additionalProperties={}],syncMode=incremental,cursorField=[timestamp_ch],destinationSyncMode=append_dedup,primaryKey=[[inbound_file_metadata_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@52c5e01[stream=io.airbyte.protocol.models.AirbyteStream@39d8228d[name=vendor_config,jsonSchema={"type":"object","properties":{"name":{"type":"string"},"_ab_cdc_lsn":{"type":"number"},"timestamp_ch":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"timestamp_cr":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"vendor_config_id":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"inbound_upload_path":{"type":"string"},"outbound_upload_path":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[vendor_config_id]],namespace=raw_checkmate,additionalProperties={}],syncMode=incremental,cursorField=[timestamp_ch],destinationSyncMode=append_dedup,primaryKey=[[vendor_config_id]],additionalProperties={}]],additionalProperties={}],failures=[]]
2022-06-20 16:20:58 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):236 - Stopping temporal heartbeating...
2022-06-20 16:20:58 INFO i.a.c.p.ConfigRepository(updateConnectionState):775 - Updating connection 8b0bff81-e1b7-4b56-a2ee-9c2092d4763a state: io.airbyte.config.State@65242cfb[state={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"checkmate\",{\"server\":\"checkmate\"}]}":"{\"last_snapshot_record\":true,\"lsn\":360862204232,\"txId\":19622750,\"ts_usec\":1655742023889000,\"snapshot\":true}"}},"streams":[{"stream_name":"bank_config","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"deposit","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"inbound_file_metadata","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"vendor_config","stream_namespace":"public","cursor_field":["timestamp_ch"]}]}]
2022-06-20 16:20:58 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/81417/0/logs.log
2022-06-20 16:20:58 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.19-alpha
2022-06-20 16:20:58 INFO i.a.w.g.DefaultNormalizationWorker(run):49 - Running normalization.
2022-06-20 16:20:58 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):122 - Running with normalization version: airbyte/normalization:0.2.4
2022-06-20 16:20:58 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/normalization:0.2.4 exists...
2022-06-20 16:20:58 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/normalization:0.2.4 was found locally.
2022-06-20 16:20:58 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 81417
2022-06-20 16:20:58 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/81417/0/normalize --log-driver none --name normalization-normalize-81417-0-ouqja --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.39.19-alpha airbyte/normalization:0.2.4 run --integration-type bigquery --config destination_config.json --catalog destination_catalog.json
2022-06-20 16:20:58 normalization > Running: transform-config --config destination_config.json --integration-type bigquery --out /data/81417/0/normalize
2022-06-20 16:20:59 normalization > Namespace(config='destination_config.json', integration_type=<DestinationType.BIGQUERY: 'bigquery'>, out='/data/81417/0/normalize')
2022-06-20 16:20:59 normalization > transform_bigquery
2022-06-20 16:20:59 normalization > Running: transform-catalog --integration-type bigquery --profile-config-dir /data/81417/0/normalize --catalog destination_catalog.json --out /data/81417/0/normalize/models/generated/ --json-column _airbyte_data
2022-06-20 16:21:00 normalization > Processing destination_catalog.json...
2022-06-20 16:21:00 normalization >   Generating airbyte_ctes/raw_checkmate/bank_config_ab1.sql from bank_config
2022-06-20 16:21:00 normalization >   Generating airbyte_ctes/raw_checkmate/bank_config_ab2.sql from bank_config
2022-06-20 16:21:00 normalization >   Generating airbyte_views/raw_checkmate/bank_config_stg.sql from bank_config
2022-06-20 16:21:00 normalization >   Generating airbyte_incremental/scd/raw_checkmate/bank_config_scd.sql from bank_config
2022-06-20 16:21:00 normalization >   Generating airbyte_incremental/raw_checkmate/bank_config.sql from bank_config
2022-06-20 16:21:00 normalization >   Generating airbyte_ctes/raw_checkmate/deposit_ab1.sql from deposit
2022-06-20 16:21:00 normalization >   Generating airbyte_ctes/raw_checkmate/deposit_ab2.sql from deposit
2022-06-20 16:21:00 normalization >   Generating airbyte_views/raw_checkmate/deposit_stg.sql from deposit
2022-06-20 16:21:00 normalization >   Generating airbyte_incremental/scd/raw_checkmate/deposit_scd.sql from deposit
2022-06-20 16:21:00 normalization >   Generating airbyte_incremental/raw_checkmate/deposit.sql from deposit
2022-06-20 16:21:00 normalization >   Generating airbyte_ctes/raw_checkmate/inbound_file_metadata_ab1.sql from inbound_file_metadata
2022-06-20 16:21:00 normalization >   Generating airbyte_ctes/raw_checkmate/inbound_file_metadata_ab2.sql from inbound_file_metadata
2022-06-20 16:21:00 normalization >   Generating airbyte_views/raw_checkmate/inbound_file_metadata_stg.sql from inbound_file_metadata
2022-06-20 16:21:00 normalization >   Generating airbyte_incremental/scd/raw_checkmate/inbound_file_metadata_scd.sql from inbound_file_metadata
2022-06-20 16:21:00 normalization >   Generating airbyte_incremental/raw_checkmate/inbound_file_metadata.sql from inbound_file_metadata
2022-06-20 16:21:00 normalization >   Generating airbyte_ctes/raw_checkmate/vendor_config_ab1.sql from vendor_config
2022-06-20 16:21:00 normalization >   Generating airbyte_ctes/raw_checkmate/vendor_config_ab2.sql from vendor_config
2022-06-20 16:21:00 normalization >   Generating airbyte_views/raw_checkmate/vendor_config_stg.sql from vendor_config
2022-06-20 16:21:00 normalization >   Generating airbyte_incremental/scd/raw_checkmate/vendor_config_scd.sql from vendor_config
2022-06-20 16:21:00 normalization >   Generating airbyte_incremental/raw_checkmate/vendor_config.sql from vendor_config
2022-06-20 16:21:00 normalization > detected no config file for ssh, assuming ssh is off.
2022-06-20 16:21:04 normalization >            [--event-buffer-size EVENT_BUFFER_SIZE]
2022-06-20 16:21:04 normalization >   --event-buffer-size EVENT_BUFFER_SIZE
2022-06-20 16:21:04 normalization > 
2022-06-20 16:21:04 normalization > DBT >=1.0.0 detected; using 10K event buffer size
2022-06-20 16:21:04 normalization > 
2022-06-20 16:21:08 normalization > 16:21:08  Running with dbt=1.0.0
2022-06-20 16:21:08 normalization > 16:21:08  Partial parse save file not found. Starting full parse.
2022-06-20 16:21:11 normalization > 16:21:11  [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources.
2022-06-20 16:21:11 normalization > There are 1 unused configuration paths:
2022-06-20 16:21:11 normalization > - models.airbyte_utils.generated.airbyte_tables
2022-06-20 16:21:11 normalization > 
2022-06-20 16:21:11 normalization > 16:21:11  Found 20 models, 0 tests, 0 snapshots, 0 analyses, 548 macros, 0 operations, 0 seed files, 4 sources, 0 exposures, 0 metrics
2022-06-20 16:21:11 normalization > 16:21:11  
2022-06-20 16:21:11 normalization > 16:21:11  Concurrency: 8 threads (target='prod')
2022-06-20 16:21:11 normalization > 16:21:11  
2022-06-20 16:21:12 normalization > 16:21:12  1 of 12 START view model _airbyte_raw_checkmate.bank_config_stg......................................................... [RUN]
2022-06-20 16:21:12 normalization > 16:21:12  2 of 12 START view model _airbyte_raw_checkmate.vendor_config_stg....................................................... [RUN]
2022-06-20 16:21:12 normalization > 16:21:12  3 of 12 START view model _airbyte_raw_checkmate.inbound_file_metadata_stg............................................... [RUN]
2022-06-20 16:21:12 normalization > 16:21:12  4 of 12 START view model _airbyte_raw_checkmate.deposit_stg............................................................. [RUN]
2022-06-20 16:21:13 normalization > 16:21:13  1 of 12 OK created view model _airbyte_raw_checkmate.bank_config_stg.................................................... [OK in 1.06s]
2022-06-20 16:21:13 normalization > 16:21:13  5 of 12 START incremental model raw_checkmate.bank_config_scd........................................................... [RUN]
2022-06-20 16:21:13 normalization > 16:21:13  2 of 12 OK created view model _airbyte_raw_checkmate.vendor_config_stg.................................................. [OK in 1.06s]
2022-06-20 16:21:13 normalization > 16:21:13  4 of 12 OK created view model _airbyte_raw_checkmate.deposit_stg........................................................ [OK in 0.97s]
2022-06-20 16:21:13 normalization > 16:21:13  6 of 12 START incremental model raw_checkmate.vendor_config_scd......................................................... [RUN]
2022-06-20 16:21:13 normalization > 16:21:13  3 of 12 OK created view model _airbyte_raw_checkmate.inbound_file_metadata_stg.......................................... [OK in 1.10s]
2022-06-20 16:21:13 normalization > 16:21:13  7 of 12 START incremental model raw_checkmate.deposit_scd............................................................... [RUN]
2022-06-20 16:21:13 normalization > 16:21:13  8 of 12 START incremental model raw_checkmate.inbound_file_metadata_scd................................................. [RUN]
2022-06-20 16:21:13 normalization > 16:21:13  16:21:13 + `mainapi-282501`.raw_checkmate.`bank_config_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-06-20 16:21:13 normalization > 16:21:13  16:21:13 + `mainapi-282501`.raw_checkmate.`deposit_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-06-20 16:21:13 normalization > 16:21:13  16:21:13 + `mainapi-282501`.raw_checkmate.`vendor_config_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-06-20 16:21:13 normalization > 16:21:13  16:21:13 + `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-06-20 16:21:19 normalization > 16:21:19  7 of 12 ERROR creating incremental model raw_checkmate.deposit_scd...................................................... [ERROR in 6.54s]
2022-06-20 16:21:19 normalization > 16:21:19  9 of 12 SKIP relation raw_checkmate.deposit............................................................................. [SKIP]
2022-06-20 16:21:19 normalization > 16:21:19  5 of 12 OK created incremental model raw_checkmate.bank_config_scd...................................................... [CREATE TABLE (0.0 rows, 0 processed) in 6.81s]
2022-06-20 16:21:19 normalization > 16:21:19  10 of 12 START incremental model raw_checkmate.bank_config.............................................................. [RUN]
2022-06-20 16:21:20 normalization > 16:21:20  16:21:20 + `mainapi-282501`.raw_checkmate.`bank_config`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-06-20 16:21:20 normalization > 16:21:20  8 of 12 OK created incremental model raw_checkmate.inbound_file_metadata_scd............................................ [CREATE TABLE (0.0 rows, 0 processed) in 6.98s]
2022-06-20 16:21:20 normalization > 16:21:20  11 of 12 START incremental model raw_checkmate.inbound_file_metadata.................................................... [RUN]
2022-06-20 16:21:20 normalization > 16:21:20  16:21:20 + `mainapi-282501`.raw_checkmate.`inbound_file_metadata`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-06-20 16:21:20 normalization > 16:21:20  6 of 12 OK created incremental model raw_checkmate.vendor_config_scd.................................................... [CREATE TABLE (1.0 rows, 425.0 Bytes processed) in 7.55s]
2022-06-20 16:21:20 normalization > 16:21:20  12 of 12 START incremental model raw_checkmate.vendor_config............................................................ [RUN]
2022-06-20 16:21:20 normalization > 16:21:20  16:21:20 + `mainapi-282501`.raw_checkmate.`vendor_config`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-06-20 16:21:22 normalization > 16:21:22  10 of 12 OK created incremental model raw_checkmate.bank_config......................................................... [CREATE TABLE (0.0 rows, 0 processed) in 2.50s]
2022-06-20 16:21:22 normalization > 16:21:22  11 of 12 OK created incremental model raw_checkmate.inbound_file_metadata............................................... [CREATE TABLE (0.0 rows, 0 processed) in 2.45s]
2022-06-20 16:21:23 normalization > 16:21:23  12 of 12 OK created incremental model raw_checkmate.vendor_config....................................................... [CREATE TABLE (1.0 rows, 282.0 Bytes processed) in 2.45s]
2022-06-20 16:21:23 normalization > 16:21:23  
2022-06-20 16:21:23 normalization > 16:21:23  Finished running 4 view models, 8 incremental models in 12.13s.
2022-06-20 16:21:23 normalization > 16:21:23  
2022-06-20 16:21:23 normalization > 16:21:23  Completed with 1 error and 0 warnings:
2022-06-20 16:21:23 normalization > 16:21:23  
2022-06-20 16:21:23 normalization > 16:21:23  Database Error in model deposit_scd (models/generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql)
2022-06-20 16:21:23 normalization > 16:21:23    Invalid timestamp string "0000-12-30T00:00:00Z"
2022-06-20 16:21:23 normalization > 16:21:23    compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql
2022-06-20 16:21:23 normalization > 16:21:23  
2022-06-20 16:21:23 normalization > 16:21:23  Done. PASS=10 WARN=0 ERROR=1 SKIP=1 TOTAL=12
2022-06-20 16:21:23 normalization > 
2022-06-20 16:21:23 normalization > Diagnosing dbt debug to check if destination is available for dbt and well configured (1):
2022-06-20 16:21:23 normalization > 
2022-06-20 16:21:27 normalization > 16:21:27  Running with dbt=1.0.0
2022-06-20 16:21:27 normalization > dbt version: 1.0.0
2022-06-20 16:21:27 normalization > python version: 3.9.9
2022-06-20 16:21:27 normalization > python path: /usr/local/bin/python
2022-06-20 16:21:27 normalization > os info: Linux-5.13.0-1024-gcp-x86_64-with-glibc2.31
2022-06-20 16:21:27 normalization > Using profiles.yml file at /data/81417/0/normalize/profiles.yml
2022-06-20 16:21:27 normalization > Using dbt_project.yml file at /data/81417/0/normalize/dbt_project.yml
2022-06-20 16:21:27 normalization > 
2022-06-20 16:21:27 normalization > Configuration:
2022-06-20 16:21:27 normalization >   profiles.yml file [OK found and valid]
2022-06-20 16:21:27 normalization >   dbt_project.yml file [OK found and valid]
2022-06-20 16:21:27 normalization > 
2022-06-20 16:21:27 normalization > Required dependencies:
2022-06-20 16:21:27 normalization >  - git [OK found]
2022-06-20 16:21:27 normalization > 
2022-06-20 16:21:27 normalization > Connection:
2022-06-20 16:21:27 normalization >   method: service-account-json
2022-06-20 16:21:27 normalization >   database: mainapi-282501
2022-06-20 16:21:27 normalization >   schema: airbyte
2022-06-20 16:21:27 normalization >   location: US
2022-06-20 16:21:27 normalization >   priority: interactive
2022-06-20 16:21:27 normalization >   timeout_seconds: 300
2022-06-20 16:21:27 normalization >   maximum_bytes_billed: None
2022-06-20 16:21:27 normalization >   execution_project: mainapi-282501
2022-06-20 16:21:28 normalization >   Connection test: [OK connection ok]
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > All checks passed!
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > Forward dbt output logs to diagnose/debug errors (0):
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > ============================== 2022-06-20 16:21:08.191111 | c37bd190-dc6c-4f24-952f-9edeeb937444 ==============================
2022-06-20 16:21:28 normalization > 16:21:08.191111 [info ] [MainThread]: Running with dbt=1.0.0
2022-06-20 16:21:28 normalization > 16:21:08.192247 [debug] [MainThread]: running dbt with arguments Namespace(record_timing_info=None, debug=None, log_format=None, write_json=None, use_colors=None, printer_width=None, warn_error=None, version_check=None, partial_parse=None, single_threaded=False, use_experimental_parser=None, static_parser=None, profiles_dir='/data/81417/0/normalize', send_anonymous_usage_stats=None, fail_fast=None, event_buffer_size='10000', project_dir='/data/81417/0/normalize', profile=None, target=None, vars='{}', log_cache_events=False, threads=None, select=None, exclude=None, selector_name=None, state=None, defer=None, full_refresh=False, cls=<class 'dbt.task.run.RunTask'>, which='run', rpc_method='run')
2022-06-20 16:21:28 normalization > 16:21:08.192765 [debug] [MainThread]: Tracking: do not track
2022-06-20 16:21:28 normalization > 16:21:08.259010 [info ] [MainThread]: Partial parse save file not found. Starting full parse.
2022-06-20 16:21:28 normalization > 16:21:08.313315 [debug] [MainThread]: Parsing macros/configuration.sql
2022-06-20 16:21:28 normalization > 16:21:08.318841 [debug] [MainThread]: Parsing macros/should_full_refresh.sql
2022-06-20 16:21:28 normalization > 16:21:08.328780 [debug] [MainThread]: Parsing macros/incremental.sql
2022-06-20 16:21:28 normalization > 16:21:08.340260 [debug] [MainThread]: Parsing macros/get_custom_schema.sql
2022-06-20 16:21:28 normalization > 16:21:08.341541 [debug] [MainThread]: Parsing macros/star_intersect.sql
2022-06-20 16:21:28 normalization > 16:21:08.352246 [debug] [MainThread]: Parsing macros/schema_tests/equal_rowcount.sql
2022-06-20 16:21:28 normalization > 16:21:08.354494 [debug] [MainThread]: Parsing macros/schema_tests/equality.sql
2022-06-20 16:21:28 normalization > 16:21:08.366456 [debug] [MainThread]: Parsing macros/cross_db_utils/except.sql
2022-06-20 16:21:28 normalization > 16:21:08.368005 [debug] [MainThread]: Parsing macros/cross_db_utils/current_timestamp.sql
2022-06-20 16:21:28 normalization > 16:21:08.369011 [debug] [MainThread]: Parsing macros/cross_db_utils/columns.sql
2022-06-20 16:21:28 normalization > 16:21:08.374497 [debug] [MainThread]: Parsing macros/cross_db_utils/hash.sql
2022-06-20 16:21:28 normalization > 16:21:08.375812 [debug] [MainThread]: Parsing macros/cross_db_utils/json_operations.sql
2022-06-20 16:21:28 normalization > 16:21:08.450477 [debug] [MainThread]: Parsing macros/cross_db_utils/quote.sql
2022-06-20 16:21:28 normalization > 16:21:08.453439 [debug] [MainThread]: Parsing macros/cross_db_utils/type_conversions.sql
2022-06-20 16:21:28 normalization > 16:21:08.469016 [debug] [MainThread]: Parsing macros/cross_db_utils/surrogate_key.sql
2022-06-20 16:21:28 normalization > 16:21:08.473004 [debug] [MainThread]: Parsing macros/cross_db_utils/datatypes.sql
2022-06-20 16:21:28 normalization > 16:21:08.493038 [debug] [MainThread]: Parsing macros/cross_db_utils/concat.sql
2022-06-20 16:21:28 normalization > 16:21:08.496956 [debug] [MainThread]: Parsing macros/cross_db_utils/array.sql
2022-06-20 16:21:28 normalization > 16:21:08.523639 [debug] [MainThread]: Parsing macros/adapters.sql
2022-06-20 16:21:28 normalization > 16:21:08.570978 [debug] [MainThread]: Parsing macros/catalog.sql
2022-06-20 16:21:28 normalization > 16:21:08.583874 [debug] [MainThread]: Parsing macros/etc.sql
2022-06-20 16:21:28 normalization > 16:21:08.587385 [debug] [MainThread]: Parsing macros/materializations/table.sql
2022-06-20 16:21:28 normalization > 16:21:08.594614 [debug] [MainThread]: Parsing macros/materializations/copy.sql
2022-06-20 16:21:28 normalization > 16:21:08.599519 [debug] [MainThread]: Parsing macros/materializations/seed.sql
2022-06-20 16:21:28 normalization > 16:21:08.604600 [debug] [MainThread]: Parsing macros/materializations/incremental.sql
2022-06-20 16:21:28 normalization > 16:21:08.633887 [debug] [MainThread]: Parsing macros/materializations/view.sql
2022-06-20 16:21:28 normalization > 16:21:08.638927 [debug] [MainThread]: Parsing macros/materializations/snapshot.sql
2022-06-20 16:21:28 normalization > 16:21:08.642042 [debug] [MainThread]: Parsing macros/etc/statement.sql
2022-06-20 16:21:28 normalization > 16:21:08.650266 [debug] [MainThread]: Parsing macros/etc/datetime.sql
2022-06-20 16:21:28 normalization > 16:21:08.667390 [debug] [MainThread]: Parsing macros/materializations/configs.sql
2022-06-20 16:21:28 normalization > 16:21:08.671984 [debug] [MainThread]: Parsing macros/materializations/hooks.sql
2022-06-20 16:21:28 normalization > 16:21:08.680230 [debug] [MainThread]: Parsing macros/materializations/tests/where_subquery.sql
2022-06-20 16:21:28 normalization > 16:21:08.684171 [debug] [MainThread]: Parsing macros/materializations/tests/helpers.sql
2022-06-20 16:21:28 normalization > 16:21:08.687587 [debug] [MainThread]: Parsing macros/materializations/tests/test.sql
2022-06-20 16:21:28 normalization > 16:21:08.696569 [debug] [MainThread]: Parsing macros/materializations/seeds/seed.sql
2022-06-20 16:21:28 normalization > 16:21:08.708713 [debug] [MainThread]: Parsing macros/materializations/seeds/helpers.sql
2022-06-20 16:21:28 normalization > 16:21:08.742493 [debug] [MainThread]: Parsing macros/materializations/models/table/table.sql
2022-06-20 16:21:28 normalization > 16:21:08.756396 [debug] [MainThread]: Parsing macros/materializations/models/table/create_table_as.sql
2022-06-20 16:21:28 normalization > 16:21:08.761754 [debug] [MainThread]: Parsing macros/materializations/models/incremental/incremental.sql
2022-06-20 16:21:28 normalization > 16:21:08.782620 [debug] [MainThread]: Parsing macros/materializations/models/incremental/column_helpers.sql
2022-06-20 16:21:28 normalization > 16:21:08.791388 [debug] [MainThread]: Parsing macros/materializations/models/incremental/merge.sql
2022-06-20 16:21:28 normalization > 16:21:08.813740 [debug] [MainThread]: Parsing macros/materializations/models/incremental/on_schema_change.sql
2022-06-20 16:21:28 normalization > 16:21:08.844912 [debug] [MainThread]: Parsing macros/materializations/models/incremental/is_incremental.sql
2022-06-20 16:21:28 normalization > 16:21:08.848003 [debug] [MainThread]: Parsing macros/materializations/models/view/create_or_replace_view.sql
2022-06-20 16:21:28 normalization > 16:21:08.853325 [debug] [MainThread]: Parsing macros/materializations/models/view/create_view_as.sql
2022-06-20 16:21:28 normalization > 16:21:08.857378 [debug] [MainThread]: Parsing macros/materializations/models/view/view.sql
2022-06-20 16:21:28 normalization > 16:21:08.870452 [debug] [MainThread]: Parsing macros/materializations/models/view/helpers.sql
2022-06-20 16:21:28 normalization > 16:21:08.873078 [debug] [MainThread]: Parsing macros/materializations/snapshots/snapshot_merge.sql
2022-06-20 16:21:28 normalization > 16:21:08.876113 [debug] [MainThread]: Parsing macros/materializations/snapshots/snapshot.sql
2022-06-20 16:21:28 normalization > 16:21:08.899417 [debug] [MainThread]: Parsing macros/materializations/snapshots/helpers.sql
2022-06-20 16:21:28 normalization > 16:21:08.922568 [debug] [MainThread]: Parsing macros/materializations/snapshots/strategies.sql
2022-06-20 16:21:28 normalization > 16:21:08.954003 [debug] [MainThread]: Parsing macros/adapters/persist_docs.sql
2022-06-20 16:21:28 normalization > 16:21:08.962154 [debug] [MainThread]: Parsing macros/adapters/columns.sql
2022-06-20 16:21:28 normalization > 16:21:08.980653 [debug] [MainThread]: Parsing macros/adapters/indexes.sql
2022-06-20 16:21:28 normalization > 16:21:08.985659 [debug] [MainThread]: Parsing macros/adapters/relation.sql
2022-06-20 16:21:28 normalization > 16:21:09.006968 [debug] [MainThread]: Parsing macros/adapters/schema.sql
2022-06-20 16:21:28 normalization > 16:21:09.013664 [debug] [MainThread]: Parsing macros/adapters/freshness.sql
2022-06-20 16:21:28 normalization > 16:21:09.022177 [debug] [MainThread]: Parsing macros/adapters/metadata.sql
2022-06-20 16:21:28 normalization > 16:21:09.042121 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_database.sql
2022-06-20 16:21:28 normalization > 16:21:09.045212 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_schema.sql
2022-06-20 16:21:28 normalization > 16:21:09.050190 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_alias.sql
2022-06-20 16:21:28 normalization > 16:21:09.053084 [debug] [MainThread]: Parsing macros/generic_test_sql/not_null.sql
2022-06-20 16:21:28 normalization > 16:21:09.054165 [debug] [MainThread]: Parsing macros/generic_test_sql/accepted_values.sql
2022-06-20 16:21:28 normalization > 16:21:09.056688 [debug] [MainThread]: Parsing macros/generic_test_sql/unique.sql
2022-06-20 16:21:28 normalization > 16:21:09.058010 [debug] [MainThread]: Parsing macros/generic_test_sql/relationships.sql
2022-06-20 16:21:28 normalization > 16:21:09.059709 [debug] [MainThread]: Parsing tests/generic/builtin.sql
2022-06-20 16:21:28 normalization > 16:21:09.065189 [debug] [MainThread]: Parsing macros/web/get_url_path.sql
2022-06-20 16:21:28 normalization > 16:21:09.070122 [debug] [MainThread]: Parsing macros/web/get_url_host.sql
2022-06-20 16:21:28 normalization > 16:21:09.073931 [debug] [MainThread]: Parsing macros/web/get_url_parameter.sql
2022-06-20 16:21:28 normalization > 16:21:09.076830 [debug] [MainThread]: Parsing macros/materializations/insert_by_period_materialization.sql
2022-06-20 16:21:28 normalization > 16:21:09.125571 [debug] [MainThread]: Parsing macros/schema_tests/test_not_null_where.sql
2022-06-20 16:21:28 normalization > 16:21:09.128467 [debug] [MainThread]: Parsing macros/schema_tests/test_unique_where.sql
2022-06-20 16:21:28 normalization > 16:21:09.131145 [debug] [MainThread]: Parsing macros/schema_tests/at_least_one.sql
2022-06-20 16:21:28 normalization > 16:21:09.133395 [debug] [MainThread]: Parsing macros/schema_tests/not_constant.sql
2022-06-20 16:21:28 normalization > 16:21:09.135538 [debug] [MainThread]: Parsing macros/schema_tests/expression_is_true.sql
2022-06-20 16:21:28 normalization > 16:21:09.138692 [debug] [MainThread]: Parsing macros/schema_tests/recency.sql
2022-06-20 16:21:28 normalization > 16:21:09.141744 [debug] [MainThread]: Parsing macros/schema_tests/equal_rowcount.sql
2022-06-20 16:21:28 normalization > 16:21:09.144637 [debug] [MainThread]: Parsing macros/schema_tests/not_null_proportion.sql
2022-06-20 16:21:28 normalization > 16:21:09.148513 [debug] [MainThread]: Parsing macros/schema_tests/accepted_range.sql
2022-06-20 16:21:28 normalization > 16:21:09.153570 [debug] [MainThread]: Parsing macros/schema_tests/not_accepted_values.sql
2022-06-20 16:21:28 normalization > 16:21:09.157407 [debug] [MainThread]: Parsing macros/schema_tests/cardinality_equality.sql
2022-06-20 16:21:28 normalization > 16:21:09.161051 [debug] [MainThread]: Parsing macros/schema_tests/unique_combination_of_columns.sql
2022-06-20 16:21:28 normalization > 16:21:09.166167 [debug] [MainThread]: Parsing macros/schema_tests/mutually_exclusive_ranges.sql
2022-06-20 16:21:28 normalization > 16:21:09.184236 [debug] [MainThread]: Parsing macros/schema_tests/fewer_rows_than.sql
2022-06-20 16:21:28 normalization > 16:21:09.187613 [debug] [MainThread]: Parsing macros/schema_tests/equality.sql
2022-06-20 16:21:28 normalization > 16:21:09.194193 [debug] [MainThread]: Parsing macros/schema_tests/relationships_where.sql
2022-06-20 16:21:28 normalization > 16:21:09.198435 [debug] [MainThread]: Parsing macros/schema_tests/sequential_values.sql
2022-06-20 16:21:28 normalization > 16:21:09.204021 [debug] [MainThread]: Parsing macros/cross_db_utils/except.sql
2022-06-20 16:21:28 normalization > 16:21:09.205978 [debug] [MainThread]: Parsing macros/cross_db_utils/length.sql
2022-06-20 16:21:28 normalization > 16:21:09.208207 [debug] [MainThread]: Parsing macros/cross_db_utils/position.sql
2022-06-20 16:21:28 normalization > 16:21:09.210882 [debug] [MainThread]: Parsing macros/cross_db_utils/current_timestamp.sql
2022-06-20 16:21:28 normalization > 16:21:09.217144 [debug] [MainThread]: Parsing macros/cross_db_utils/intersect.sql
2022-06-20 16:21:28 normalization > 16:21:09.219224 [debug] [MainThread]: Parsing macros/cross_db_utils/replace.sql
2022-06-20 16:21:28 normalization > 16:21:09.221316 [debug] [MainThread]: Parsing macros/cross_db_utils/escape_single_quotes.sql
2022-06-20 16:21:28 normalization > 16:21:09.224380 [debug] [MainThread]: Parsing macros/cross_db_utils/any_value.sql
2022-06-20 16:21:28 normalization > 16:21:09.226554 [debug] [MainThread]: Parsing macros/cross_db_utils/last_day.sql
2022-06-20 16:21:28 normalization > 16:21:09.232644 [debug] [MainThread]: Parsing macros/cross_db_utils/cast_bool_to_text.sql
2022-06-20 16:21:28 normalization > 16:21:09.235123 [debug] [MainThread]: Parsing macros/cross_db_utils/dateadd.sql
2022-06-20 16:21:28 normalization > 16:21:09.240310 [debug] [MainThread]: Parsing macros/cross_db_utils/literal.sql
2022-06-20 16:21:28 normalization > 16:21:09.241957 [debug] [MainThread]: Parsing macros/cross_db_utils/safe_cast.sql
2022-06-20 16:21:28 normalization > 16:21:09.245131 [debug] [MainThread]: Parsing macros/cross_db_utils/date_trunc.sql
2022-06-20 16:21:28 normalization > 16:21:09.247846 [debug] [MainThread]: Parsing macros/cross_db_utils/bool_or.sql
2022-06-20 16:21:28 normalization > 16:21:09.250661 [debug] [MainThread]: Parsing macros/cross_db_utils/width_bucket.sql
2022-06-20 16:21:28 normalization > 16:21:09.260732 [debug] [MainThread]: Parsing macros/cross_db_utils/hash.sql
2022-06-20 16:21:28 normalization > 16:21:09.263285 [debug] [MainThread]: Parsing macros/cross_db_utils/_is_ephemeral.sql
2022-06-20 16:21:28 normalization > 16:21:09.266772 [debug] [MainThread]: Parsing macros/cross_db_utils/_is_relation.sql
2022-06-20 16:21:28 normalization > 16:21:09.268762 [debug] [MainThread]: Parsing macros/cross_db_utils/right.sql
2022-06-20 16:21:28 normalization > 16:21:09.272804 [debug] [MainThread]: Parsing macros/cross_db_utils/split_part.sql
2022-06-20 16:21:28 normalization > 16:21:09.276061 [debug] [MainThread]: Parsing macros/cross_db_utils/datediff.sql
2022-06-20 16:21:28 normalization > 16:21:09.296002 [debug] [MainThread]: Parsing macros/cross_db_utils/datatypes.sql
2022-06-20 16:21:28 normalization > 16:21:09.306671 [debug] [MainThread]: Parsing macros/cross_db_utils/concat.sql
2022-06-20 16:21:28 normalization > 16:21:09.308447 [debug] [MainThread]: Parsing macros/cross_db_utils/identifier.sql
2022-06-20 16:21:28 normalization > 16:21:09.311333 [debug] [MainThread]: Parsing macros/sql/get_tables_by_prefix_sql.sql
2022-06-20 16:21:28 normalization > 16:21:09.314798 [debug] [MainThread]: Parsing macros/sql/get_column_values.sql
2022-06-20 16:21:28 normalization > 16:21:09.324154 [debug] [MainThread]: Parsing macros/sql/get_query_results_as_dict.sql
2022-06-20 16:21:28 normalization > 16:21:09.328287 [debug] [MainThread]: Parsing macros/sql/get_relations_by_pattern.sql
2022-06-20 16:21:28 normalization > 16:21:09.334378 [debug] [MainThread]: Parsing macros/sql/get_relations_by_prefix.sql
2022-06-20 16:21:28 normalization > 16:21:09.340602 [debug] [MainThread]: Parsing macros/sql/haversine_distance.sql
2022-06-20 16:21:28 normalization > 16:21:09.351588 [debug] [MainThread]: Parsing macros/sql/get_tables_by_pattern_sql.sql
2022-06-20 16:21:28 normalization > 16:21:09.363492 [debug] [MainThread]: Parsing macros/sql/pivot.sql
2022-06-20 16:21:28 normalization > 16:21:09.371038 [debug] [MainThread]: Parsing macros/sql/date_spine.sql
2022-06-20 16:21:28 normalization > 16:21:09.379035 [debug] [MainThread]: Parsing macros/sql/star.sql
2022-06-20 16:21:28 normalization > 16:21:09.387204 [debug] [MainThread]: Parsing macros/sql/union.sql
2022-06-20 16:21:28 normalization > 16:21:09.407384 [debug] [MainThread]: Parsing macros/sql/get_table_types_sql.sql
2022-06-20 16:21:28 normalization > 16:21:09.410079 [debug] [MainThread]: Parsing macros/sql/safe_add.sql
2022-06-20 16:21:28 normalization > 16:21:09.413364 [debug] [MainThread]: Parsing macros/sql/surrogate_key.sql
2022-06-20 16:21:28 normalization > 16:21:09.419913 [debug] [MainThread]: Parsing macros/sql/groupby.sql
2022-06-20 16:21:28 normalization > 16:21:09.422572 [debug] [MainThread]: Parsing macros/sql/generate_series.sql
2022-06-20 16:21:28 normalization > 16:21:09.430421 [debug] [MainThread]: Parsing macros/sql/nullcheck.sql
2022-06-20 16:21:28 normalization > 16:21:09.433396 [debug] [MainThread]: Parsing macros/sql/unpivot.sql
2022-06-20 16:21:28 normalization > 16:21:09.448379 [debug] [MainThread]: Parsing macros/sql/nullcheck_table.sql
2022-06-20 16:21:28 normalization > 16:21:09.451475 [debug] [MainThread]: Parsing macros/jinja_helpers/log_info.sql
2022-06-20 16:21:28 normalization > 16:21:09.453466 [debug] [MainThread]: Parsing macros/jinja_helpers/pretty_time.sql
2022-06-20 16:21:28 normalization > 16:21:09.455589 [debug] [MainThread]: Parsing macros/jinja_helpers/slugify.sql
2022-06-20 16:21:28 normalization > 16:21:09.457621 [debug] [MainThread]: Parsing macros/jinja_helpers/pretty_log_format.sql
2022-06-20 16:21:28 normalization > 16:21:10.208628 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/raw_checkmate/vendor_config_scd.sql
2022-06-20 16:21:28 normalization > 16:21:10.297185 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/raw_checkmate/vendor_config_scd.sql
2022-06-20 16:21:28 normalization > 16:21:10.300297 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/raw_checkmate/bank_config_scd.sql
2022-06-20 16:21:28 normalization > 16:21:10.336814 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/raw_checkmate/bank_config_scd.sql
2022-06-20 16:21:28 normalization > 16:21:10.339961 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql
2022-06-20 16:21:28 normalization > 16:21:10.376809 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql
2022-06-20 16:21:28 normalization > 16:21:10.379850 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/raw_checkmate/inbound_file_metadata_scd.sql
2022-06-20 16:21:28 normalization > 16:21:10.492611 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/raw_checkmate/inbound_file_metadata_scd.sql
2022-06-20 16:21:28 normalization > 16:21:10.495081 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/raw_checkmate/inbound_file_metadata.sql
2022-06-20 16:21:28 normalization > 16:21:10.512629 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/raw_checkmate/inbound_file_metadata.sql
2022-06-20 16:21:28 normalization > 16:21:10.514955 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/raw_checkmate/bank_config.sql
2022-06-20 16:21:28 normalization > 16:21:10.527543 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/raw_checkmate/bank_config.sql
2022-06-20 16:21:28 normalization > 16:21:10.529817 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/raw_checkmate/deposit.sql
2022-06-20 16:21:28 normalization > 16:21:10.541878 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/raw_checkmate/deposit.sql
2022-06-20 16:21:28 normalization > 16:21:10.544182 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/raw_checkmate/vendor_config.sql
2022-06-20 16:21:28 normalization > 16:21:10.556080 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/raw_checkmate/vendor_config.sql
2022-06-20 16:21:28 normalization > 16:21:10.560583 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/bank_config_ab2.sql
2022-06-20 16:21:28 normalization > 16:21:10.589729 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/bank_config_ab2.sql
2022-06-20 16:21:28 normalization > 16:21:10.592094 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/inbound_file_metadata_ab2.sql
2022-06-20 16:21:28 normalization > 16:21:10.609307 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/inbound_file_metadata_ab2.sql
2022-06-20 16:21:28 normalization > 16:21:10.611756 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/bank_config_ab1.sql
2022-06-20 16:21:28 normalization > 16:21:10.650583 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/bank_config_ab1.sql
2022-06-20 16:21:28 normalization > 16:21:10.653343 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/deposit_ab1.sql
2022-06-20 16:21:28 normalization > 16:21:10.702485 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/deposit_ab1.sql
2022-06-20 16:21:28 normalization > 16:21:10.704923 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/vendor_config_ab2.sql
2022-06-20 16:21:28 normalization > 16:21:10.723638 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/vendor_config_ab2.sql
2022-06-20 16:21:28 normalization > 16:21:10.726472 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/deposit_ab2.sql
2022-06-20 16:21:28 normalization > 16:21:10.758439 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/deposit_ab2.sql
2022-06-20 16:21:28 normalization > 16:21:10.760804 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/inbound_file_metadata_ab1.sql
2022-06-20 16:21:28 normalization > 16:21:10.783879 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/inbound_file_metadata_ab1.sql
2022-06-20 16:21:28 normalization > 16:21:10.786274 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/vendor_config_ab1.sql
2022-06-20 16:21:28 normalization > 16:21:10.809209 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/vendor_config_ab1.sql
2022-06-20 16:21:28 normalization > 16:21:10.811733 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/raw_checkmate/vendor_config_stg.sql
2022-06-20 16:21:28 normalization > 16:21:10.828115 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/raw_checkmate/vendor_config_stg.sql
2022-06-20 16:21:28 normalization > 16:21:10.830405 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/raw_checkmate/deposit_stg.sql
2022-06-20 16:21:28 normalization > 16:21:10.854171 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/raw_checkmate/deposit_stg.sql
2022-06-20 16:21:28 normalization > 16:21:10.856969 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/raw_checkmate/bank_config_stg.sql
2022-06-20 16:21:28 normalization > 16:21:10.874723 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/raw_checkmate/bank_config_stg.sql
2022-06-20 16:21:28 normalization > 16:21:10.876987 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/raw_checkmate/inbound_file_metadata_stg.sql
2022-06-20 16:21:28 normalization > 16:21:10.894839 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/raw_checkmate/inbound_file_metadata_stg.sql
2022-06-20 16:21:28 normalization > 16:21:11.014605 [warn ] [MainThread]: [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources.
2022-06-20 16:21:28 normalization > There are 1 unused configuration paths:
2022-06-20 16:21:28 normalization > - models.airbyte_utils.generated.airbyte_tables
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 16:21:11.045447 [info ] [MainThread]: Found 20 models, 0 tests, 0 snapshots, 0 analyses, 548 macros, 0 operations, 0 seed files, 4 sources, 0 exposures, 0 metrics
2022-06-20 16:21:28 normalization > 16:21:11.048725 [info ] [MainThread]: 
2022-06-20 16:21:28 normalization > 16:21:11.049951 [debug] [MainThread]: Acquiring new bigquery connection "master"
2022-06-20 16:21:28 normalization > 16:21:11.052521 [debug] [ThreadPool]: Acquiring new bigquery connection "list_mainapi-282501"
2022-06-20 16:21:28 normalization > 16:21:11.052897 [debug] [ThreadPool]: Opening a new connection, currently in state init
2022-06-20 16:21:28 normalization > 16:21:11.054448 [debug] [ThreadPool]: Acquiring new bigquery connection "list_mainapi-282501"
2022-06-20 16:21:28 normalization > 16:21:11.055012 [debug] [ThreadPool]: Opening a new connection, currently in state init
2022-06-20 16:21:28 normalization > 16:21:11.316383 [debug] [ThreadPool]: Acquiring new bigquery connection "create_mainapi-282501__airbyte_raw_checkmate"
2022-06-20 16:21:28 normalization > 16:21:11.317286 [debug] [ThreadPool]: Acquiring new bigquery connection "create_mainapi-282501__airbyte_raw_checkmate"
2022-06-20 16:21:28 normalization > 16:21:11.317532 [debug] [ThreadPool]: BigQuery adapter: Creating schema "mainapi-282501._airbyte_raw_checkmate".
2022-06-20 16:21:28 normalization > 16:21:11.317741 [debug] [ThreadPool]: Opening a new connection, currently in state closed
2022-06-20 16:21:28 normalization > 16:21:11.522796 [debug] [ThreadPool]: Acquiring new bigquery connection "list_mainapi-282501_raw_checkmate"
2022-06-20 16:21:28 normalization > 16:21:11.523854 [debug] [ThreadPool]: Acquiring new bigquery connection "list_mainapi-282501__airbyte_raw_checkmate"
2022-06-20 16:21:28 normalization > 16:21:11.524343 [debug] [ThreadPool]: Opening a new connection, currently in state closed
2022-06-20 16:21:28 normalization > 16:21:11.524642 [debug] [ThreadPool]: Opening a new connection, currently in state closed
2022-06-20 16:21:28 normalization > 16:21:11.655359 [info ] [MainThread]: Concurrency: 8 threads (target='prod')
2022-06-20 16:21:28 normalization > 16:21:11.655957 [info ] [MainThread]: 
2022-06-20 16:21:28 normalization > 16:21:11.682501 [debug] [Thread-1  ]: Began running node model.airbyte_utils.bank_config_ab1
2022-06-20 16:21:28 normalization > 16:21:11.682983 [debug] [Thread-2  ]: Began running node model.airbyte_utils.deposit_ab1
2022-06-20 16:21:28 normalization > 16:21:11.683938 [debug] [Thread-1  ]: Acquiring new bigquery connection "model.airbyte_utils.bank_config_ab1"
2022-06-20 16:21:28 normalization > 16:21:11.684205 [debug] [Thread-3  ]: Began running node model.airbyte_utils.inbound_file_metadata_ab1
2022-06-20 16:21:28 normalization > 16:21:11.684609 [debug] [Thread-4  ]: Began running node model.airbyte_utils.vendor_config_ab1
2022-06-20 16:21:28 normalization > 16:21:11.685609 [debug] [Thread-2  ]: Acquiring new bigquery connection "model.airbyte_utils.deposit_ab1"
2022-06-20 16:21:28 normalization > 16:21:11.685991 [debug] [Thread-1  ]: Began compiling node model.airbyte_utils.bank_config_ab1
2022-06-20 16:21:28 normalization > 16:21:11.686995 [debug] [Thread-3  ]: Acquiring new bigquery connection "model.airbyte_utils.inbound_file_metadata_ab1"
2022-06-20 16:21:28 normalization > 16:21:11.687912 [debug] [Thread-4  ]: Acquiring new bigquery connection "model.airbyte_utils.vendor_config_ab1"
2022-06-20 16:21:28 normalization > 16:21:11.688229 [debug] [Thread-2  ]: Began compiling node model.airbyte_utils.deposit_ab1
2022-06-20 16:21:28 normalization > 16:21:11.688579 [debug] [Thread-1  ]: Compiling model.airbyte_utils.bank_config_ab1
2022-06-20 16:21:28 normalization > 16:21:11.688912 [debug] [Thread-3  ]: Began compiling node model.airbyte_utils.inbound_file_metadata_ab1
2022-06-20 16:21:28 normalization > 16:21:11.689218 [debug] [Thread-4  ]: Began compiling node model.airbyte_utils.vendor_config_ab1
2022-06-20 16:21:28 normalization > 16:21:11.689532 [debug] [Thread-2  ]: Compiling model.airbyte_utils.deposit_ab1
2022-06-20 16:21:28 normalization > 16:21:11.710777 [debug] [Thread-3  ]: Compiling model.airbyte_utils.inbound_file_metadata_ab1
2022-06-20 16:21:28 normalization > 16:21:11.719763 [debug] [Thread-1  ]: Writing injected SQL for node "model.airbyte_utils.bank_config_ab1"
2022-06-20 16:21:28 normalization > 16:21:11.720369 [debug] [Thread-4  ]: Compiling model.airbyte_utils.vendor_config_ab1
2022-06-20 16:21:28 normalization > 16:21:11.777514 [debug] [Thread-3  ]: Writing injected SQL for node "model.airbyte_utils.inbound_file_metadata_ab1"
2022-06-20 16:21:28 normalization > 16:21:11.802154 [debug] [Thread-4  ]: Writing injected SQL for node "model.airbyte_utils.vendor_config_ab1"
2022-06-20 16:21:28 normalization > 16:21:11.826164 [debug] [Thread-1  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:11.824803 [debug] [Thread-2  ]: Writing injected SQL for node "model.airbyte_utils.deposit_ab1"
2022-06-20 16:21:28 normalization > 16:21:11.826743 [debug] [Thread-4  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:11.828060 [debug] [Thread-1  ]: Finished running node model.airbyte_utils.bank_config_ab1
2022-06-20 16:21:28 normalization > 16:21:11.828324 [debug] [Thread-3  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:11.829497 [debug] [Thread-4  ]: Finished running node model.airbyte_utils.vendor_config_ab1
2022-06-20 16:21:28 normalization > 16:21:11.829780 [debug] [Thread-2  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:11.830843 [debug] [Thread-6  ]: Began running node model.airbyte_utils.bank_config_ab2
2022-06-20 16:21:28 normalization > 16:21:11.831690 [debug] [Thread-3  ]: Finished running node model.airbyte_utils.inbound_file_metadata_ab1
2022-06-20 16:21:28 normalization > 16:21:11.833123 [debug] [Thread-2  ]: Finished running node model.airbyte_utils.deposit_ab1
2022-06-20 16:21:28 normalization > 16:21:11.833404 [debug] [Thread-8  ]: Began running node model.airbyte_utils.vendor_config_ab2
2022-06-20 16:21:28 normalization > 16:21:11.834441 [debug] [Thread-6  ]: Acquiring new bigquery connection "model.airbyte_utils.bank_config_ab2"
2022-06-20 16:21:28 normalization > 16:21:11.835300 [debug] [Thread-1  ]: Began running node model.airbyte_utils.inbound_file_metadata_ab2
2022-06-20 16:21:28 normalization > 16:21:11.836742 [debug] [Thread-8  ]: Acquiring new bigquery connection "model.airbyte_utils.vendor_config_ab2"
2022-06-20 16:21:28 normalization > 16:21:11.836987 [debug] [Thread-4  ]: Began running node model.airbyte_utils.deposit_ab2
2022-06-20 16:21:28 normalization > 16:21:11.837305 [debug] [Thread-6  ]: Began compiling node model.airbyte_utils.bank_config_ab2
2022-06-20 16:21:28 normalization > 16:21:11.838089 [debug] [Thread-1  ]: Acquiring new bigquery connection "model.airbyte_utils.inbound_file_metadata_ab2"
2022-06-20 16:21:28 normalization > 16:21:11.838441 [debug] [Thread-8  ]: Began compiling node model.airbyte_utils.vendor_config_ab2
2022-06-20 16:21:28 normalization > 16:21:11.839240 [debug] [Thread-4  ]: Acquiring new bigquery connection "model.airbyte_utils.deposit_ab2"
2022-06-20 16:21:28 normalization > 16:21:11.839575 [debug] [Thread-6  ]: Compiling model.airbyte_utils.bank_config_ab2
2022-06-20 16:21:28 normalization > 16:21:11.839867 [debug] [Thread-1  ]: Began compiling node model.airbyte_utils.inbound_file_metadata_ab2
2022-06-20 16:21:28 normalization > 16:21:11.840198 [debug] [Thread-8  ]: Compiling model.airbyte_utils.vendor_config_ab2
2022-06-20 16:21:28 normalization > 16:21:11.840510 [debug] [Thread-4  ]: Began compiling node model.airbyte_utils.deposit_ab2
2022-06-20 16:21:28 normalization > 16:21:11.861674 [debug] [Thread-1  ]: Compiling model.airbyte_utils.inbound_file_metadata_ab2
2022-06-20 16:21:28 normalization > 16:21:11.907854 [debug] [Thread-6  ]: Writing injected SQL for node "model.airbyte_utils.bank_config_ab2"
2022-06-20 16:21:28 normalization > 16:21:11.923935 [debug] [Thread-4  ]: Compiling model.airbyte_utils.deposit_ab2
2022-06-20 16:21:28 normalization > 16:21:11.935563 [debug] [Thread-8  ]: Writing injected SQL for node "model.airbyte_utils.vendor_config_ab2"
2022-06-20 16:21:28 normalization > 16:21:11.971613 [debug] [Thread-1  ]: Writing injected SQL for node "model.airbyte_utils.inbound_file_metadata_ab2"
2022-06-20 16:21:28 normalization > 16:21:11.982685 [debug] [Thread-6  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:12.015240 [debug] [Thread-8  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:12.021629 [debug] [Thread-6  ]: Finished running node model.airbyte_utils.bank_config_ab2
2022-06-20 16:21:28 normalization > 16:21:12.028187 [debug] [Thread-8  ]: Finished running node model.airbyte_utils.vendor_config_ab2
2022-06-20 16:21:28 normalization > 16:21:12.037847 [debug] [Thread-1  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:12.059180 [debug] [Thread-4  ]: Writing injected SQL for node "model.airbyte_utils.deposit_ab2"
2022-06-20 16:21:28 normalization > 16:21:12.059774 [debug] [Thread-3  ]: Began running node model.airbyte_utils.bank_config_stg
2022-06-20 16:21:28 normalization > 16:21:12.060781 [debug] [Thread-7  ]: Began running node model.airbyte_utils.vendor_config_stg
2022-06-20 16:21:28 normalization > 16:21:12.061755 [debug] [Thread-1  ]: Finished running node model.airbyte_utils.inbound_file_metadata_ab2
2022-06-20 16:21:28 normalization > 16:21:12.062578 [info ] [Thread-3  ]: 1 of 12 START view model _airbyte_raw_checkmate.bank_config_stg......................................................... [RUN]
2022-06-20 16:21:28 normalization > 16:21:12.063148 [info ] [Thread-7  ]: 2 of 12 START view model _airbyte_raw_checkmate.vendor_config_stg....................................................... [RUN]
2022-06-20 16:21:28 normalization > 16:21:12.063363 [debug] [Thread-4  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:12.064185 [debug] [Thread-6  ]: Began running node model.airbyte_utils.inbound_file_metadata_stg
2022-06-20 16:21:28 normalization > 16:21:12.065444 [debug] [Thread-3  ]: Acquiring new bigquery connection "model.airbyte_utils.bank_config_stg"
2022-06-20 16:21:28 normalization > 16:21:12.066759 [debug] [Thread-7  ]: Acquiring new bigquery connection "model.airbyte_utils.vendor_config_stg"
2022-06-20 16:21:28 normalization > 16:21:12.067679 [debug] [Thread-4  ]: Finished running node model.airbyte_utils.deposit_ab2
2022-06-20 16:21:28 normalization > 16:21:12.068135 [info ] [Thread-6  ]: 3 of 12 START view model _airbyte_raw_checkmate.inbound_file_metadata_stg............................................... [RUN]
2022-06-20 16:21:28 normalization > 16:21:12.068477 [debug] [Thread-3  ]: Began compiling node model.airbyte_utils.bank_config_stg
2022-06-20 16:21:28 normalization > 16:21:12.068784 [debug] [Thread-7  ]: Began compiling node model.airbyte_utils.vendor_config_stg
2022-06-20 16:21:28 normalization > 16:21:12.070598 [debug] [Thread-6  ]: Acquiring new bigquery connection "model.airbyte_utils.inbound_file_metadata_stg"
2022-06-20 16:21:28 normalization > 16:21:12.070899 [debug] [Thread-8  ]: Began running node model.airbyte_utils.deposit_stg
2022-06-20 16:21:28 normalization > 16:21:12.071260 [debug] [Thread-3  ]: Compiling model.airbyte_utils.bank_config_stg
2022-06-20 16:21:28 normalization > 16:21:12.071552 [debug] [Thread-7  ]: Compiling model.airbyte_utils.vendor_config_stg
2022-06-20 16:21:28 normalization > 16:21:12.071839 [debug] [Thread-6  ]: Began compiling node model.airbyte_utils.inbound_file_metadata_stg
2022-06-20 16:21:28 normalization > 16:21:12.072250 [info ] [Thread-8  ]: 4 of 12 START view model _airbyte_raw_checkmate.deposit_stg............................................................. [RUN]
2022-06-20 16:21:28 normalization > 16:21:12.135503 [debug] [Thread-6  ]: Compiling model.airbyte_utils.inbound_file_metadata_stg
2022-06-20 16:21:28 normalization > 16:21:12.157789 [debug] [Thread-3  ]: Writing injected SQL for node "model.airbyte_utils.bank_config_stg"
2022-06-20 16:21:28 normalization > 16:21:12.162011 [debug] [Thread-7  ]: Writing injected SQL for node "model.airbyte_utils.vendor_config_stg"
2022-06-20 16:21:28 normalization > 16:21:12.163635 [debug] [Thread-8  ]: Acquiring new bigquery connection "model.airbyte_utils.deposit_stg"
2022-06-20 16:21:28 normalization > 16:21:12.200805 [debug] [Thread-6  ]: Writing injected SQL for node "model.airbyte_utils.inbound_file_metadata_stg"
2022-06-20 16:21:28 normalization > 16:21:12.201608 [debug] [Thread-8  ]: Began compiling node model.airbyte_utils.deposit_stg
2022-06-20 16:21:28 normalization > 16:21:12.201978 [debug] [Thread-7  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:12.202856 [debug] [Thread-3  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:12.203171 [debug] [Thread-8  ]: Compiling model.airbyte_utils.deposit_stg
2022-06-20 16:21:28 normalization > 16:21:12.203613 [debug] [Thread-7  ]: Began executing node model.airbyte_utils.vendor_config_stg
2022-06-20 16:21:28 normalization > 16:21:12.203842 [debug] [Thread-6  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:12.204184 [debug] [Thread-3  ]: Began executing node model.airbyte_utils.bank_config_stg
2022-06-20 16:21:28 normalization > 16:21:12.288570 [debug] [Thread-6  ]: Began executing node model.airbyte_utils.inbound_file_metadata_stg
2022-06-20 16:21:28 normalization > 16:21:12.329551 [debug] [Thread-7  ]: Writing runtime SQL for node "model.airbyte_utils.vendor_config_stg"
2022-06-20 16:21:28 normalization > 16:21:12.419710 [debug] [Thread-6  ]: Writing runtime SQL for node "model.airbyte_utils.inbound_file_metadata_stg"
2022-06-20 16:21:28 normalization > 16:21:12.433512 [debug] [Thread-8  ]: Writing injected SQL for node "model.airbyte_utils.deposit_stg"
2022-06-20 16:21:28 normalization > 16:21:12.443995 [debug] [Thread-3  ]: Writing runtime SQL for node "model.airbyte_utils.bank_config_stg"
2022-06-20 16:21:28 normalization > 16:21:12.444664 [debug] [Thread-8  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:12.445771 [debug] [Thread-8  ]: Began executing node model.airbyte_utils.deposit_stg
2022-06-20 16:21:28 normalization > 16:21:12.451483 [debug] [Thread-3  ]: Opening a new connection, currently in state closed
2022-06-20 16:21:28 normalization > 16:21:12.456695 [debug] [Thread-8  ]: Writing runtime SQL for node "model.airbyte_utils.deposit_stg"
2022-06-20 16:21:28 normalization > 16:21:12.457031 [debug] [Thread-6  ]: Opening a new connection, currently in state closed
2022-06-20 16:21:28 normalization > 16:21:12.457323 [debug] [Thread-7  ]: Opening a new connection, currently in state init
2022-06-20 16:21:28 normalization > 16:21:12.458474 [debug] [Thread-8  ]: Opening a new connection, currently in state closed
2022-06-20 16:21:28 normalization > 16:21:12.466691 [debug] [Thread-3  ]: On model.airbyte_utils.bank_config_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.bank_config_stg"} */
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >   create or replace view `mainapi-282501`._airbyte_raw_checkmate.`bank_config_stg`
2022-06-20 16:21:28 normalization >   OPTIONS()
2022-06-20 16:21:28 normalization >   as 
2022-06-20 16:21:28 normalization > with __dbt__cte__bank_config_ab1 as (
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema
2022-06-20 16:21:28 normalization > -- depends_on: `mainapi-282501`.raw_checkmate._airbyte_raw_bank_config
2022-06-20 16:21:28 normalization > select
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['name']") as name,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['bank_id']") as bank_id,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_ch']") as timestamp_ch,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_cr']") as timestamp_cr,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['hold_duration']") as hold_duration,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['bank_config_id']") as bank_config_id,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['vendor_bank_id']") as vendor_bank_id,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['inbound_upload_path']") as inbound_upload_path,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['outbound_upload_path']") as outbound_upload_path,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['hold_amount_percentage']") as hold_amount_percentage,
2022-06-20 16:21:28 normalization >     _airbyte_ab_id,
2022-06-20 16:21:28 normalization >     _airbyte_emitted_at,
2022-06-20 16:21:28 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:21:28 normalization > from `mainapi-282501`.raw_checkmate._airbyte_raw_bank_config as table_alias
2022-06-20 16:21:28 normalization > -- bank_config
2022-06-20 16:21:28 normalization > where 1 = 1
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > ),  __dbt__cte__bank_config_ab2 as (
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type
2022-06-20 16:21:28 normalization > -- depends_on: __dbt__cte__bank_config_ab1
2022-06-20 16:21:28 normalization > select
2022-06-20 16:21:28 normalization >     cast(name as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as name,
2022-06-20 16:21:28 normalization >     cast(bank_id as 
2022-06-20 16:21:28 normalization >     float64
2022-06-20 16:21:28 normalization > ) as bank_id,
2022-06-20 16:21:28 normalization >     cast(_ab_cdc_lsn as 
2022-06-20 16:21:28 normalization >     float64
2022-06-20 16:21:28 normalization > ) as _ab_cdc_lsn,
2022-06-20 16:21:28 normalization >     cast(nullif(timestamp_ch, '') as 
2022-06-20 16:21:28 normalization >     timestamp
2022-06-20 16:21:28 normalization > ) as timestamp_ch,
2022-06-20 16:21:28 normalization >     cast(nullif(timestamp_cr, '') as 
2022-06-20 16:21:28 normalization >     timestamp
2022-06-20 16:21:28 normalization > ) as timestamp_cr,
2022-06-20 16:21:28 normalization >     cast(hold_duration as 
2022-06-20 16:21:28 normalization >     float64
2022-06-20 16:21:28 normalization > ) as hold_duration,
2022-06-20 16:21:28 normalization >     cast(bank_config_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as bank_config_id,
2022-06-20 16:21:28 normalization >     cast(vendor_bank_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as vendor_bank_id,
2022-06-20 16:21:28 normalization >     cast(_ab_cdc_deleted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as _ab_cdc_deleted_at,
2022-06-20 16:21:28 normalization >     cast(_ab_cdc_updated_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as _ab_cdc_updated_at,
2022-06-20 16:21:28 normalization >     cast(inbound_upload_path as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as inbound_upload_path,
2022-06-20 16:21:28 normalization >     cast(outbound_upload_path as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as outbound_upload_path,
2022-06-20 16:21:28 normalization >     cast(hold_amount_percentage as 
2022-06-20 16:21:28 normalization >     float64
2022-06-20 16:21:28 normalization > ) as hold_amount_percentage,
2022-06-20 16:21:28 normalization >     _airbyte_ab_id,
2022-06-20 16:21:28 normalization >     _airbyte_emitted_at,
2022-06-20 16:21:28 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:21:28 normalization > from __dbt__cte__bank_config_ab1
2022-06-20 16:21:28 normalization > -- bank_config
2022-06-20 16:21:28 normalization > where 1 = 1
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > )-- SQL model to build a hash column based on the values of this record
2022-06-20 16:21:28 normalization > -- depends_on: __dbt__cte__bank_config_ab2
2022-06-20 16:21:28 normalization > select
2022-06-20 16:21:28 normalization >     to_hex(md5(cast(concat(coalesce(cast(name as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(bank_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(timestamp_ch as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(timestamp_cr as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(hold_duration as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(bank_config_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(vendor_bank_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(inbound_upload_path as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(outbound_upload_path as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(hold_amount_percentage as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), '')) as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ))) as _airbyte_bank_config_hashid,
2022-06-20 16:21:28 normalization >     tmp.*
2022-06-20 16:21:28 normalization > from __dbt__cte__bank_config_ab2 tmp
2022-06-20 16:21:28 normalization > -- bank_config
2022-06-20 16:21:28 normalization > where 1 = 1
2022-06-20 16:21:28 normalization > ;
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 16:21:12.468757 [debug] [Thread-7  ]: On model.airbyte_utils.vendor_config_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.vendor_config_stg"} */
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >   create or replace view `mainapi-282501`._airbyte_raw_checkmate.`vendor_config_stg`
2022-06-20 16:21:28 normalization >   OPTIONS()
2022-06-20 16:21:28 normalization >   as 
2022-06-20 16:21:28 normalization > with __dbt__cte__vendor_config_ab1 as (
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema
2022-06-20 16:21:28 normalization > -- depends_on: `mainapi-282501`.raw_checkmate._airbyte_raw_vendor_config
2022-06-20 16:21:28 normalization > select
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['name']") as name,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_ch']") as timestamp_ch,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_cr']") as timestamp_cr,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['vendor_config_id']") as vendor_config_id,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['inbound_upload_path']") as inbound_upload_path,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['outbound_upload_path']") as outbound_upload_path,
2022-06-20 16:21:28 normalization >     _airbyte_ab_id,
2022-06-20 16:21:28 normalization >     _airbyte_emitted_at,
2022-06-20 16:21:28 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:21:28 normalization > from `mainapi-282501`.raw_checkmate._airbyte_raw_vendor_config as table_alias
2022-06-20 16:21:28 normalization > -- vendor_config
2022-06-20 16:21:28 normalization > where 1 = 1
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > ),  __dbt__cte__vendor_config_ab2 as (
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type
2022-06-20 16:21:28 normalization > -- depends_on: __dbt__cte__vendor_config_ab1
2022-06-20 16:21:28 normalization > select
2022-06-20 16:21:28 normalization >     cast(name as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as name,
2022-06-20 16:21:28 normalization >     cast(_ab_cdc_lsn as 
2022-06-20 16:21:28 normalization >     float64
2022-06-20 16:21:28 normalization > ) as _ab_cdc_lsn,
2022-06-20 16:21:28 normalization >     cast(nullif(timestamp_ch, '') as 
2022-06-20 16:21:28 normalization >     timestamp
2022-06-20 16:21:28 normalization > ) as timestamp_ch,
2022-06-20 16:21:28 normalization >     cast(nullif(timestamp_cr, '') as 
2022-06-20 16:21:28 normalization >     timestamp
2022-06-20 16:21:28 normalization > ) as timestamp_cr,
2022-06-20 16:21:28 normalization >     cast(vendor_config_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as vendor_config_id,
2022-06-20 16:21:28 normalization >     cast(_ab_cdc_deleted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as _ab_cdc_deleted_at,
2022-06-20 16:21:28 normalization >     cast(_ab_cdc_updated_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as _ab_cdc_updated_at,
2022-06-20 16:21:28 normalization >     cast(inbound_upload_path as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as inbound_upload_path,
2022-06-20 16:21:28 normalization >     cast(outbound_upload_path as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as outbound_upload_path,
2022-06-20 16:21:28 normalization >     _airbyte_ab_id,
2022-06-20 16:21:28 normalization >     _airbyte_emitted_at,
2022-06-20 16:21:28 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:21:28 normalization > from __dbt__cte__vendor_config_ab1
2022-06-20 16:21:28 normalization > -- vendor_config
2022-06-20 16:21:28 normalization > where 1 = 1
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > )-- SQL model to build a hash column based on the values of this record
2022-06-20 16:21:28 normalization > -- depends_on: __dbt__cte__vendor_config_ab2
2022-06-20 16:21:28 normalization > select
2022-06-20 16:21:28 normalization >     to_hex(md5(cast(concat(coalesce(cast(name as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(timestamp_ch as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(timestamp_cr as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(vendor_config_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(inbound_upload_path as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(outbound_upload_path as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), '')) as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ))) as _airbyte_vendor_config_hashid,
2022-06-20 16:21:28 normalization >     tmp.*
2022-06-20 16:21:28 normalization > from __dbt__cte__vendor_config_ab2 tmp
2022-06-20 16:21:28 normalization > -- vendor_config
2022-06-20 16:21:28 normalization > where 1 = 1
2022-06-20 16:21:28 normalization > ;
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 16:21:12.470549 [debug] [Thread-6  ]: On model.airbyte_utils.inbound_file_metadata_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.inbound_file_metadata_stg"} */
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >   create or replace view `mainapi-282501`._airbyte_raw_checkmate.`inbound_file_metadata_stg`
2022-06-20 16:21:28 normalization >   OPTIONS()
2022-06-20 16:21:28 normalization >   as 
2022-06-20 16:21:28 normalization > with __dbt__cte__inbound_file_metadata_ab1 as (
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema
2022-06-20 16:21:28 normalization > -- depends_on: `mainapi-282501`.raw_checkmate._airbyte_raw_inbound_file_metadata
2022-06-20 16:21:28 normalization > select
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['file_hash']") as file_hash,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['file_name']") as file_name,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_ch']") as timestamp_ch,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_cr']") as timestamp_cr,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['inbound_file_metadata_id']") as inbound_file_metadata_id,
2022-06-20 16:21:28 normalization >     _airbyte_ab_id,
2022-06-20 16:21:28 normalization >     _airbyte_emitted_at,
2022-06-20 16:21:28 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:21:28 normalization > from `mainapi-282501`.raw_checkmate._airbyte_raw_inbound_file_metadata as table_alias
2022-06-20 16:21:28 normalization > -- inbound_file_metadata
2022-06-20 16:21:28 normalization > where 1 = 1
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > ),  __dbt__cte__inbound_file_metadata_ab2 as (
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type
2022-06-20 16:21:28 normalization > -- depends_on: __dbt__cte__inbound_file_metadata_ab1
2022-06-20 16:21:28 normalization > select
2022-06-20 16:21:28 normalization >     cast(file_hash as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as file_hash,
2022-06-20 16:21:28 normalization >     cast(file_name as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as file_name,
2022-06-20 16:21:28 normalization >     cast(_ab_cdc_lsn as 
2022-06-20 16:21:28 normalization >     float64
2022-06-20 16:21:28 normalization > ) as _ab_cdc_lsn,
2022-06-20 16:21:28 normalization >     cast(nullif(timestamp_ch, '') as 
2022-06-20 16:21:28 normalization >     timestamp
2022-06-20 16:21:28 normalization > ) as timestamp_ch,
2022-06-20 16:21:28 normalization >     cast(nullif(timestamp_cr, '') as 
2022-06-20 16:21:28 normalization >     timestamp
2022-06-20 16:21:28 normalization > ) as timestamp_cr,
2022-06-20 16:21:28 normalization >     cast(_ab_cdc_deleted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as _ab_cdc_deleted_at,
2022-06-20 16:21:28 normalization >     cast(_ab_cdc_updated_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as _ab_cdc_updated_at,
2022-06-20 16:21:28 normalization >     cast(inbound_file_metadata_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as inbound_file_metadata_id,
2022-06-20 16:21:28 normalization >     _airbyte_ab_id,
2022-06-20 16:21:28 normalization >     _airbyte_emitted_at,
2022-06-20 16:21:28 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:21:28 normalization > from __dbt__cte__inbound_file_metadata_ab1
2022-06-20 16:21:28 normalization > -- inbound_file_metadata
2022-06-20 16:21:28 normalization > where 1 = 1
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > )-- SQL model to build a hash column based on the values of this record
2022-06-20 16:21:28 normalization > -- depends_on: __dbt__cte__inbound_file_metadata_ab2
2022-06-20 16:21:28 normalization > select
2022-06-20 16:21:28 normalization >     to_hex(md5(cast(concat(coalesce(cast(file_hash as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(file_name as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(timestamp_ch as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(timestamp_cr as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(inbound_file_metadata_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), '')) as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ))) as _airbyte_inbound_file_metadata_hashid,
2022-06-20 16:21:28 normalization >     tmp.*
2022-06-20 16:21:28 normalization > from __dbt__cte__inbound_file_metadata_ab2 tmp
2022-06-20 16:21:28 normalization > -- inbound_file_metadata
2022-06-20 16:21:28 normalization > where 1 = 1
2022-06-20 16:21:28 normalization > ;
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 16:21:12.471054 [debug] [Thread-8  ]: On model.airbyte_utils.deposit_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.deposit_stg"} */
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >   create or replace view `mainapi-282501`._airbyte_raw_checkmate.`deposit_stg`
2022-06-20 16:21:28 normalization >   OPTIONS()
2022-06-20 16:21:28 normalization >   as 
2022-06-20 16:21:28 normalization > with __dbt__cte__deposit_ab1 as (
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema
2022-06-20 16:21:28 normalization > -- depends_on: `mainapi-282501`.raw_checkmate._airbyte_raw_deposit
2022-06-20 16:21:28 normalization > select
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['micr']") as micr,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['amount']") as amount,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['status']") as status,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['bank_id']") as bank_id,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['currency']") as currency,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['party_id']") as party_id,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['account_id']") as account_id,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['deposit_id']") as deposit_id,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['partner_id']") as partner_id,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['party_type']") as party_type,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['vendor_info']") as vendor_info,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['check_amount']") as check_amount,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['check_number']") as check_number,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_ch']") as timestamp_ch,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_cr']") as timestamp_cr,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_de']") as timestamp_de,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['back_image_id']") as back_image_id,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['date_captured']") as date_captured,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['account_number']") as account_number,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['date_processed']") as date_processed,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['front_image_id']") as front_image_id,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['transaction_id']") as transaction_id,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['ocr_account_number']") as ocr_account_number,
2022-06-20 16:21:28 normalization >     json_extract_scalar(_airbyte_data, "$['vendor_reference_id']") as vendor_reference_id,
2022-06-20 16:21:28 normalization >     _airbyte_ab_id,
2022-06-20 16:21:28 normalization >     _airbyte_emitted_at,
2022-06-20 16:21:28 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:21:28 normalization > from `mainapi-282501`.raw_checkmate._airbyte_raw_deposit as table_alias
2022-06-20 16:21:28 normalization > -- deposit
2022-06-20 16:21:28 normalization > where 1 = 1
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > ),  __dbt__cte__deposit_ab2 as (
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type
2022-06-20 16:21:28 normalization > -- depends_on: __dbt__cte__deposit_ab1
2022-06-20 16:21:28 normalization > select
2022-06-20 16:21:28 normalization >     cast(micr as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as micr,
2022-06-20 16:21:28 normalization >     cast(amount as 
2022-06-20 16:21:28 normalization >     float64
2022-06-20 16:21:28 normalization > ) as amount,
2022-06-20 16:21:28 normalization >     cast(status as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as status,
2022-06-20 16:21:28 normalization >     cast(bank_id as 
2022-06-20 16:21:28 normalization >     float64
2022-06-20 16:21:28 normalization > ) as bank_id,
2022-06-20 16:21:28 normalization >     cast(currency as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as currency,
2022-06-20 16:21:28 normalization >     cast(party_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as party_id,
2022-06-20 16:21:28 normalization >     cast(account_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as account_id,
2022-06-20 16:21:28 normalization >     cast(deposit_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as deposit_id,
2022-06-20 16:21:28 normalization >     cast(partner_id as 
2022-06-20 16:21:28 normalization >     float64
2022-06-20 16:21:28 normalization > ) as partner_id,
2022-06-20 16:21:28 normalization >     cast(party_type as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as party_type,
2022-06-20 16:21:28 normalization >     cast(_ab_cdc_lsn as 
2022-06-20 16:21:28 normalization >     float64
2022-06-20 16:21:28 normalization > ) as _ab_cdc_lsn,
2022-06-20 16:21:28 normalization >     cast(vendor_info as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as vendor_info,
2022-06-20 16:21:28 normalization >     cast(check_amount as 
2022-06-20 16:21:28 normalization >     float64
2022-06-20 16:21:28 normalization > ) as check_amount,
2022-06-20 16:21:28 normalization >     cast(check_number as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as check_number,
2022-06-20 16:21:28 normalization >     cast(nullif(timestamp_ch, '') as 
2022-06-20 16:21:28 normalization >     timestamp
2022-06-20 16:21:28 normalization > ) as timestamp_ch,
2022-06-20 16:21:28 normalization >     cast(nullif(timestamp_cr, '') as 
2022-06-20 16:21:28 normalization >     timestamp
2022-06-20 16:21:28 normalization > ) as timestamp_cr,
2022-06-20 16:21:28 normalization >     cast(nullif(timestamp_de, '') as 
2022-06-20 16:21:28 normalization >     timestamp
2022-06-20 16:21:28 normalization > ) as timestamp_de,
2022-06-20 16:21:28 normalization >     cast(back_image_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as back_image_id,
2022-06-20 16:21:28 normalization >     cast(nullif(date_captured, '') as 
2022-06-20 16:21:28 normalization >     timestamp
2022-06-20 16:21:28 normalization > ) as date_captured,
2022-06-20 16:21:28 normalization >     cast(account_number as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as account_number,
2022-06-20 16:21:28 normalization >     cast(nullif(date_processed, '') as 
2022-06-20 16:21:28 normalization >     timestamp
2022-06-20 16:21:28 normalization > ) as date_processed,
2022-06-20 16:21:28 normalization >     cast(front_image_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as front_image_id,
2022-06-20 16:21:28 normalization >     cast(transaction_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as transaction_id,
2022-06-20 16:21:28 normalization >     cast(_ab_cdc_deleted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as _ab_cdc_deleted_at,
2022-06-20 16:21:28 normalization >     cast(_ab_cdc_updated_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as _ab_cdc_updated_at,
2022-06-20 16:21:28 normalization >     cast(ocr_account_number as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as ocr_account_number,
2022-06-20 16:21:28 normalization >     cast(vendor_reference_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ) as vendor_reference_id,
2022-06-20 16:21:28 normalization >     _airbyte_ab_id,
2022-06-20 16:21:28 normalization >     _airbyte_emitted_at,
2022-06-20 16:21:28 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:21:28 normalization > from __dbt__cte__deposit_ab1
2022-06-20 16:21:28 normalization > -- deposit
2022-06-20 16:21:28 normalization > where 1 = 1
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > )-- SQL model to build a hash column based on the values of this record
2022-06-20 16:21:28 normalization > -- depends_on: __dbt__cte__deposit_ab2
2022-06-20 16:21:28 normalization > select
2022-06-20 16:21:28 normalization >     to_hex(md5(cast(concat(coalesce(cast(micr as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(amount as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(status as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(bank_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(currency as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(party_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(account_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(deposit_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(partner_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(party_type as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(vendor_info as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(check_amount as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(check_number as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(timestamp_ch as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(timestamp_cr as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(timestamp_de as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(back_image_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(date_captured as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(account_number as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(date_processed as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(front_image_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(transaction_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(ocr_account_number as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(vendor_reference_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), '')) as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ))) as _airbyte_deposit_hashid,
2022-06-20 16:21:28 normalization >     tmp.*
2022-06-20 16:21:28 normalization > from __dbt__cte__deposit_ab2 tmp
2022-06-20 16:21:28 normalization > -- deposit
2022-06-20 16:21:28 normalization > where 1 = 1
2022-06-20 16:21:28 normalization > ;
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 16:21:13.120042 [debug] [Thread-3  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:13.121744 [info ] [Thread-3  ]: 1 of 12 OK created view model _airbyte_raw_checkmate.bank_config_stg.................................................... [OK in 1.06s]
2022-06-20 16:21:28 normalization > 16:21:13.123641 [debug] [Thread-3  ]: Finished running node model.airbyte_utils.bank_config_stg
2022-06-20 16:21:28 normalization > 16:21:13.124718 [debug] [Thread-1  ]: Began running node model.airbyte_utils.bank_config_scd
2022-06-20 16:21:28 normalization > 16:21:13.125415 [info ] [Thread-1  ]: 5 of 12 START incremental model raw_checkmate.bank_config_scd........................................................... [RUN]
2022-06-20 16:21:28 normalization > 16:21:13.128320 [debug] [Thread-7  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:13.129554 [debug] [Thread-1  ]: Acquiring new bigquery connection "model.airbyte_utils.bank_config_scd"
2022-06-20 16:21:28 normalization > 16:21:13.130755 [info ] [Thread-7  ]: 2 of 12 OK created view model _airbyte_raw_checkmate.vendor_config_stg.................................................. [OK in 1.06s]
2022-06-20 16:21:28 normalization > 16:21:13.133404 [debug] [Thread-8  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:13.133806 [debug] [Thread-1  ]: Began compiling node model.airbyte_utils.bank_config_scd
2022-06-20 16:21:28 normalization > 16:21:13.135699 [info ] [Thread-8  ]: 4 of 12 OK created view model _airbyte_raw_checkmate.deposit_stg........................................................ [OK in 0.97s]
2022-06-20 16:21:28 normalization > 16:21:13.135988 [debug] [Thread-7  ]: Finished running node model.airbyte_utils.vendor_config_stg
2022-06-20 16:21:28 normalization > 16:21:13.136328 [debug] [Thread-1  ]: Compiling model.airbyte_utils.bank_config_scd
2022-06-20 16:21:28 normalization > 16:21:13.137049 [debug] [Thread-8  ]: Finished running node model.airbyte_utils.deposit_stg
2022-06-20 16:21:28 normalization > 16:21:13.144052 [debug] [Thread-4  ]: Began running node model.airbyte_utils.vendor_config_scd
2022-06-20 16:21:28 normalization > 16:21:13.165942 [debug] [Thread-1  ]: Writing injected SQL for node "model.airbyte_utils.bank_config_scd"
2022-06-20 16:21:28 normalization > 16:21:13.169392 [debug] [Thread-6  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:13.169745 [debug] [Thread-3  ]: Began running node model.airbyte_utils.deposit_scd
2022-06-20 16:21:28 normalization > 16:21:13.170105 [info ] [Thread-4  ]: 6 of 12 START incremental model raw_checkmate.vendor_config_scd......................................................... [RUN]
2022-06-20 16:21:28 normalization > 16:21:13.171485 [info ] [Thread-6  ]: 3 of 12 OK created view model _airbyte_raw_checkmate.inbound_file_metadata_stg.......................................... [OK in 1.10s]
2022-06-20 16:21:28 normalization > 16:21:13.172055 [info ] [Thread-3  ]: 7 of 12 START incremental model raw_checkmate.deposit_scd............................................................... [RUN]
2022-06-20 16:21:28 normalization > 16:21:13.173506 [debug] [Thread-4  ]: Acquiring new bigquery connection "model.airbyte_utils.vendor_config_scd"
2022-06-20 16:21:28 normalization > 16:21:13.174266 [debug] [Thread-6  ]: Finished running node model.airbyte_utils.inbound_file_metadata_stg
2022-06-20 16:21:28 normalization > 16:21:13.174844 [debug] [Thread-1  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:13.176054 [debug] [Thread-3  ]: Acquiring new bigquery connection "model.airbyte_utils.deposit_scd"
2022-06-20 16:21:28 normalization > 16:21:13.176367 [debug] [Thread-4  ]: Began compiling node model.airbyte_utils.vendor_config_scd
2022-06-20 16:21:28 normalization > 16:21:13.177191 [debug] [Thread-7  ]: Began running node model.airbyte_utils.inbound_file_metadata_scd
2022-06-20 16:21:28 normalization > 16:21:13.177498 [debug] [Thread-1  ]: Began executing node model.airbyte_utils.bank_config_scd
2022-06-20 16:21:28 normalization > 16:21:13.177774 [debug] [Thread-3  ]: Began compiling node model.airbyte_utils.deposit_scd
2022-06-20 16:21:28 normalization > 16:21:13.178063 [debug] [Thread-4  ]: Compiling model.airbyte_utils.vendor_config_scd
2022-06-20 16:21:28 normalization > 16:21:13.178630 [info ] [Thread-7  ]: 8 of 12 START incremental model raw_checkmate.inbound_file_metadata_scd................................................. [RUN]
2022-06-20 16:21:28 normalization > 16:21:13.199808 [debug] [Thread-3  ]: Compiling model.airbyte_utils.deposit_scd
2022-06-20 16:21:28 normalization > 16:21:13.223557 [debug] [Thread-1  ]: Opening a new connection, currently in state closed
2022-06-20 16:21:28 normalization > 16:21:13.228442 [debug] [Thread-7  ]: Acquiring new bigquery connection "model.airbyte_utils.inbound_file_metadata_scd"
2022-06-20 16:21:28 normalization > 16:21:13.274960 [debug] [Thread-3  ]: Writing injected SQL for node "model.airbyte_utils.deposit_scd"
2022-06-20 16:21:28 normalization > 16:21:13.282284 [debug] [Thread-4  ]: Writing injected SQL for node "model.airbyte_utils.vendor_config_scd"
2022-06-20 16:21:28 normalization > 16:21:13.282922 [debug] [Thread-7  ]: Began compiling node model.airbyte_utils.inbound_file_metadata_scd
2022-06-20 16:21:28 normalization > 16:21:13.283843 [debug] [Thread-3  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:13.284273 [debug] [Thread-7  ]: Compiling model.airbyte_utils.inbound_file_metadata_scd
2022-06-20 16:21:28 normalization > 16:21:13.284522 [debug] [Thread-4  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:13.284963 [debug] [Thread-3  ]: Began executing node model.airbyte_utils.deposit_scd
2022-06-20 16:21:28 normalization > 16:21:13.313242 [debug] [Thread-4  ]: Began executing node model.airbyte_utils.vendor_config_scd
2022-06-20 16:21:28 normalization > 16:21:13.314477 [debug] [Thread-7  ]: Writing injected SQL for node "model.airbyte_utils.inbound_file_metadata_scd"
2022-06-20 16:21:28 normalization > 16:21:13.319268 [debug] [Thread-3  ]: Opening a new connection, currently in state closed
2022-06-20 16:21:28 normalization > 16:21:13.325836 [debug] [Thread-4  ]: Opening a new connection, currently in state closed
2022-06-20 16:21:28 normalization > 16:21:13.328102 [debug] [Thread-7  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:13.328542 [debug] [Thread-7  ]: Began executing node model.airbyte_utils.inbound_file_metadata_scd
2022-06-20 16:21:28 normalization > 16:21:13.336128 [debug] [Thread-7  ]: Opening a new connection, currently in state closed
2022-06-20 16:21:28 normalization > 16:21:13.442746 [debug] [Thread-3  ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/mainapi-282501/datasets/raw_checkmate/tables/deposit_scd?prettyPrint=false: Not found: Table mainapi-282501:raw_checkmate.deposit_scd
2022-06-20 16:21:28 normalization > 16:21:13.449655 [debug] [Thread-1  ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/mainapi-282501/datasets/raw_checkmate/tables/bank_config_scd?prettyPrint=false: Not found: Table mainapi-282501:raw_checkmate.bank_config_scd
2022-06-20 16:21:28 normalization > 16:21:13.464886 [info ] [Thread-1  ]: 16:21:13 + `mainapi-282501`.raw_checkmate.`bank_config_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-06-20 16:21:28 normalization > 16:21:13.465417 [debug] [Thread-4  ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/mainapi-282501/datasets/raw_checkmate/tables/vendor_config_scd?prettyPrint=false: Not found: Table mainapi-282501:raw_checkmate.vendor_config_scd
2022-06-20 16:21:28 normalization > 16:21:13.465948 [info ] [Thread-3  ]: 16:21:13 + `mainapi-282501`.raw_checkmate.`deposit_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-06-20 16:21:28 normalization > 16:21:13.478441 [info ] [Thread-4  ]: 16:21:13 + `mainapi-282501`.raw_checkmate.`vendor_config_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-06-20 16:21:28 normalization > 16:21:13.521670 [debug] [Thread-1  ]: Writing runtime SQL for node "model.airbyte_utils.bank_config_scd"
2022-06-20 16:21:28 normalization > 16:21:13.524964 [debug] [Thread-3  ]: Writing runtime SQL for node "model.airbyte_utils.deposit_scd"
2022-06-20 16:21:28 normalization > 16:21:13.529241 [debug] [Thread-4  ]: Writing runtime SQL for node "model.airbyte_utils.vendor_config_scd"
2022-06-20 16:21:28 normalization > 16:21:13.530459 [debug] [Thread-7  ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/mainapi-282501/datasets/raw_checkmate/tables/inbound_file_metadata_scd?prettyPrint=false: Not found: Table mainapi-282501:raw_checkmate.inbound_file_metadata_scd
2022-06-20 16:21:28 normalization > 16:21:13.533512 [info ] [Thread-7  ]: 16:21:13 + `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-06-20 16:21:28 normalization > 16:21:13.538462 [debug] [Thread-7  ]: Writing runtime SQL for node "model.airbyte_utils.inbound_file_metadata_scd"
2022-06-20 16:21:28 normalization > 16:21:13.539484 [debug] [Thread-1  ]: On model.airbyte_utils.bank_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.bank_config_scd"} */
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`bank_config_scd`
2022-06-20 16:21:28 normalization >   partition by range_bucket(
2022-06-20 16:21:28 normalization >             _airbyte_active_row,
2022-06-20 16:21:28 normalization >             generate_array(0, 1, 1)
2022-06-20 16:21:28 normalization >         )
2022-06-20 16:21:28 normalization >   cluster by _airbyte_unique_key_scd, _airbyte_emitted_at
2022-06-20 16:21:28 normalization >   OPTIONS()
2022-06-20 16:21:28 normalization >   as (
2022-06-20 16:21:28 normalization >     
2022-06-20 16:21:28 normalization > -- depends_on: ref('bank_config_stg')
2022-06-20 16:21:28 normalization > with
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > input_data as (
2022-06-20 16:21:28 normalization >     select *
2022-06-20 16:21:28 normalization >     from `mainapi-282501`._airbyte_raw_checkmate.`bank_config_stg`
2022-06-20 16:21:28 normalization >     -- bank_config from `mainapi-282501`.raw_checkmate._airbyte_raw_bank_config
2022-06-20 16:21:28 normalization > ),
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > scd_data as (
2022-06-20 16:21:28 normalization >     -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key
2022-06-20 16:21:28 normalization >     select
2022-06-20 16:21:28 normalization >       to_hex(md5(cast(concat(coalesce(cast(bank_config_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), '')) as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ))) as _airbyte_unique_key,
2022-06-20 16:21:28 normalization >       name,
2022-06-20 16:21:28 normalization >       bank_id,
2022-06-20 16:21:28 normalization >       _ab_cdc_lsn,
2022-06-20 16:21:28 normalization >       timestamp_ch,
2022-06-20 16:21:28 normalization >       timestamp_cr,
2022-06-20 16:21:28 normalization >       hold_duration,
2022-06-20 16:21:28 normalization >       bank_config_id,
2022-06-20 16:21:28 normalization >       vendor_bank_id,
2022-06-20 16:21:28 normalization >       _ab_cdc_deleted_at,
2022-06-20 16:21:28 normalization >       _ab_cdc_updated_at,
2022-06-20 16:21:28 normalization >       inbound_upload_path,
2022-06-20 16:21:28 normalization >       outbound_upload_path,
2022-06-20 16:21:28 normalization >       hold_amount_percentage,
2022-06-20 16:21:28 normalization >       timestamp_ch as _airbyte_start_at,
2022-06-20 16:21:28 normalization >       lag(timestamp_ch) over (
2022-06-20 16:21:28 normalization >         partition by bank_config_id
2022-06-20 16:21:28 normalization >         order by
2022-06-20 16:21:28 normalization >             timestamp_ch is null asc,
2022-06-20 16:21:28 normalization >             timestamp_ch desc,
2022-06-20 16:21:28 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:21:28 normalization >             _airbyte_emitted_at desc
2022-06-20 16:21:28 normalization >       ) as _airbyte_end_at,
2022-06-20 16:21:28 normalization >       case when row_number() over (
2022-06-20 16:21:28 normalization >         partition by bank_config_id
2022-06-20 16:21:28 normalization >         order by
2022-06-20 16:21:28 normalization >             timestamp_ch is null asc,
2022-06-20 16:21:28 normalization >             timestamp_ch desc,
2022-06-20 16:21:28 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:21:28 normalization >             _airbyte_emitted_at desc
2022-06-20 16:21:28 normalization >       ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row,
2022-06-20 16:21:28 normalization >       _airbyte_ab_id,
2022-06-20 16:21:28 normalization >       _airbyte_emitted_at,
2022-06-20 16:21:28 normalization >       _airbyte_bank_config_hashid
2022-06-20 16:21:28 normalization >     from input_data
2022-06-20 16:21:28 normalization > ),
2022-06-20 16:21:28 normalization > dedup_data as (
2022-06-20 16:21:28 normalization >     select
2022-06-20 16:21:28 normalization >         -- we need to ensure de-duplicated rows for merge/update queries
2022-06-20 16:21:28 normalization >         -- additionally, we generate a unique key for the scd table
2022-06-20 16:21:28 normalization >         row_number() over (
2022-06-20 16:21:28 normalization >             partition by
2022-06-20 16:21:28 normalization >                 _airbyte_unique_key,
2022-06-20 16:21:28 normalization >                 _airbyte_start_at,
2022-06-20 16:21:28 normalization >                 _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), cast(_ab_cdc_updated_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > )
2022-06-20 16:21:28 normalization >             order by _airbyte_active_row desc, _airbyte_ab_id
2022-06-20 16:21:28 normalization >         ) as _airbyte_row_num,
2022-06-20 16:21:28 normalization >         to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), '')) as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ))) as _airbyte_unique_key_scd,
2022-06-20 16:21:28 normalization >         scd_data.*
2022-06-20 16:21:28 normalization >     from scd_data
2022-06-20 16:21:28 normalization > )
2022-06-20 16:21:28 normalization > select
2022-06-20 16:21:28 normalization >     _airbyte_unique_key,
2022-06-20 16:21:28 normalization >     _airbyte_unique_key_scd,
2022-06-20 16:21:28 normalization >     name,
2022-06-20 16:21:28 normalization >     bank_id,
2022-06-20 16:21:28 normalization >     _ab_cdc_lsn,
2022-06-20 16:21:28 normalization >     timestamp_ch,
2022-06-20 16:21:28 normalization >     timestamp_cr,
2022-06-20 16:21:28 normalization >     hold_duration,
2022-06-20 16:21:28 normalization >     bank_config_id,
2022-06-20 16:21:28 normalization >     vendor_bank_id,
2022-06-20 16:21:28 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:21:28 normalization >     _ab_cdc_updated_at,
2022-06-20 16:21:28 normalization >     inbound_upload_path,
2022-06-20 16:21:28 normalization >     outbound_upload_path,
2022-06-20 16:21:28 normalization >     hold_amount_percentage,
2022-06-20 16:21:28 normalization >     _airbyte_start_at,
2022-06-20 16:21:28 normalization >     _airbyte_end_at,
2022-06-20 16:21:28 normalization >     _airbyte_active_row,
2022-06-20 16:21:28 normalization >     _airbyte_ab_id,
2022-06-20 16:21:28 normalization >     _airbyte_emitted_at,
2022-06-20 16:21:28 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:21:28 normalization >     _airbyte_bank_config_hashid
2022-06-20 16:21:28 normalization > from dedup_data where _airbyte_row_num = 1
2022-06-20 16:21:28 normalization >   );
2022-06-20 16:21:28 normalization >   
2022-06-20 16:21:28 normalization > 16:21:13.540846 [debug] [Thread-7  ]: On model.airbyte_utils.inbound_file_metadata_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.inbound_file_metadata_scd"} */
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd`
2022-06-20 16:21:28 normalization >   partition by range_bucket(
2022-06-20 16:21:28 normalization >             _airbyte_active_row,
2022-06-20 16:21:28 normalization >             generate_array(0, 1, 1)
2022-06-20 16:21:28 normalization >         )
2022-06-20 16:21:28 normalization >   cluster by _airbyte_unique_key_scd, _airbyte_emitted_at
2022-06-20 16:21:28 normalization >   OPTIONS()
2022-06-20 16:21:28 normalization >   as (
2022-06-20 16:21:28 normalization >     
2022-06-20 16:21:28 normalization > -- depends_on: ref('inbound_file_metadata_stg')
2022-06-20 16:21:28 normalization > with
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > input_data as (
2022-06-20 16:21:28 normalization >     select *
2022-06-20 16:21:28 normalization >     from `mainapi-282501`._airbyte_raw_checkmate.`inbound_file_metadata_stg`
2022-06-20 16:21:28 normalization >     -- inbound_file_metadata from `mainapi-282501`.raw_checkmate._airbyte_raw_inbound_file_metadata
2022-06-20 16:21:28 normalization > ),
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > scd_data as (
2022-06-20 16:21:28 normalization >     -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key
2022-06-20 16:21:28 normalization >     select
2022-06-20 16:21:28 normalization >       to_hex(md5(cast(concat(coalesce(cast(inbound_file_metadata_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), '')) as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ))) as _airbyte_unique_key,
2022-06-20 16:21:28 normalization >       file_hash,
2022-06-20 16:21:28 normalization >       file_name,
2022-06-20 16:21:28 normalization >       _ab_cdc_lsn,
2022-06-20 16:21:28 normalization >       timestamp_ch,
2022-06-20 16:21:28 normalization >       timestamp_cr,
2022-06-20 16:21:28 normalization >       _ab_cdc_deleted_at,
2022-06-20 16:21:28 normalization >       _ab_cdc_updated_at,
2022-06-20 16:21:28 normalization >       inbound_file_metadata_id,
2022-06-20 16:21:28 normalization >       timestamp_ch as _airbyte_start_at,
2022-06-20 16:21:28 normalization >       lag(timestamp_ch) over (
2022-06-20 16:21:28 normalization >         partition by inbound_file_metadata_id
2022-06-20 16:21:28 normalization >         order by
2022-06-20 16:21:28 normalization >             timestamp_ch is null asc,
2022-06-20 16:21:28 normalization >             timestamp_ch desc,
2022-06-20 16:21:28 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:21:28 normalization >             _airbyte_emitted_at desc
2022-06-20 16:21:28 normalization >       ) as _airbyte_end_at,
2022-06-20 16:21:28 normalization >       case when row_number() over (
2022-06-20 16:21:28 normalization >         partition by inbound_file_metadata_id
2022-06-20 16:21:28 normalization >         order by
2022-06-20 16:21:28 normalization >             timestamp_ch is null asc,
2022-06-20 16:21:28 normalization >             timestamp_ch desc,
2022-06-20 16:21:28 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:21:28 normalization >             _airbyte_emitted_at desc
2022-06-20 16:21:28 normalization >       ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row,
2022-06-20 16:21:28 normalization >       _airbyte_ab_id,
2022-06-20 16:21:28 normalization >       _airbyte_emitted_at,
2022-06-20 16:21:28 normalization >       _airbyte_inbound_file_metadata_hashid
2022-06-20 16:21:28 normalization >     from input_data
2022-06-20 16:21:28 normalization > ),
2022-06-20 16:21:28 normalization > dedup_data as (
2022-06-20 16:21:28 normalization >     select
2022-06-20 16:21:28 normalization >         -- we need to ensure de-duplicated rows for merge/update queries
2022-06-20 16:21:28 normalization >         -- additionally, we generate a unique key for the scd table
2022-06-20 16:21:28 normalization >         row_number() over (
2022-06-20 16:21:28 normalization >             partition by
2022-06-20 16:21:28 normalization >                 _airbyte_unique_key,
2022-06-20 16:21:28 normalization >                 _airbyte_start_at,
2022-06-20 16:21:28 normalization >                 _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), cast(_ab_cdc_updated_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > )
2022-06-20 16:21:28 normalization >             order by _airbyte_active_row desc, _airbyte_ab_id
2022-06-20 16:21:28 normalization >         ) as _airbyte_row_num,
2022-06-20 16:21:28 normalization >         to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), '')) as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ))) as _airbyte_unique_key_scd,
2022-06-20 16:21:28 normalization >         scd_data.*
2022-06-20 16:21:28 normalization >     from scd_data
2022-06-20 16:21:28 normalization > )
2022-06-20 16:21:28 normalization > select
2022-06-20 16:21:28 normalization >     _airbyte_unique_key,
2022-06-20 16:21:28 normalization >     _airbyte_unique_key_scd,
2022-06-20 16:21:28 normalization >     file_hash,
2022-06-20 16:21:28 normalization >     file_name,
2022-06-20 16:21:28 normalization >     _ab_cdc_lsn,
2022-06-20 16:21:28 normalization >     timestamp_ch,
2022-06-20 16:21:28 normalization >     timestamp_cr,
2022-06-20 16:21:28 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:21:28 normalization >     _ab_cdc_updated_at,
2022-06-20 16:21:28 normalization >     inbound_file_metadata_id,
2022-06-20 16:21:28 normalization >     _airbyte_start_at,
2022-06-20 16:21:28 normalization >     _airbyte_end_at,
2022-06-20 16:21:28 normalization >     _airbyte_active_row,
2022-06-20 16:21:28 normalization >     _airbyte_ab_id,
2022-06-20 16:21:28 normalization >     _airbyte_emitted_at,
2022-06-20 16:21:28 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:21:28 normalization >     _airbyte_inbound_file_metadata_hashid
2022-06-20 16:21:28 normalization > from dedup_data where _airbyte_row_num = 1
2022-06-20 16:21:28 normalization >   );
2022-06-20 16:21:28 normalization >   
2022-06-20 16:21:28 normalization > 16:21:13.541234 [debug] [Thread-4  ]: On model.airbyte_utils.vendor_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.vendor_config_scd"} */
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`vendor_config_scd`
2022-06-20 16:21:28 normalization >   partition by range_bucket(
2022-06-20 16:21:28 normalization >             _airbyte_active_row,
2022-06-20 16:21:28 normalization >             generate_array(0, 1, 1)
2022-06-20 16:21:28 normalization >         )
2022-06-20 16:21:28 normalization >   cluster by _airbyte_unique_key_scd, _airbyte_emitted_at
2022-06-20 16:21:28 normalization >   OPTIONS()
2022-06-20 16:21:28 normalization >   as (
2022-06-20 16:21:28 normalization >     
2022-06-20 16:21:28 normalization > -- depends_on: ref('vendor_config_stg')
2022-06-20 16:21:28 normalization > with
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > input_data as (
2022-06-20 16:21:28 normalization >     select *
2022-06-20 16:21:28 normalization >     from `mainapi-282501`._airbyte_raw_checkmate.`vendor_config_stg`
2022-06-20 16:21:28 normalization >     -- vendor_config from `mainapi-282501`.raw_checkmate._airbyte_raw_vendor_config
2022-06-20 16:21:28 normalization > ),
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > scd_data as (
2022-06-20 16:21:28 normalization >     -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key
2022-06-20 16:21:28 normalization >     select
2022-06-20 16:21:28 normalization >       to_hex(md5(cast(concat(coalesce(cast(vendor_config_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), '')) as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ))) as _airbyte_unique_key,
2022-06-20 16:21:28 normalization >       name,
2022-06-20 16:21:28 normalization >       _ab_cdc_lsn,
2022-06-20 16:21:28 normalization >       timestamp_ch,
2022-06-20 16:21:28 normalization >       timestamp_cr,
2022-06-20 16:21:28 normalization >       vendor_config_id,
2022-06-20 16:21:28 normalization >       _ab_cdc_deleted_at,
2022-06-20 16:21:28 normalization >       _ab_cdc_updated_at,
2022-06-20 16:21:28 normalization >       inbound_upload_path,
2022-06-20 16:21:28 normalization >       outbound_upload_path,
2022-06-20 16:21:28 normalization >       timestamp_ch as _airbyte_start_at,
2022-06-20 16:21:28 normalization >       lag(timestamp_ch) over (
2022-06-20 16:21:28 normalization >         partition by vendor_config_id
2022-06-20 16:21:28 normalization >         order by
2022-06-20 16:21:28 normalization >             timestamp_ch is null asc,
2022-06-20 16:21:28 normalization >             timestamp_ch desc,
2022-06-20 16:21:28 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:21:28 normalization >             _airbyte_emitted_at desc
2022-06-20 16:21:28 normalization >       ) as _airbyte_end_at,
2022-06-20 16:21:28 normalization >       case when row_number() over (
2022-06-20 16:21:28 normalization >         partition by vendor_config_id
2022-06-20 16:21:28 normalization >         order by
2022-06-20 16:21:28 normalization >             timestamp_ch is null asc,
2022-06-20 16:21:28 normalization >             timestamp_ch desc,
2022-06-20 16:21:28 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:21:28 normalization >             _airbyte_emitted_at desc
2022-06-20 16:21:28 normalization >       ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row,
2022-06-20 16:21:28 normalization >       _airbyte_ab_id,
2022-06-20 16:21:28 normalization >       _airbyte_emitted_at,
2022-06-20 16:21:28 normalization >       _airbyte_vendor_config_hashid
2022-06-20 16:21:28 normalization >     from input_data
2022-06-20 16:21:28 normalization > ),
2022-06-20 16:21:28 normalization > dedup_data as (
2022-06-20 16:21:28 normalization >     select
2022-06-20 16:21:28 normalization >         -- we need to ensure de-duplicated rows for merge/update queries
2022-06-20 16:21:28 normalization >         -- additionally, we generate a unique key for the scd table
2022-06-20 16:21:28 normalization >         row_number() over (
2022-06-20 16:21:28 normalization >             partition by
2022-06-20 16:21:28 normalization >                 _airbyte_unique_key,
2022-06-20 16:21:28 normalization >                 _airbyte_start_at,
2022-06-20 16:21:28 normalization >                 _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), cast(_ab_cdc_updated_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > )
2022-06-20 16:21:28 normalization >             order by _airbyte_active_row desc, _airbyte_ab_id
2022-06-20 16:21:28 normalization >         ) as _airbyte_row_num,
2022-06-20 16:21:28 normalization >         to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), '')) as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ))) as _airbyte_unique_key_scd,
2022-06-20 16:21:28 normalization >         scd_data.*
2022-06-20 16:21:28 normalization >     from scd_data
2022-06-20 16:21:28 normalization > )
2022-06-20 16:21:28 normalization > select
2022-06-20 16:21:28 normalization >     _airbyte_unique_key,
2022-06-20 16:21:28 normalization >     _airbyte_unique_key_scd,
2022-06-20 16:21:28 normalization >     name,
2022-06-20 16:21:28 normalization >     _ab_cdc_lsn,
2022-06-20 16:21:28 normalization >     timestamp_ch,
2022-06-20 16:21:28 normalization >     timestamp_cr,
2022-06-20 16:21:28 normalization >     vendor_config_id,
2022-06-20 16:21:28 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:21:28 normalization >     _ab_cdc_updated_at,
2022-06-20 16:21:28 normalization >     inbound_upload_path,
2022-06-20 16:21:28 normalization >     outbound_upload_path,
2022-06-20 16:21:28 normalization >     _airbyte_start_at,
2022-06-20 16:21:28 normalization >     _airbyte_end_at,
2022-06-20 16:21:28 normalization >     _airbyte_active_row,
2022-06-20 16:21:28 normalization >     _airbyte_ab_id,
2022-06-20 16:21:28 normalization >     _airbyte_emitted_at,
2022-06-20 16:21:28 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:21:28 normalization >     _airbyte_vendor_config_hashid
2022-06-20 16:21:28 normalization > from dedup_data where _airbyte_row_num = 1
2022-06-20 16:21:28 normalization >   );
2022-06-20 16:21:28 normalization >   
2022-06-20 16:21:28 normalization > 16:21:13.541596 [debug] [Thread-3  ]: On model.airbyte_utils.deposit_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.deposit_scd"} */
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`deposit_scd`
2022-06-20 16:21:28 normalization >   partition by range_bucket(
2022-06-20 16:21:28 normalization >             _airbyte_active_row,
2022-06-20 16:21:28 normalization >             generate_array(0, 1, 1)
2022-06-20 16:21:28 normalization >         )
2022-06-20 16:21:28 normalization >   cluster by _airbyte_unique_key_scd, _airbyte_emitted_at
2022-06-20 16:21:28 normalization >   OPTIONS()
2022-06-20 16:21:28 normalization >   as (
2022-06-20 16:21:28 normalization >     
2022-06-20 16:21:28 normalization > -- depends_on: ref('deposit_stg')
2022-06-20 16:21:28 normalization > with
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > input_data as (
2022-06-20 16:21:28 normalization >     select *
2022-06-20 16:21:28 normalization >     from `mainapi-282501`._airbyte_raw_checkmate.`deposit_stg`
2022-06-20 16:21:28 normalization >     -- deposit from `mainapi-282501`.raw_checkmate._airbyte_raw_deposit
2022-06-20 16:21:28 normalization > ),
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > scd_data as (
2022-06-20 16:21:28 normalization >     -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key
2022-06-20 16:21:28 normalization >     select
2022-06-20 16:21:28 normalization >       to_hex(md5(cast(concat(coalesce(cast(deposit_id as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), '')) as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ))) as _airbyte_unique_key,
2022-06-20 16:21:28 normalization >       micr,
2022-06-20 16:21:28 normalization >       amount,
2022-06-20 16:21:28 normalization >       status,
2022-06-20 16:21:28 normalization >       bank_id,
2022-06-20 16:21:28 normalization >       currency,
2022-06-20 16:21:28 normalization >       party_id,
2022-06-20 16:21:28 normalization >       account_id,
2022-06-20 16:21:28 normalization >       deposit_id,
2022-06-20 16:21:28 normalization >       partner_id,
2022-06-20 16:21:28 normalization >       party_type,
2022-06-20 16:21:28 normalization >       _ab_cdc_lsn,
2022-06-20 16:21:28 normalization >       vendor_info,
2022-06-20 16:21:28 normalization >       check_amount,
2022-06-20 16:21:28 normalization >       check_number,
2022-06-20 16:21:28 normalization >       timestamp_ch,
2022-06-20 16:21:28 normalization >       timestamp_cr,
2022-06-20 16:21:28 normalization >       timestamp_de,
2022-06-20 16:21:28 normalization >       back_image_id,
2022-06-20 16:21:28 normalization >       date_captured,
2022-06-20 16:21:28 normalization >       account_number,
2022-06-20 16:21:28 normalization >       date_processed,
2022-06-20 16:21:28 normalization >       front_image_id,
2022-06-20 16:21:28 normalization >       transaction_id,
2022-06-20 16:21:28 normalization >       _ab_cdc_deleted_at,
2022-06-20 16:21:28 normalization >       _ab_cdc_updated_at,
2022-06-20 16:21:28 normalization >       ocr_account_number,
2022-06-20 16:21:28 normalization >       vendor_reference_id,
2022-06-20 16:21:28 normalization >       timestamp_ch as _airbyte_start_at,
2022-06-20 16:21:28 normalization >       lag(timestamp_ch) over (
2022-06-20 16:21:28 normalization >         partition by deposit_id
2022-06-20 16:21:28 normalization >         order by
2022-06-20 16:21:28 normalization >             timestamp_ch is null asc,
2022-06-20 16:21:28 normalization >             timestamp_ch desc,
2022-06-20 16:21:28 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:21:28 normalization >             _airbyte_emitted_at desc
2022-06-20 16:21:28 normalization >       ) as _airbyte_end_at,
2022-06-20 16:21:28 normalization >       case when row_number() over (
2022-06-20 16:21:28 normalization >         partition by deposit_id
2022-06-20 16:21:28 normalization >         order by
2022-06-20 16:21:28 normalization >             timestamp_ch is null asc,
2022-06-20 16:21:28 normalization >             timestamp_ch desc,
2022-06-20 16:21:28 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:21:28 normalization >             _airbyte_emitted_at desc
2022-06-20 16:21:28 normalization >       ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row,
2022-06-20 16:21:28 normalization >       _airbyte_ab_id,
2022-06-20 16:21:28 normalization >       _airbyte_emitted_at,
2022-06-20 16:21:28 normalization >       _airbyte_deposit_hashid
2022-06-20 16:21:28 normalization >     from input_data
2022-06-20 16:21:28 normalization > ),
2022-06-20 16:21:28 normalization > dedup_data as (
2022-06-20 16:21:28 normalization >     select
2022-06-20 16:21:28 normalization >         -- we need to ensure de-duplicated rows for merge/update queries
2022-06-20 16:21:28 normalization >         -- additionally, we generate a unique key for the scd table
2022-06-20 16:21:28 normalization >         row_number() over (
2022-06-20 16:21:28 normalization >             partition by
2022-06-20 16:21:28 normalization >                 _airbyte_unique_key,
2022-06-20 16:21:28 normalization >                 _airbyte_start_at,
2022-06-20 16:21:28 normalization >                 _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), cast(_ab_cdc_updated_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > )
2022-06-20 16:21:28 normalization >             order by _airbyte_active_row desc, _airbyte_ab_id
2022-06-20 16:21:28 normalization >         ) as _airbyte_row_num,
2022-06-20 16:21:28 normalization >         to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ), '')) as 
2022-06-20 16:21:28 normalization >     string
2022-06-20 16:21:28 normalization > ))) as _airbyte_unique_key_scd,
2022-06-20 16:21:28 normalization >         scd_data.*
2022-06-20 16:21:28 normalization >     from scd_data
2022-06-20 16:21:28 normalization > )
2022-06-20 16:21:28 normalization > select
2022-06-20 16:21:28 normalization >     _airbyte_unique_key,
2022-06-20 16:21:28 normalization >     _airbyte_unique_key_scd,
2022-06-20 16:21:28 normalization >     micr,
2022-06-20 16:21:28 normalization >     amount,
2022-06-20 16:21:28 normalization >     status,
2022-06-20 16:21:28 normalization >     bank_id,
2022-06-20 16:21:28 normalization >     currency,
2022-06-20 16:21:28 normalization >     party_id,
2022-06-20 16:21:28 normalization >     account_id,
2022-06-20 16:21:28 normalization >     deposit_id,
2022-06-20 16:21:28 normalization >     partner_id,
2022-06-20 16:21:28 normalization >     party_type,
2022-06-20 16:21:28 normalization >     _ab_cdc_lsn,
2022-06-20 16:21:28 normalization >     vendor_info,
2022-06-20 16:21:28 normalization >     check_amount,
2022-06-20 16:21:28 normalization >     check_number,
2022-06-20 16:21:28 normalization >     timestamp_ch,
2022-06-20 16:21:28 normalization >     timestamp_cr,
2022-06-20 16:21:28 normalization >     timestamp_de,
2022-06-20 16:21:28 normalization >     back_image_id,
2022-06-20 16:21:28 normalization >     date_captured,
2022-06-20 16:21:28 normalization >     account_number,
2022-06-20 16:21:28 normalization >     date_processed,
2022-06-20 16:21:28 normalization >     front_image_id,
2022-06-20 16:21:28 normalization >     transaction_id,
2022-06-20 16:21:28 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:21:28 normalization >     _ab_cdc_updated_at,
2022-06-20 16:21:28 normalization >     ocr_account_number,
2022-06-20 16:21:28 normalization >     vendor_reference_id,
2022-06-20 16:21:28 normalization >     _airbyte_start_at,
2022-06-20 16:21:28 normalization >     _airbyte_end_at,
2022-06-20 16:21:28 normalization >     _airbyte_active_row,
2022-06-20 16:21:28 normalization >     _airbyte_ab_id,
2022-06-20 16:21:28 normalization >     _airbyte_emitted_at,
2022-06-20 16:21:28 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:21:28 normalization >     _airbyte_deposit_hashid
2022-06-20 16:21:28 normalization > from dedup_data where _airbyte_row_num = 1
2022-06-20 16:21:28 normalization >   );
2022-06-20 16:21:28 normalization >   
2022-06-20 16:21:28 normalization > 16:21:14.395845 [debug] [Thread-3  ]: BigQuery adapter: Retry attempt 1 of 3 after error: BadRequest('Invalid timestamp string "0000-12-30T00:00:00Z"')
2022-06-20 16:21:28 normalization > 16:21:15.842621 [debug] [Thread-3  ]: BigQuery adapter: Retry attempt 2 of 3 after error: BadRequest('Invalid timestamp string "0000-12-30T00:00:00Z"')
2022-06-20 16:21:28 normalization > 16:21:16.728967 [debug] [Thread-1  ]: On model.airbyte_utils.bank_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.bank_config_scd"} */
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >         -- We have to have a non-empty query, so just do a noop delete
2022-06-20 16:21:28 normalization >                     delete from `mainapi-282501`.raw_checkmate.`bank_config_scd` where 1=0
2022-06-20 16:21:28 normalization >       
2022-06-20 16:21:28 normalization > 16:21:17.128429 [debug] [Thread-7  ]: On model.airbyte_utils.inbound_file_metadata_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.inbound_file_metadata_scd"} */
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >         -- We have to have a non-empty query, so just do a noop delete
2022-06-20 16:21:28 normalization >                     delete from `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd` where 1=0
2022-06-20 16:21:28 normalization >       
2022-06-20 16:21:28 normalization > 16:21:17.623316 [debug] [Thread-4  ]: On model.airbyte_utils.vendor_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.vendor_config_scd"} */
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >         -- We have to have a non-empty query, so just do a noop delete
2022-06-20 16:21:28 normalization >                     delete from `mainapi-282501`.raw_checkmate.`vendor_config_scd` where 1=0
2022-06-20 16:21:28 normalization >       
2022-06-20 16:21:28 normalization > 16:21:17.793690 [debug] [Thread-3  ]: BigQuery adapter: Retry attempt 3 of 3 after error: BadRequest('Invalid timestamp string "0000-12-30T00:00:00Z"')
2022-06-20 16:21:28 normalization > 16:21:19.390274 [debug] [Thread-1  ]: On model.airbyte_utils.bank_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.bank_config_scd"} */
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >         drop view _airbyte_raw_checkmate.bank_config_stg
2022-06-20 16:21:28 normalization >       
2022-06-20 16:21:28 normalization > 16:21:19.713813 [debug] [Thread-7  ]: On model.airbyte_utils.inbound_file_metadata_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.inbound_file_metadata_scd"} */
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >         drop view _airbyte_raw_checkmate.inbound_file_metadata_stg
2022-06-20 16:21:28 normalization >       
2022-06-20 16:21:28 normalization > 16:21:19.718612 [debug] [Thread-3  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:19.719656 [debug] [Thread-3  ]: Database Error in model deposit_scd (models/generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql)
2022-06-20 16:21:28 normalization >   Invalid timestamp string "0000-12-30T00:00:00Z"
2022-06-20 16:21:28 normalization >   compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql
2022-06-20 16:21:28 normalization > 16:21:19.720252 [error] [Thread-3  ]: 7 of 12 ERROR creating incremental model raw_checkmate.deposit_scd...................................................... [ERROR in 6.54s]
2022-06-20 16:21:28 normalization > 16:21:19.720794 [debug] [Thread-3  ]: Finished running node model.airbyte_utils.deposit_scd
2022-06-20 16:21:28 normalization > 16:21:19.721947 [debug] [Thread-5  ]: Began running node model.airbyte_utils.deposit
2022-06-20 16:21:28 normalization > 16:21:19.722367 [info ] [Thread-5  ]: 9 of 12 SKIP relation raw_checkmate.deposit............................................................................. [SKIP]
2022-06-20 16:21:28 normalization > 16:21:19.722871 [debug] [Thread-5  ]: Finished running node model.airbyte_utils.deposit
2022-06-20 16:21:28 normalization > 16:21:19.933698 [debug] [Thread-1  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:19.934849 [info ] [Thread-1  ]: 5 of 12 OK created incremental model raw_checkmate.bank_config_scd...................................................... [CREATE TABLE (0.0 rows, 0 processed) in 6.81s]
2022-06-20 16:21:28 normalization > 16:21:19.935463 [debug] [Thread-1  ]: Finished running node model.airbyte_utils.bank_config_scd
2022-06-20 16:21:28 normalization > 16:21:19.936358 [debug] [Thread-6  ]: Began running node model.airbyte_utils.bank_config
2022-06-20 16:21:28 normalization > 16:21:19.936791 [info ] [Thread-6  ]: 10 of 12 START incremental model raw_checkmate.bank_config.............................................................. [RUN]
2022-06-20 16:21:28 normalization > 16:21:19.937951 [debug] [Thread-6  ]: Acquiring new bigquery connection "model.airbyte_utils.bank_config"
2022-06-20 16:21:28 normalization > 16:21:19.938171 [debug] [Thread-6  ]: Began compiling node model.airbyte_utils.bank_config
2022-06-20 16:21:28 normalization > 16:21:19.938423 [debug] [Thread-6  ]: Compiling model.airbyte_utils.bank_config
2022-06-20 16:21:28 normalization > 16:21:19.948860 [debug] [Thread-6  ]: Writing injected SQL for node "model.airbyte_utils.bank_config"
2022-06-20 16:21:28 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):161 - Completing future exceptionally...
io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:63) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at java.lang.Thread.run(Thread.java:833) [?:?]
Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	... 3 more
	Suppressed: io.airbyte.workers.exception.WorkerException: Normalization process wasn't successful
		at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:162) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:48) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at java.lang.Thread.run(Thread.java:833) [?:?]
2022-06-20 16:21:28 normalization > 16:21:19.949623 [debug] [Thread-6  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:19.949840 [debug] [Thread-6  ]: Began executing node model.airbyte_utils.bank_config
2022-06-20 16:21:28 normalization > 16:21:19.954158 [debug] [Thread-6  ]: Opening a new connection, currently in state closed
2022-06-20 16:21:28 normalization > 16:21:20.038975 [debug] [Thread-6  ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/mainapi-282501/datasets/raw_checkmate/tables/bank_config?prettyPrint=false: Not found: Table mainapi-282501:raw_checkmate.bank_config
2022-06-20 16:21:28 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling...
2022-06-20 16:21:28 normalization > 16:21:20.043169 [info ] [Thread-6  ]: 16:21:20 + `mainapi-282501`.raw_checkmate.`bank_config`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-06-20 16:21:28 normalization > 16:21:20.047510 [debug] [Thread-6  ]: Writing runtime SQL for node "model.airbyte_utils.bank_config"
2022-06-20 16:21:28 normalization > 16:21:20.048281 [debug] [Thread-6  ]: On model.airbyte_utils.bank_config: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.bank_config"} */
2022-06-20 16:21:28 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):236 - Stopping temporal heartbeating...
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`bank_config`
2022-06-20 16:21:28 normalization >   partition by timestamp_trunc(_airbyte_emitted_at, day)
2022-06-20 16:21:28 normalization >   cluster by _airbyte_unique_key, _airbyte_emitted_at
2022-06-20 16:21:28 normalization >   OPTIONS()
2022-06-20 16:21:28 normalization >   as (
2022-06-20 16:21:28 normalization >     
2022-06-20 16:21:28 normalization > -- Final base SQL model
2022-06-20 16:21:28 normalization > -- depends_on: `mainapi-282501`.raw_checkmate.`bank_config_scd`
2022-06-20 16:21:28 normalization > select
2022-06-20 16:21:28 normalization >     _airbyte_unique_key,
2022-06-20 16:21:28 WARN i.t.i.a.POJOActivityTaskHandler(activityFailureToResult):307 - Activity failure. ActivityId=823e4e33-808d-3da1-9836-934675c152c1, activityType=Normalize, attempt=1
java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:234) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.normalize(NormalizationActivityImpl.java:75) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at jdk.internal.reflect.GeneratedMethodAccessor419.invoke(Unknown Source) ~[?:?]
	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
	at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?]
	at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?]
	at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?]
	at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?]
	at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?]
	at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?]
	at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
	at java.lang.Thread.run(Thread.java:833) [?:?]
Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:56) ~[temporal-serviceclient-1.8.1.jar:?]
	at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:448) ~[temporal-sdk-1.8.1.jar:?]
	at io.temporal.activity.Activity.wrap(Activity.java:51) ~[temporal-sdk-1.8.1.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:138) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:229) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	... 13 more
Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?]
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:132) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:229) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	... 13 more
Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:63) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	... 1 more
Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	... 1 more
	Suppressed: io.airbyte.workers.exception.WorkerException: Normalization process wasn't successful
		at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:162) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:48) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at java.lang.Thread.run(Thread.java:833) [?:?]
2022-06-20 16:21:28 normalization >     name,
2022-06-20 16:21:28 normalization >     bank_id,
2022-06-20 16:21:28 normalization >     _ab_cdc_lsn,
2022-06-20 16:21:28 normalization >     timestamp_ch,
2022-06-20 16:21:28 normalization >     timestamp_cr,
2022-06-20 16:21:28 normalization >     hold_duration,
2022-06-20 16:21:28 normalization >     bank_config_id,
2022-06-20 16:21:28 normalization >     vendor_bank_id,
2022-06-20 16:21:28 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:21:28 normalization >     _ab_cdc_updated_at,
2022-06-20 16:21:28 normalization >     inbound_upload_path,
2022-06-20 16:21:28 normalization >     outbound_upload_path,
2022-06-20 16:21:28 normalization >     hold_amount_percentage,
2022-06-20 16:21:28 normalization >     _airbyte_ab_id,
2022-06-20 16:21:28 normalization >     _airbyte_emitted_at,
2022-06-20 16:21:28 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:21:28 normalization >     _airbyte_bank_config_hashid
2022-06-20 16:21:28 normalization > from `mainapi-282501`.raw_checkmate.`bank_config_scd`
2022-06-20 16:21:28 normalization > -- bank_config from `mainapi-282501`.raw_checkmate._airbyte_raw_bank_config
2022-06-20 16:21:28 normalization > where 1 = 1
2022-06-20 16:21:28 normalization > and _airbyte_active_row = 1
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >   );
2022-06-20 16:21:28 normalization >   
2022-06-20 16:21:28 normalization > 16:21:20.202524 [debug] [Thread-4  ]: On model.airbyte_utils.vendor_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.vendor_config_scd"} */
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >         drop view _airbyte_raw_checkmate.vendor_config_stg
2022-06-20 16:21:28 normalization >       
2022-06-20 16:21:28 normalization > 16:21:20.205921 [debug] [Thread-7  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:20.209877 [info ] [Thread-7  ]: 8 of 12 OK created incremental model raw_checkmate.inbound_file_metadata_scd............................................ [CREATE TABLE (0.0 rows, 0 processed) in 6.98s]
2022-06-20 16:21:28 normalization > 16:21:20.210691 [debug] [Thread-7  ]: Finished running node model.airbyte_utils.inbound_file_metadata_scd
2022-06-20 16:21:28 normalization > 16:21:20.211598 [debug] [Thread-3  ]: Began running node model.airbyte_utils.inbound_file_metadata
2022-06-20 16:21:28 normalization > 16:21:20.211989 [info ] [Thread-3  ]: 11 of 12 START incremental model raw_checkmate.inbound_file_metadata.................................................... [RUN]
2022-06-20 16:21:28 normalization > 16:21:20.213154 [debug] [Thread-3  ]: Acquiring new bigquery connection "model.airbyte_utils.inbound_file_metadata"
2022-06-20 16:21:28 normalization > 16:21:20.213374 [debug] [Thread-3  ]: Began compiling node model.airbyte_utils.inbound_file_metadata
2022-06-20 16:21:28 normalization > 16:21:20.213586 [debug] [Thread-3  ]: Compiling model.airbyte_utils.inbound_file_metadata
2022-06-20 16:21:28 normalization > 16:21:20.223861 [debug] [Thread-3  ]: Writing injected SQL for node "model.airbyte_utils.inbound_file_metadata"
2022-06-20 16:21:28 normalization > 16:21:20.224511 [debug] [Thread-3  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:20.224721 [debug] [Thread-3  ]: Began executing node model.airbyte_utils.inbound_file_metadata
2022-06-20 16:21:28 normalization > 16:21:20.228906 [debug] [Thread-3  ]: Opening a new connection, currently in state closed
2022-06-20 16:21:28 normalization > 16:21:20.363721 [debug] [Thread-3  ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/mainapi-282501/datasets/raw_checkmate/tables/inbound_file_metadata?prettyPrint=false: Not found: Table mainapi-282501:raw_checkmate.inbound_file_metadata
2022-06-20 16:21:28 normalization > 16:21:20.365730 [info ] [Thread-3  ]: 16:21:20 + `mainapi-282501`.raw_checkmate.`inbound_file_metadata`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-06-20 16:21:28 normalization > 16:21:20.369853 [debug] [Thread-3  ]: Writing runtime SQL for node "model.airbyte_utils.inbound_file_metadata"
2022-06-20 16:21:28 normalization > 16:21:20.370542 [debug] [Thread-3  ]: On model.airbyte_utils.inbound_file_metadata: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.inbound_file_metadata"} */
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`inbound_file_metadata`
2022-06-20 16:21:28 normalization >   partition by timestamp_trunc(_airbyte_emitted_at, day)
2022-06-20 16:21:28 normalization >   cluster by _airbyte_unique_key, _airbyte_emitted_at
2022-06-20 16:21:28 normalization >   OPTIONS()
2022-06-20 16:21:28 normalization >   as (
2022-06-20 16:21:28 normalization >     
2022-06-20 16:21:28 normalization > -- Final base SQL model
2022-06-20 16:21:28 normalization > -- depends_on: `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd`
2022-06-20 16:21:28 normalization > select
2022-06-20 16:21:28 normalization >     _airbyte_unique_key,
2022-06-20 16:21:28 normalization >     file_hash,
2022-06-20 16:21:28 normalization >     file_name,
2022-06-20 16:21:28 normalization >     _ab_cdc_lsn,
2022-06-20 16:21:28 normalization >     timestamp_ch,
2022-06-20 16:21:28 normalization >     timestamp_cr,
2022-06-20 16:21:28 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:21:28 normalization >     _ab_cdc_updated_at,
2022-06-20 16:21:28 normalization >     inbound_file_metadata_id,
2022-06-20 16:21:28 normalization >     _airbyte_ab_id,
2022-06-20 16:21:28 normalization >     _airbyte_emitted_at,
2022-06-20 16:21:28 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:21:28 normalization >     _airbyte_inbound_file_metadata_hashid
2022-06-20 16:21:28 normalization > from `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd`
2022-06-20 16:21:28 normalization > -- inbound_file_metadata from `mainapi-282501`.raw_checkmate._airbyte_raw_inbound_file_metadata
2022-06-20 16:21:28 normalization > where 1 = 1
2022-06-20 16:21:28 normalization > and _airbyte_active_row = 1
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >   );
2022-06-20 16:21:28 normalization >   
2022-06-20 16:21:28 normalization > 16:21:20.720087 [debug] [Thread-4  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:20.721184 [info ] [Thread-4  ]: 6 of 12 OK created incremental model raw_checkmate.vendor_config_scd.................................................... [CREATE TABLE (1.0 rows, 425.0 Bytes processed) in 7.55s]
2022-06-20 16:21:28 normalization > 16:21:20.721701 [debug] [Thread-4  ]: Finished running node model.airbyte_utils.vendor_config_scd
2022-06-20 16:21:28 normalization > 16:21:20.722621 [debug] [Thread-5  ]: Began running node model.airbyte_utils.vendor_config
2022-06-20 16:21:28 normalization > 16:21:20.722999 [info ] [Thread-5  ]: 12 of 12 START incremental model raw_checkmate.vendor_config............................................................ [RUN]
2022-06-20 16:21:28 normalization > 16:21:20.724238 [debug] [Thread-5  ]: Acquiring new bigquery connection "model.airbyte_utils.vendor_config"
2022-06-20 16:21:28 normalization > 16:21:20.724485 [debug] [Thread-5  ]: Began compiling node model.airbyte_utils.vendor_config
2022-06-20 16:21:28 normalization > 16:21:20.724683 [debug] [Thread-5  ]: Compiling model.airbyte_utils.vendor_config
2022-06-20 16:21:28 normalization > 16:21:20.735270 [debug] [Thread-5  ]: Writing injected SQL for node "model.airbyte_utils.vendor_config"
2022-06-20 16:21:28 normalization > 16:21:20.735965 [debug] [Thread-5  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:20.736181 [debug] [Thread-5  ]: Began executing node model.airbyte_utils.vendor_config
2022-06-20 16:21:28 normalization > 16:21:20.740436 [debug] [Thread-5  ]: Opening a new connection, currently in state init
2022-06-20 16:21:28 normalization > 16:21:20.843339 [debug] [Thread-5  ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/mainapi-282501/datasets/raw_checkmate/tables/vendor_config?prettyPrint=false: Not found: Table mainapi-282501:raw_checkmate.vendor_config
2022-06-20 16:21:28 normalization > 16:21:20.845376 [info ] [Thread-5  ]: 16:21:20 + `mainapi-282501`.raw_checkmate.`vendor_config`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-06-20 16:21:28 normalization > 16:21:20.849681 [debug] [Thread-5  ]: Writing runtime SQL for node "model.airbyte_utils.vendor_config"
2022-06-20 16:21:28 normalization > 16:21:20.850375 [debug] [Thread-5  ]: On model.airbyte_utils.vendor_config: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.vendor_config"} */
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`vendor_config`
2022-06-20 16:21:28 normalization >   partition by timestamp_trunc(_airbyte_emitted_at, day)
2022-06-20 16:21:28 normalization >   cluster by _airbyte_unique_key, _airbyte_emitted_at
2022-06-20 16:21:28 normalization >   OPTIONS()
2022-06-20 16:21:28 normalization >   as (
2022-06-20 16:21:28 normalization >     
2022-06-20 16:21:28 normalization > -- Final base SQL model
2022-06-20 16:21:28 normalization > -- depends_on: `mainapi-282501`.raw_checkmate.`vendor_config_scd`
2022-06-20 16:21:28 normalization > select
2022-06-20 16:21:28 normalization >     _airbyte_unique_key,
2022-06-20 16:21:28 normalization >     name,
2022-06-20 16:21:28 normalization >     _ab_cdc_lsn,
2022-06-20 16:21:28 normalization >     timestamp_ch,
2022-06-20 16:21:28 normalization >     timestamp_cr,
2022-06-20 16:21:28 normalization >     vendor_config_id,
2022-06-20 16:21:28 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:21:28 normalization >     _ab_cdc_updated_at,
2022-06-20 16:21:28 normalization >     inbound_upload_path,
2022-06-20 16:21:28 normalization >     outbound_upload_path,
2022-06-20 16:21:28 normalization >     _airbyte_ab_id,
2022-06-20 16:21:28 normalization >     _airbyte_emitted_at,
2022-06-20 16:21:28 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:21:28 normalization >     _airbyte_vendor_config_hashid
2022-06-20 16:21:28 normalization > from `mainapi-282501`.raw_checkmate.`vendor_config_scd`
2022-06-20 16:21:28 normalization > -- vendor_config from `mainapi-282501`.raw_checkmate._airbyte_raw_vendor_config
2022-06-20 16:21:28 normalization > where 1 = 1
2022-06-20 16:21:28 normalization > and _airbyte_active_row = 1
2022-06-20 16:21:28 normalization > 
2022-06-20 16:21:28 normalization >   );
2022-06-20 16:21:28 normalization >   
2022-06-20 16:21:28 normalization > 16:21:22.433161 [debug] [Thread-6  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:22.434348 [info ] [Thread-6  ]: 10 of 12 OK created incremental model raw_checkmate.bank_config......................................................... [CREATE TABLE (0.0 rows, 0 processed) in 2.50s]
2022-06-20 16:21:28 normalization > 16:21:22.434868 [debug] [Thread-6  ]: Finished running node model.airbyte_utils.bank_config
2022-06-20 16:21:28 normalization > 16:21:22.660627 [debug] [Thread-3  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:22.661824 [info ] [Thread-3  ]: 11 of 12 OK created incremental model raw_checkmate.inbound_file_metadata............................................... [CREATE TABLE (0.0 rows, 0 processed) in 2.45s]
2022-06-20 16:21:28 normalization > 16:21:22.662463 [debug] [Thread-3  ]: Finished running node model.airbyte_utils.inbound_file_metadata
2022-06-20 16:21:28 normalization > 16:21:23.173171 [debug] [Thread-5  ]: finished collecting timing info
2022-06-20 16:21:28 normalization > 16:21:23.174519 [info ] [Thread-5  ]: 12 of 12 OK created incremental model raw_checkmate.vendor_config....................................................... [CREATE TABLE (1.0 rows, 282.0 Bytes processed) in 2.45s]
2022-06-20 16:21:28 normalization > 16:21:23.175099 [debug] [Thread-5  ]: Finished running node model.airbyte_utils.vendor_config
2022-06-20 16:21:28 normalization > 16:21:23.178541 [debug] [MainThread]: Acquiring new bigquery connection "master"
2022-06-20 16:21:28 normalization > 16:21:23.179722 [info ] [MainThread]: 
2022-06-20 16:21:28 normalization > 16:21:23.180294 [info ] [MainThread]: Finished running 4 view models, 8 incremental models in 12.13s.
2022-06-20 16:21:28 normalization > 16:21:23.180873 [debug] [MainThread]: Connection 'master' was properly closed.
2022-06-20 16:21:28 normalization > 16:21:23.181246 [debug] [MainThread]: Connection 'model.airbyte_utils.bank_config_scd' was properly closed.
2022-06-20 16:21:28 normalization > 16:21:23.181562 [debug] [MainThread]: Connection 'model.airbyte_utils.deposit_ab1' was properly closed.
2022-06-20 16:21:28 normalization > 16:21:23.181740 [debug] [MainThread]: Connection 'model.airbyte_utils.inbound_file_metadata' was properly closed.
2022-06-20 16:21:28 normalization > 16:21:23.181901 [debug] [MainThread]: Connection 'model.airbyte_utils.vendor_config_scd' was properly closed.
2022-06-20 16:21:28 normalization > 16:21:23.182059 [debug] [MainThread]: Connection 'model.airbyte_utils.bank_config' was properly closed.
2022-06-20 16:21:28 normalization > 16:21:23.182295 [debug] [MainThread]: Connection 'model.airbyte_utils.deposit_stg' was properly closed.
2022-06-20 16:21:28 normalization > 16:21:23.182472 [debug] [MainThread]: Connection 'model.airbyte_utils.inbound_file_metadata_scd' was properly closed.
2022-06-20 16:21:28 normalization > 16:21:23.182641 [debug] [MainThread]: Connection 'model.airbyte_utils.vendor_config' was properly closed.
2022-06-20 16:21:28 normalization > 16:21:23.210553 [info ] [MainThread]: 
2022-06-20 16:21:28 normalization > 16:21:23.211120 [info ] [MainThread]: Completed with 1 error and 0 warnings:
2022-06-20 16:21:28 normalization > 16:21:23.211807 [info ] [MainThread]: 
2022-06-20 16:21:28 normalization > 16:21:23.212416 [error] [MainThread]: Database Error in model deposit_scd (models/generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql)
2022-06-20 16:21:28 normalization > 16:21:23.213103 [error] [MainThread]:   Invalid timestamp string "0000-12-30T00:00:00Z"
2022-06-20 16:21:28 normalization > 16:21:23.213663 [error] [MainThread]:   compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql
2022-06-20 16:21:28 normalization > 16:21:23.214300 [info ] [MainThread]: 
2022-06-20 16:21:28 normalization > 16:21:23.214839 [info ] [MainThread]: Done. PASS=10 WARN=0 ERROR=1 SKIP=1 TOTAL=12
2022-06-20 16:21:28 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.plugin: is not defined in the schema and the schema does not allow additional properties, $.publication: is not defined in the schema and the schema does not allow additional properties, $.replication_slot: is not defined in the schema and the schema does not allow additional properties, $.method: does not have a value in the enumeration [Standard], $.method: must be a constant value Standard
2022-06-20 16:21:28 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.credential: is not defined in the schema and the schema does not allow additional properties, $.part_size_mb: is not defined in the schema and the schema does not allow additional properties, $.gcs_bucket_name: is not defined in the schema and the schema does not allow additional properties, $.gcs_bucket_path: is not defined in the schema and the schema does not allow additional properties, $.keep_files_in_gcs-bucket: is not defined in the schema and the schema does not allow additional properties, $.method: must be a constant value Standard
2022-06-20 16:21:28 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.credential.hmac_key_access_id: object found, string expected, $.credential.hmac_key_secret: object found, string expected
2022-06-20 16:21:28 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/81417/1/logs.log
2022-06-20 16:21:28 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.19-alpha
2022-06-20 16:21:29 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-postgres:0.4.24 exists...
2022-06-20 16:21:29 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-postgres:0.4.24 was found locally.
2022-06-20 16:21:29 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 81417
2022-06-20 16:21:29 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/81417/1 --log-driver none --name source-postgres-check-81417-1-mbwyi --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:0.4.24 -e AIRBYTE_VERSION=0.39.19-alpha -e WORKER_JOB_ID=81417 airbyte/source-postgres:0.4.24 check --config source_config.json
2022-06-20 16:21:29 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings.
2022-06-20 16:21:29 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:21:29 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:21:29 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2022-06-20 16:21:29 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-06-20 16:21:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:30 INFO i.a.i.s.p.PostgresSource(main):409 - starting source: class io.airbyte.integrations.source.postgres.PostgresSource
2022-06-20 16:21:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:30 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json}
2022-06-20 16:21:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:30 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2022-06-20 16:21:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:30 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK
2022-06-20 16:21:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:30 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}
2022-06-20 16:21:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:30 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:21:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:30 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:21:30 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:30 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:21:31 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:31 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:21:31 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:31 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL
2022-06-20 16:21:31 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:31 INFO c.z.h.HikariDataSource(<init>):80 - HikariPool-1 - Starting...
2022-06-20 16:21:31 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:31 INFO c.z.h.HikariDataSource(<init>):82 - HikariPool-1 - Start completed.
2022-06-20 16:21:31 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:31 INFO i.a.i.s.p.PostgresSource(isCdc):258 - using CDC: true
2022-06-20 16:21:31 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:31 INFO i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):93 - Attempting to get metadata from the database to see if we can connect.
2022-06-20 16:21:31 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:31 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$1):173 - Attempting to find the named replication slot using the query: HikariProxyPreparedStatement@358019805 wrapping SELECT * FROM pg_replication_slots WHERE slot_name = 'airbyte_slot_checkmate' AND plugin = 'wal2json' AND database = 'checkmate'
2022-06-20 16:21:31 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:31 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows
2022-06-20 16:21:32 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:31 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$3):191 - Attempting to find the publication using the query: HikariProxyPreparedStatement@623051334 wrapping SELECT * FROM pg_publication WHERE pubname = 'checkmate_publication'
2022-06-20 16:21:32 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:31 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows
2022-06-20 16:21:32 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:32 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated...
2022-06-20 16:21:32 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:32 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed.
2022-06-20 16:21:32 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling...
2022-06-20 16:21:32 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/81417/1/logs.log
2022-06-20 16:21:32 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.19-alpha
2022-06-20 16:21:32 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.8 exists...
2022-06-20 16:21:32 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.8 was found locally.
2022-06-20 16:21:32 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 81417
2022-06-20 16:21:32 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/81417/1 --log-driver none --name destination-bigquery-check-81417-1-zzzwt --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.8 -e AIRBYTE_VERSION=0.39.19-alpha -e WORKER_JOB_ID=81417 airbyte/destination-bigquery:1.1.8 check --config source_config.json
2022-06-20 16:21:32 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings.
2022-06-20 16:21:32 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:21:32 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:21:32 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:21:32 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2022-06-20 16:21:33 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-06-20 16:21:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:34 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json}
2022-06-20 16:21:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:34 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2022-06-20 16:21:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:34 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK
2022-06-20 16:21:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:34 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}
2022-06-20 16:21:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:34 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:21:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:34 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:21:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:34 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:21:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:34 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):303 - Selected loading method is set to: GCS
2022-06-20 16:21:35 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:35 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"CSV","flattening":"No flattening","part_size_mb":"5"}
2022-06-20 16:21:36 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:36 INFO i.a.i.d.s.S3Destination(testSingleUpload):81 - Started testing if all required credentials assigned to user for single file uploading
2022-06-20 16:21:36 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:36 INFO i.a.i.d.s.S3Destination(testSingleUpload):91 - Finished checking for normal upload mode
2022-06-20 16:21:36 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:36 INFO i.a.i.d.s.S3Destination(testMultipartUpload):95 - Started testing if all required credentials assigned to user for multipart upload
2022-06-20 16:21:37 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:37 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to synctera-data-staging/airbyte/test_1655742096933 with full ID ABPnzm4hxDtppNauDnnlGwqlfRPIjvuLmDRMW14U1v5yWVs7GWS_vQRthy0CokZhXUYl8tQ
2022-06-20 16:21:37 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:37 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000]
2022-06-20 16:21:37 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:37 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000]
2022-06-20 16:21:37 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:37 WARN a.m.s.MultiPartOutputStream(close):160 - [MultipartOutputStream for parts 1 - 10000] is already closed
2022-06-20 16:21:37 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:37 INFO a.m.s.StreamTransferManager(complete):367 - [Manager uploading to synctera-data-staging/airbyte/test_1655742096933 with id ABPnzm4hx...ZhXUYl8tQ]: Uploading leftover stream [Part number 1 containing 3.34 MB]
2022-06-20 16:21:37 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:37 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to synctera-data-staging/airbyte/test_1655742096933 with id ABPnzm4hx...ZhXUYl8tQ]: Finished uploading [Part number 1 containing 3.34 MB]
2022-06-20 16:21:37 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:37 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to synctera-data-staging/airbyte/test_1655742096933 with id ABPnzm4hx...ZhXUYl8tQ]: Completed
2022-06-20 16:21:38 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:21:38 INFO i.a.i.d.s.S3Destination(testMultipartUpload):119 - Finished verification for multipart upload mode
2022-06-20 16:21:38 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling...
2022-06-20 16:21:38 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/81417/1/logs.log
2022-06-20 16:21:38 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.19-alpha
2022-06-20 16:21:38 INFO i.a.w.g.DefaultReplicationWorker(run):115 - start sync worker. job id: 81417 attempt id: 1
2022-06-20 16:21:38 INFO i.a.w.g.DefaultReplicationWorker(run):127 - configured sync modes: {public.bank_config=incremental - append_dedup, public.deposit=incremental - append_dedup, public.vendor_config=incremental - append_dedup, public.inbound_file_metadata=incremental - append_dedup}
2022-06-20 16:21:38 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination...
2022-06-20 16:21:38 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.8 exists...
2022-06-20 16:21:39 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.8 was found locally.
2022-06-20 16:21:39 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 81417
2022-06-20 16:21:39 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/81417/1 --log-driver none --name destination-bigquery-write-81417-1-phqvz --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.8 -e AIRBYTE_VERSION=0.39.19-alpha -e WORKER_JOB_ID=81417 airbyte/destination-bigquery:1.1.8 write --config destination_config.json --catalog destination_catalog.json
2022-06-20 16:21:39 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-postgres:0.4.24 exists...
2022-06-20 16:21:39 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-postgres:0.4.24 was found locally.
2022-06-20 16:21:39 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 81417
2022-06-20 16:21:39 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/81417/1 --log-driver none --name source-postgres-read-81417-1-qbjpk --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:0.4.24 -e AIRBYTE_VERSION=0.39.19-alpha -e WORKER_JOB_ID=81417 airbyte/source-postgres:0.4.24 read --config source_config.json --catalog source_catalog.json --state input_state.json
2022-06-20 16:21:39 INFO i.a.w.g.DefaultReplicationWorker(run):169 - Waiting for source and destination threads to complete.
2022-06-20 16:21:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):395 - Destination output thread started.
2022-06-20 16:21:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):298 - Replication thread started.
2022-06-20 16:21:39 source > SLF4J: Class path contains multiple SLF4J bindings.
2022-06-20 16:21:39 source > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:21:39 source > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:21:39 source > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2022-06-20 16:21:39 destination > SLF4J: Class path contains multiple SLF4J bindings.
2022-06-20 16:21:39 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:21:39 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:21:39 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:21:39 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2022-06-20 16:21:39 source > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-06-20 16:21:40 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-06-20 16:21:41 destination > 2022-06-20 16:21:41 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2022-06-20 16:21:41 destination > 2022-06-20 16:21:41 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2022-06-20 16:21:41 destination > 2022-06-20 16:21:41 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE
2022-06-20 16:21:41 destination > 2022-06-20 16:21:41 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2022-06-20 16:21:41 source > 2022-06-20 16:21:41 INFO i.a.i.s.p.PostgresSource(main):409 - starting source: class io.airbyte.integrations.source.postgres.PostgresSource
2022-06-20 16:21:41 source > 2022-06-20 16:21:41 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {read=null, catalog=source_catalog.json, state=input_state.json, config=source_config.json}
2022-06-20 16:21:41 source > 2022-06-20 16:21:41 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2022-06-20 16:21:41 source > 2022-06-20 16:21:41 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: READ
2022-06-20 16:21:41 source > 2022-06-20 16:21:41 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='input_state.json'}
2022-06-20 16:21:42 destination > 2022-06-20 16:21:42 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:21:42 destination > 2022-06-20 16:21:42 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:21:42 destination > 2022-06-20 16:21:42 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:21:42 destination > 2022-06-20 16:21:42 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):303 - Selected loading method is set to: GCS
2022-06-20 16:21:42 source > 2022-06-20 16:21:42 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:21:42 source > 2022-06-20 16:21:42 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:21:42 source > 2022-06-20 16:21:42 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:21:42 source > 2022-06-20 16:21:42 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:21:42 destination > 2022-06-20 16:21:42 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"AVRO","flattening":"No flattening","part_size_mb":"5"}
2022-06-20 16:21:42 destination > 2022-06-20 16:21:42 INFO i.a.i.d.b.BigQueryUtils(isKeepFilesInGcs):319 - All tmp files will be removed from GCS when replication is finished
2022-06-20 16:21:42 source > 2022-06-20 16:21:42 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL
2022-06-20 16:21:43 source > 2022-06-20 16:21:43 INFO c.z.h.HikariDataSource(<init>):80 - HikariPool-1 - Starting...
2022-06-20 16:21:43 source > 2022-06-20 16:21:43 INFO c.z.h.HikariDataSource(<init>):82 - HikariPool-1 - Start completed.
2022-06-20 16:21:43 destination > 2022-06-20 16:21:43 INFO i.a.i.d.b.BigQueryDestination(getGcsRecordConsumer):289 - Creating BigQuery staging message consumer with staging ID 7ecff322-7ed0-4832-b05a-9f3e9c9ab462 at 2022-06-20T16:21:42.624Z
2022-06-20 16:21:43 destination > 2022-06-20 16:21:43 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$createWriteConfigs$1):86 - BigQuery write config: BigQueryWriteConfig[streamName=bank_config, namespace=raw_checkmate, datasetId=raw_checkmate, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_fig_bank_config}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_bank_config}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]]
2022-06-20 16:21:43 destination > 2022-06-20 16:21:43 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$createWriteConfigs$1):86 - BigQuery write config: BigQueryWriteConfig[streamName=deposit, namespace=raw_checkmate, datasetId=raw_checkmate, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_axw_deposit}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_deposit}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]]
2022-06-20 16:21:43 destination > 2022-06-20 16:21:43 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$createWriteConfigs$1):86 - BigQuery write config: BigQueryWriteConfig[streamName=inbound_file_metadata, namespace=raw_checkmate, datasetId=raw_checkmate, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_kfp_inbound_file_metadata}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_inbound_file_metadata}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]]
2022-06-20 16:21:43 destination > 2022-06-20 16:21:43 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$createWriteConfigs$1):86 - BigQuery write config: BigQueryWriteConfig[streamName=vendor_config, namespace=raw_checkmate, datasetId=raw_checkmate, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_vih_vendor_config}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_vendor_config}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]]
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.p.PostgresSource(isCdc):258 - using CDC: true
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):93 - Attempting to get metadata from the database to see if we can connect.
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$1):173 - Attempting to find the named replication slot using the query: HikariProxyPreparedStatement@1237144823 wrapping SELECT * FROM pg_replication_slots WHERE slot_name = 'airbyte_slot_checkmate' AND plugin = 'wal2json' AND database = 'checkmate'
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows
2022-06-20 16:21:44 destination > 2022-06-20 16:21:44 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started.
2022-06-20 16:21:44 destination > 2022-06-20 16:21:44 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):98 - Preparing tmp tables in destination started for 4 streams
2022-06-20 16:21:44 destination > 2022-06-20 16:21:44 INFO i.a.i.d.b.BigQueryGcsOperations(createSchemaIfNotExists):86 - Creating dataset raw_checkmate
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$3):191 - Attempting to find the publication using the query: HikariProxyPreparedStatement@1425405511 wrapping SELECT * FROM pg_publication WHERE pubname = 'checkmate_publication'
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated...
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed.
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.r.CdcStateManager(<init>):26 - Initialized CDC state with: null
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='bank_config', namespace='public'}, New Cursor Field: timestamp_ch. Resetting cursor value
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='deposit', namespace='public'}, New Cursor Field: timestamp_ch. Resetting cursor value
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='vendor_config', namespace='public'}, New Cursor Field: timestamp_ch. Resetting cursor value
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='inbound_file_metadata', namespace='public'}, New Cursor Field: timestamp_ch. Resetting cursor value
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO c.z.h.HikariDataSource(<init>):80 - HikariPool-2 - Starting...
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO c.z.h.HikariDataSource(<init>):82 - HikariPool-2 - Start completed.
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.p.PostgresSource(discoverInternal):144 - Checking schema: public
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(discoverInternal):121 - Internal schemas to exclude: [catalog_history, information_schema, pg_catalog, pg_internal]
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table schema_migrations column version (type int8[19]) -> JsonSchemaType({type=number})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table schema_migrations column dirty (type bool[1]) -> JsonSchemaType({type=boolean})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column bank_config_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column bank_id (type int2[5]) -> JsonSchemaType({type=number})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column vendor_bank_id (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column name (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column outbound_upload_path (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column inbound_upload_path (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column timestamp_cr (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column timestamp_ch (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column hold_amount_percentage (type int4[10]) -> JsonSchemaType({type=number})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column hold_duration (type int4[10]) -> JsonSchemaType({type=number})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table inbound_file_metadata column inbound_file_metadata_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table inbound_file_metadata column file_name (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table inbound_file_metadata column file_hash (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table inbound_file_metadata column timestamp_cr (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table inbound_file_metadata column timestamp_ch (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table vendor_config column vendor_config_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table vendor_config column name (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table vendor_config column outbound_upload_path (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table vendor_config column inbound_upload_path (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table vendor_config column timestamp_cr (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table vendor_config column timestamp_ch (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column deposit_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column bank_id (type int2[5]) -> JsonSchemaType({type=number})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column partner_id (type int2[5]) -> JsonSchemaType({type=number})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column account_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column transaction_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column party_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column party_type (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column account_number (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column ocr_account_number (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column check_number (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column status (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column vendor_reference_id (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column vendor_info (type jsonb[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column amount (type int8[19]) -> JsonSchemaType({type=number})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column check_amount (type int8[19]) -> JsonSchemaType({type=number})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column currency (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column date_captured (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column date_processed (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column timestamp_cr (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column timestamp_ch (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column timestamp_de (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column front_image_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column back_image_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column micr (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.p.PostgresSource(discoverInternal):148 - Found table: public.schema_migrations
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.p.PostgresSource(discoverInternal):148 - Found table: public.bank_config
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.p.PostgresSource(discoverInternal):148 - Found table: public.inbound_file_metadata
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.p.PostgresSource(discoverInternal):148 - Found table: public.vendor_config
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.p.PostgresSource(discoverInternal):148 - Found table: public.deposit
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.p.PostgresSource(isCdc):258 - using CDC: true
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.s.p.PostgresCdcTargetPosition(targetPosition):45 - identified target lsn: PgLsn{lsn=360862221408}
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO i.a.i.d.AirbyteDebeziumHandler(getIncrementalIterators):72 - using CDC: true
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 INFO o.a.k.c.c.AbstractConfig(logAll):354 - EmbeddedConfig values: 
2022-06-20 16:21:44 source > 	access.control.allow.methods = 
2022-06-20 16:21:44 source > 	access.control.allow.origin = 
2022-06-20 16:21:44 source > 	admin.listeners = null
2022-06-20 16:21:44 source > 	bootstrap.servers = [localhost:9092]
2022-06-20 16:21:44 source > 	client.dns.lookup = use_all_dns_ips
2022-06-20 16:21:44 source > 	config.providers = []
2022-06-20 16:21:44 source > 	connector.client.config.override.policy = None
2022-06-20 16:21:44 source > 	header.converter = class org.apache.kafka.connect.storage.SimpleHeaderConverter
2022-06-20 16:21:44 source > 	internal.key.converter = class org.apache.kafka.connect.json.JsonConverter
2022-06-20 16:21:44 source > 	internal.value.converter = class org.apache.kafka.connect.json.JsonConverter
2022-06-20 16:21:44 source > 	key.converter = class org.apache.kafka.connect.json.JsonConverter
2022-06-20 16:21:44 source > 	listeners = null
2022-06-20 16:21:44 source > 	metric.reporters = []
2022-06-20 16:21:44 source > 	metrics.num.samples = 2
2022-06-20 16:21:44 source > 	metrics.recording.level = INFO
2022-06-20 16:21:44 source > 	metrics.sample.window.ms = 30000
2022-06-20 16:21:44 source > 	offset.flush.interval.ms = 1000
2022-06-20 16:21:44 source > 	offset.flush.timeout.ms = 5000
2022-06-20 16:21:44 source > 	offset.storage.file.filename = /tmp/cdc-state-offset3614618780051001395/offset.dat
2022-06-20 16:21:44 source > 	offset.storage.partitions = null
2022-06-20 16:21:44 source > 	offset.storage.replication.factor = null
2022-06-20 16:21:44 source > 	offset.storage.topic = 
2022-06-20 16:21:44 source > 	plugin.path = null
2022-06-20 16:21:44 source > 	response.http.headers.config = 
2022-06-20 16:21:44 source > 	rest.advertised.host.name = null
2022-06-20 16:21:44 source > 	rest.advertised.listener = null
2022-06-20 16:21:44 source > 	rest.advertised.port = null
2022-06-20 16:21:44 source > 	rest.extension.classes = []
2022-06-20 16:21:44 source > 	rest.host.name = null
2022-06-20 16:21:44 source > 	rest.port = 8083
2022-06-20 16:21:44 source > 	ssl.cipher.suites = null
2022-06-20 16:21:44 source > 	ssl.client.auth = none
2022-06-20 16:21:44 source > 	ssl.enabled.protocols = [TLSv1.2, TLSv1.3]
2022-06-20 16:21:44 source > 	ssl.endpoint.identification.algorithm = https
2022-06-20 16:21:44 source > 	ssl.engine.factory.class = null
2022-06-20 16:21:44 source > 	ssl.key.password = null
2022-06-20 16:21:44 source > 	ssl.keymanager.algorithm = SunX509
2022-06-20 16:21:44 source > 	ssl.keystore.location = null
2022-06-20 16:21:44 source > 	ssl.keystore.password = null
2022-06-20 16:21:44 source > 	ssl.keystore.type = JKS
2022-06-20 16:21:44 source > 	ssl.protocol = TLSv1.3
2022-06-20 16:21:44 source > 	ssl.provider = null
2022-06-20 16:21:44 source > 	ssl.secure.random.implementation = null
2022-06-20 16:21:44 source > 	ssl.trustmanager.algorithm = PKIX
2022-06-20 16:21:44 source > 	ssl.truststore.location = null
2022-06-20 16:21:44 source > 	ssl.truststore.password = null
2022-06-20 16:21:44 source > 	ssl.truststore.type = JKS
2022-06-20 16:21:44 source > 	task.shutdown.graceful.timeout.ms = 5000
2022-06-20 16:21:44 source > 	topic.creation.enable = true
2022-06-20 16:21:44 source > 	topic.tracking.allow.reset = true
2022-06-20 16:21:44 source > 	topic.tracking.enable = true
2022-06-20 16:21:44 source > 	value.converter = class org.apache.kafka.connect.json.JsonConverter
2022-06-20 16:21:44 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $: unknown found, object expected
2022-06-20 16:21:44 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null
2022-06-20 16:21:44 source > 2022-06-20 16:21:44 WARN o.a.k.c.r.WorkerConfig(logPluginPathConfigProviderWarning):420 - Variables cannot be used in the 'plugin.path' property, since the property is used by plugin scanning before the config providers that replace the variables are initialized. The raw value 'null' was used for plugin scanning, as opposed to the transformed value 'null', and this may cause unexpected results.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "table.blacklist" is deprecated and will be removed in future versions. Please use "table.exclude.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "table.blacklist" is deprecated and will be removed in future versions. Please use "table.exclude.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.whitelist" is deprecated and will be removed in future versions. Please use "schema.include.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.blacklist" is deprecated and will be removed in future versions. Please use "schema.exclude.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.whitelist" is deprecated and will be removed in future versions. Please use "schema.include.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.blacklist" is deprecated and will be removed in future versions. Please use "schema.exclude.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(start):100 - Starting PostgresConnectorTask with configuration:
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    connector.class = io.debezium.connector.postgresql.PostgresConnector
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    max.queue.size = 8192
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    slot.name = airbyte_slot_checkmate
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    publication.name = checkmate_publication
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    offset.storage.file.filename = /tmp/cdc-state-offset3614618780051001395/offset.dat
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    decimal.handling.mode = string
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    converters = datetime
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    datetime.type = io.airbyte.integrations.debezium.internals.PostgresConverter
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    publication.autocreate.mode = disabled
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.user = airbyte_checkmate
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.dbname = checkmate
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    offset.storage = org.apache.kafka.connect.storage.FileOffsetBackingStore
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.server.name = checkmate
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    plugin.name = wal2json
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.port = 5432
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    offset.flush.interval.ms = 1000
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    key.converter.schemas.enable = false
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.hostname = 10.58.160.3
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.password = ********
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    name = checkmate
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    value.converter.schemas.enable = false
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    max.batch.size = 2048
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    table.include.list = public.bank_config,public.deposit,public.inbound_file_metadata,public.vendor_config
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    snapshot.mode = exported
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.include.list = checkmate
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.whitelist" is deprecated and will be removed in future versions. Please use "schema.include.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.blacklist" is deprecated and will be removed in future versions. Please use "schema.exclude.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "table.blacklist" is deprecated and will be removed in future versions. Please use "table.exclude.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:21:45 destination > 2022-06-20 16:21:45 INFO i.a.i.d.b.BigQueryGcsOperations(createTmpTableIfNotExists):94 - Creating tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_vih_vendor_config}}
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.blacklist" is deprecated and will be removed in future versions. Please use "schema.exclude.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "table.blacklist" is deprecated and will be removed in future versions. Please use "table.exclude.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.whitelist" is deprecated and will be removed in future versions. Please use "schema.include.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.blacklist" is deprecated and will be removed in future versions. Please use "schema.exclude.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "table.blacklist" is deprecated and will be removed in future versions. Please use "table.exclude.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.whitelist" is deprecated and will be removed in future versions. Please use "schema.include.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.p.PostgresConnectorTask(start):97 - user 'airbyte_checkmate' connected to database 'checkmate' on PostgreSQL 12.10 on x86_64-pc-linux-gnu, compiled by Debian clang version 12.0.1, 64-bit with roles:
2022-06-20 16:21:45 source > 	role 'cloudsqlsuperuser' [superuser: false, replication: false, inherit: true, create role: true, create db: true, can log in: true]
2022-06-20 16:21:45 source > 	role 'pg_read_all_settings' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: false]
2022-06-20 16:21:45 source > 	role 'pg_stat_scan_tables' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: false]
2022-06-20 16:21:45 source > 	role 'airbyte_checkmate' [superuser: false, replication: true, inherit: true, create role: true, create db: true, can log in: true]
2022-06-20 16:21:45 source > 	role 'pg_monitor' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: false]
2022-06-20 16:21:45 source > 	role 'pg_read_all_stats' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: false]
2022-06-20 16:21:45 source > 	role 'pg_signal_backend' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: false]
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.p.c.PostgresConnection(readReplicationSlotInfo):204 - Obtained valid replication slot ReplicationSlot [active=false, latestFlushedLsn=LSN{53/E11E84E0}, catalogXmin=19514215]
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.p.PostgresConnectorTask(start):106 - No previous offset found
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.p.s.ExportedSnapshotter(shouldSnapshot):38 - Taking exported snapshot for new datasource
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.u.Threads(threadFactory):270 - Requested thread factory for connector PostgresConnector, id = checkmate named = change-event-source-coordinator
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.u.Threads$3(newThread):287 - Creating thread debezium-postgresconnector-checkmate-change-event-source-coordinator
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.p.ChangeEventSourceCoordinator(lambda$start$0):91 - Metrics registered
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.p.ChangeEventSourceCoordinator(lambda$start$0):94 - Context created
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.p.s.ExportedSnapshotter(shouldSnapshot):38 - Taking exported snapshot for new datasource
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.p.PostgresSnapshotChangeEventSource(getSnapshottingTask):69 - According to the connector configuration data will be snapshotted
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):95 - Snapshot step 1 - Preparing
2022-06-20 16:21:45 destination > 2022-06-20 16:21:45 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_vih_vendor_config}}
2022-06-20 16:21:45 destination > 2022-06-20 16:21:45 INFO i.a.i.d.b.BigQueryGcsOperations(createStageIfNotExists):101 - Creating staging path for stream vendor_config (dataset raw_checkmate): airbyte/raw_checkmate_vendor_config/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):104 - Snapshot step 2 - Determining captured tables
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):111 - Snapshot step 3 - Locking captured tables [public.bank_config, public.deposit, public.inbound_file_metadata, public.vendor_config]
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.p.PostgresSnapshotChangeEventSource(lockTablesForSchemaSnapshot):122 - Step 2: skipping locking each table in an exported snapshot
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):117 - Snapshot step 4 - Determining snapshot offset
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.p.PostgresOffsetContext(initialContext):235 - Creating initial offset context
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.p.PostgresOffsetContext(initialContext):238 - Read xlogStart at 'LSN{54/5108460}' from transaction '19622769'
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.p.PostgresSnapshotChangeEventSource(updateOffsetForSnapshot):155 - Read xlogStart at 'LSN{54/5108460}' from transaction '19622769'
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):120 - Snapshot step 5 - Reading structure of captured tables
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.p.PostgresSnapshotChangeEventSource(readTableStructure):198 - Reading structure of schema 'checkmate'
2022-06-20 16:21:45 destination > 2022-06-20 16:21:45 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):97 - Storage Object synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/ does not exist in bucket; creating...
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):124 - Snapshot step 6 - Persisting schema history
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):136 - Snapshot step 7 - Snapshotting data
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):306 - 	 Exporting data from table 'public.bank_config'
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):314 - 	 For table 'public.bank_config' using select statement: 'select * from "public"."bank_config"'
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):356 - 	 Finished exporting 0 records for table 'public.bank_config'; total duration '00:00:00.004'
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):306 - 	 Exporting data from table 'public.deposit'
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):314 - 	 For table 'public.deposit' using select statement: 'select * from "public"."deposit"'
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):356 - 	 Finished exporting 18 records for table 'public.deposit'; total duration '00:00:00.076'
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):306 - 	 Exporting data from table 'public.inbound_file_metadata'
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):314 - 	 For table 'public.inbound_file_metadata' using select statement: 'select * from "public"."inbound_file_metadata"'
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):356 - 	 Finished exporting 0 records for table 'public.inbound_file_metadata'; total duration '00:00:00.006'
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):306 - 	 Exporting data from table 'public.vendor_config'
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):314 - 	 For table 'public.vendor_config' using select statement: 'select * from "public"."vendor_config"'
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):356 - 	 Finished exporting 1 records for table 'public.vendor_config'; total duration '00:00:00.026'
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.p.s.AbstractSnapshotChangeEventSource(execute):85 - Snapshot - Final stage
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.p.ChangeEventSourceCoordinator(lambda$start$0):106 - Snapshot ended with SnapshotResult [status=COMPLETED, offset=PostgresOffsetContext [sourceInfoSchema=Schema{io.debezium.connector.postgresql.Source:STRUCT}, sourceInfo=source_info[server='checkmate'db='checkmate', lsn=LSN{54/5108460}, txId=19622769, timestamp=2022-06-20T16:21:45.977Z, snapshot=FALSE, schema=public, table=vendor_config], partition={server=checkmate}, lastSnapshotRecord=true, lastCompletelyProcessedLsn=null, lastCommitLsn=null, transactionContext=TransactionContext [currentTransactionId=null, perTableEventCount={}, totalEventCount=0]]]
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.p.m.StreamingChangeEventSourceMetrics(connected):60 - Connected metrics set to 'true'
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.p.ChangeEventSourceCoordinator(streamEvents):139 - Starting streaming
2022-06-20 16:21:45 source > 2022-06-20 16:21:45 INFO i.d.c.p.PostgresStreamingChangeEventSource(execute):104 - Retrieved latest position from stored offset 'LSN{54/5108460}'
2022-06-20 16:21:46 source > 2022-06-20 16:21:46 INFO i.d.c.p.c.WalPositionLocator(<init>):40 - Looking for WAL restart position for last commit LSN 'null' and last change LSN 'LSN{54/5108460}'
2022-06-20 16:21:46 source > 2022-06-20 16:21:46 INFO i.d.c.p.c.PostgresConnection(readReplicationSlotInfo):204 - Obtained valid replication slot ReplicationSlot [active=false, latestFlushedLsn=LSN{53/E11E84E0}, catalogXmin=19514215]
2022-06-20 16:21:46 destination > 2022-06-20 16:21:46 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):99 - Storage Object synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/ has been created in bucket.
2022-06-20 16:21:46 destination > 2022-06-20 16:21:46 INFO i.a.i.d.b.BigQueryGcsOperations(createTmpTableIfNotExists):94 - Creating tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_kfp_inbound_file_metadata}}
2022-06-20 16:21:46 source > 2022-06-20 16:21:46 INFO i.d.j.JdbcConnection(lambda$doClose$3):945 - Connection gracefully closed
2022-06-20 16:21:46 destination > 2022-06-20 16:21:46 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_kfp_inbound_file_metadata}}
2022-06-20 16:21:46 destination > 2022-06-20 16:21:46 INFO i.a.i.d.b.BigQueryGcsOperations(createStageIfNotExists):101 - Creating staging path for stream inbound_file_metadata (dataset raw_checkmate): airbyte/raw_checkmate_inbound_file_metadata/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/
2022-06-20 16:21:46 source > 2022-06-20 16:21:46 INFO i.d.e.EmbeddedEngine(stop):996 - Stopping the embedded engine
2022-06-20 16:21:46 source > 2022-06-20 16:21:46 INFO i.d.e.EmbeddedEngine(stop):1004 - Waiting for PT5M for connector to stop
2022-06-20 16:21:46 source > 2022-06-20 16:21:46 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):116 - REPLICA IDENTITY for 'public.bank_config' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns
2022-06-20 16:21:46 source > 2022-06-20 16:21:46 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):116 - REPLICA IDENTITY for 'public.deposit' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns
2022-06-20 16:21:46 source > 2022-06-20 16:21:46 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):116 - REPLICA IDENTITY for 'public.vendor_config' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns
2022-06-20 16:21:46 source > 2022-06-20 16:21:46 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):116 - REPLICA IDENTITY for 'public.inbound_file_metadata' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns
2022-06-20 16:21:46 source > 2022-06-20 16:21:46 INFO i.d.c.p.PostgresStreamingChangeEventSource(searchWalPosition):268 - Searching for WAL resume position
2022-06-20 16:21:46 destination > 2022-06-20 16:21:46 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):97 - Storage Object synctera-data-staging/airbyte/raw_checkmate_inbound_file_metadata/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/ does not exist in bucket; creating...
2022-06-20 16:21:46 destination > 2022-06-20 16:21:46 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):99 - Storage Object synctera-data-staging/airbyte/raw_checkmate_inbound_file_metadata/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/ has been created in bucket.
2022-06-20 16:21:46 destination > 2022-06-20 16:21:46 INFO i.a.i.d.b.BigQueryGcsOperations(createTmpTableIfNotExists):94 - Creating tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_axw_deposit}}
2022-06-20 16:21:46 destination > 2022-06-20 16:21:46 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_axw_deposit}}
2022-06-20 16:21:46 destination > 2022-06-20 16:21:46 INFO i.a.i.d.b.BigQueryGcsOperations(createStageIfNotExists):101 - Creating staging path for stream deposit (dataset raw_checkmate): airbyte/raw_checkmate_deposit/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/
2022-06-20 16:21:46 destination > 2022-06-20 16:21:46 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):97 - Storage Object synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/ does not exist in bucket; creating...
2022-06-20 16:21:46 source > 2022-06-20 16:21:46 INFO i.d.c.c.BaseSourceTask(stop):192 - Stopping down connector
2022-06-20 16:21:46 destination > 2022-06-20 16:21:46 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):99 - Storage Object synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/ has been created in bucket.
2022-06-20 16:21:46 destination > 2022-06-20 16:21:46 INFO i.a.i.d.b.BigQueryGcsOperations(createTmpTableIfNotExists):94 - Creating tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_fig_bank_config}}
2022-06-20 16:21:47 destination > 2022-06-20 16:21:47 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_fig_bank_config}}
2022-06-20 16:21:47 destination > 2022-06-20 16:21:47 INFO i.a.i.d.b.BigQueryGcsOperations(createStageIfNotExists):101 - Creating staging path for stream bank_config (dataset raw_checkmate): airbyte/raw_checkmate_bank_config/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/
2022-06-20 16:21:47 destination > 2022-06-20 16:21:47 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):97 - Storage Object synctera-data-staging/airbyte/raw_checkmate_bank_config/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/ does not exist in bucket; creating...
2022-06-20 16:21:47 source > 2022-06-20 16:21:47 INFO i.d.c.p.PostgresStreamingChangeEventSource(searchWalPosition):287 - WAL resume position 'null' discovered
2022-06-20 16:21:47 source > 2022-06-20 16:21:47 INFO i.d.j.JdbcConnection(lambda$doClose$3):945 - Connection gracefully closed
2022-06-20 16:21:47 destination > 2022-06-20 16:21:47 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):99 - Storage Object synctera-data-staging/airbyte/raw_checkmate_bank_config/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/ has been created in bucket.
2022-06-20 16:21:47 destination > 2022-06-20 16:21:47 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):107 - Preparing tmp tables in destination completed.
2022-06-20 16:21:47 source > 2022-06-20 16:21:47 INFO i.d.c.p.PostgresStreamingChangeEventSource(processMessages):180 - Processing messages
2022-06-20 16:21:47 source > 2022-06-20 16:21:47 INFO i.d.j.JdbcConnection(lambda$doClose$3):945 - Connection gracefully closed
2022-06-20 16:21:47 source > 2022-06-20 16:21:47 INFO i.d.p.ChangeEventSourceCoordinator(streamEvents):141 - Finished streaming
2022-06-20 16:21:47 source > 2022-06-20 16:21:47 INFO i.d.p.m.StreamingChangeEventSourceMetrics(connected):60 - Connected metrics set to 'false'
2022-06-20 16:21:47 source > 2022-06-20 16:21:47 INFO i.d.j.JdbcConnection(lambda$doClose$3):945 - Connection gracefully closed
2022-06-20 16:21:47 source > 2022-06-20 16:21:47 INFO i.a.i.d.i.DebeziumRecordPublisher(lambda$start$1):85 - Debezium engine shutdown.
2022-06-20 16:21:47 source > 2022-06-20 16:21:47 INFO i.a.i.s.p.PostgresCdcStateHandler(saveState):31 - debezium state: {"{\"schema\":null,\"payload\":[\"checkmate\",{\"server\":\"checkmate\"}]}":"{\"last_snapshot_record\":true,\"lsn\":360862221408,\"txId\":19622769,\"ts_usec\":1655742105977000,\"snapshot\":true}"}
2022-06-20 16:21:47 destination > 2022-06-20 16:21:47 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):55 - Starting a new buffer for stream deposit (current state: 0 bytes in 0 buffers)
2022-06-20 16:21:47 source > 2022-06-20 16:21:47 INFO i.a.i.s.r.AbstractDbSource(lambda$read$2):130 - Closing database connection pool.
2022-06-20 16:21:47 source > 2022-06-20 16:21:47 INFO c.z.h.HikariDataSource(close):350 - HikariPool-2 - Shutdown initiated...
2022-06-20 16:21:47 source > 2022-06-20 16:21:47 INFO c.z.h.HikariDataSource(close):352 - HikariPool-2 - Shutdown completed.
2022-06-20 16:21:47 source > 2022-06-20 16:21:47 INFO i.a.i.s.r.AbstractDbSource(lambda$read$2):132 - Closed database connection pool.
2022-06-20 16:21:47 source > 2022-06-20 16:21:47 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2022-06-20 16:21:47 source > 2022-06-20 16:21:47 INFO i.a.i.s.p.PostgresSource(main):411 - completed source: class io.airbyte.integrations.source.postgres.PostgresSource
2022-06-20 16:21:47 destination > 2022-06-20 16:21:47 INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 - Default schema.
2022-06-20 16:21:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):347 - Source has no more messages, closing connection.
2022-06-20 16:21:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):355 - Total records read: 20 (419 KB)
2022-06-20 16:21:47 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):358 - Schema validation errors found for stream publicdeposit. Error messages: [$.micr is of an incorrect type. Expected it to be string, $.timestamp_de is of an incorrect type. Expected it to be string, $.date_processed is of an incorrect type. Expected it to be date-time, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string]
2022-06-20 16:21:47 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):358 - Schema validation errors found for stream publicvendor_config. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string]
2022-06-20 16:21:47 INFO i.a.w.g.DefaultReplicationWorker(run):174 - One of source or destination thread complete. Waiting on the other.
2022-06-20 16:21:47 destination > 2022-06-20 16:21:47 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):55 - Starting a new buffer for stream vendor_config (current state: 419 KB in 1 buffers)
2022-06-20 16:21:47 destination > 2022-06-20 16:21:47 INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 - Default schema.
2022-06-20 16:21:47 destination > 2022-06-20 16:21:47 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded.
2022-06-20 16:21:47 destination > 2022-06-20 16:21:47 INFO i.a.i.d.b.BufferedStreamConsumer(close):170 - executing on success close procedure.
2022-06-20 16:21:47 destination > 2022-06-20 16:21:47 INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):92 - Flushing all 2 current buffers (419 KB in total)
2022-06-20 16:21:47 destination > 2022-06-20 16:21:47 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$flushAll$2):95 - Flushing buffer of stream vendor_config (331 bytes)
2022-06-20 16:21:47 destination > 2022-06-20 16:21:47 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):115 - Flushing buffer for stream vendor_config (331 bytes) to staging
2022-06-20 16:21:47 destination > 2022-06-20 16:21:47 INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 - Finished writing data to 1f637b16-0e0c-441c-bfa2-446f40a07f5213943467226689529942.avro (772 bytes)
2022-06-20 16:21:47 destination > 2022-06-20 16:21:47 INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):108 - Uploading records to staging for stream vendor_config (dataset raw_checkmate): airbyte/raw_checkmate_vendor_config/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/
2022-06-20 16:21:48 destination > 2022-06-20 16:21:48 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro with full ID ABPnzm5AtCkWIB_90etJCkvqwut_xM171UImSnmf3e84k43g0YplY2vN5nCHzVVyUlXV-rc
2022-06-20 16:21:48 destination > 2022-06-20 16:21:48 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000]
2022-06-20 16:21:48 destination > 2022-06-20 16:21:48 INFO a.m.s.StreamTransferManager(complete):367 - [Manager uploading to synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro with id ABPnzm5At...VyUlXV-rc]: Uploading leftover stream [Part number 1 containing 0.00 MB]
2022-06-20 16:21:48 destination > 2022-06-20 16:21:48 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro with id ABPnzm5At...VyUlXV-rc]: Finished uploading [Part number 1 containing 0.00 MB]
2022-06-20 16:21:48 destination > 2022-06-20 16:21:48 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro with id ABPnzm5At...VyUlXV-rc]: Completed
2022-06-20 16:21:48 destination > 2022-06-20 16:21:48 INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):178 - Uploaded buffer file to storage: 1f637b16-0e0c-441c-bfa2-446f40a07f5213943467226689529942.avro -> airbyte/raw_checkmate_vendor_config/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro (filename: 1.avro)
2022-06-20 16:21:48 destination > 2022-06-20 16:21:48 INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):53 - Added staged file: 1.avro
2022-06-20 16:21:48 destination > 2022-06-20 16:21:48 INFO i.a.i.d.r.FileBuffer(deleteFile):81 - Deleting tempFile data 1f637b16-0e0c-441c-bfa2-446f40a07f5213943467226689529942.avro
2022-06-20 16:21:48 destination > 2022-06-20 16:21:48 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$flushAll$2):95 - Flushing buffer of stream deposit (420 KB)
2022-06-20 16:21:48 destination > 2022-06-20 16:21:48 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):115 - Flushing buffer for stream deposit (420 KB) to staging
2022-06-20 16:21:48 destination > 2022-06-20 16:21:48 INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 - Finished writing data to 18e62e5f-419b-470b-adbb-7ec20fc738767644103284512748971.avro (420 KB)
2022-06-20 16:21:48 destination > 2022-06-20 16:21:48 INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):108 - Uploading records to staging for stream deposit (dataset raw_checkmate): airbyte/raw_checkmate_deposit/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/
2022-06-20 16:21:48 destination > 2022-06-20 16:21:48 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro with full ID ABPnzm4eMSCfxTlHhyADMPpD25I--Sp1hGndUAYviL3bFNKN0ZG1o6reU53Tng-csjggE30
2022-06-20 16:21:48 destination > 2022-06-20 16:21:48 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000]
2022-06-20 16:21:48 destination > 2022-06-20 16:21:48 INFO a.m.s.StreamTransferManager(complete):367 - [Manager uploading to synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro with id ABPnzm4eM...-csjggE30]: Uploading leftover stream [Part number 1 containing 0.41 MB]
2022-06-20 16:21:48 destination > 2022-06-20 16:21:48 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro with id ABPnzm4eM...-csjggE30]: Finished uploading [Part number 1 containing 0.41 MB]
2022-06-20 16:21:49 destination > 2022-06-20 16:21:49 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro with id ABPnzm4eM...-csjggE30]: Completed
2022-06-20 16:21:49 destination > 2022-06-20 16:21:49 INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):178 - Uploaded buffer file to storage: 18e62e5f-419b-470b-adbb-7ec20fc738767644103284512748971.avro -> airbyte/raw_checkmate_deposit/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro (filename: 1.avro)
2022-06-20 16:21:49 destination > 2022-06-20 16:21:49 INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):53 - Added staged file: 1.avro
2022-06-20 16:21:49 destination > 2022-06-20 16:21:49 INFO i.a.i.d.r.FileBuffer(deleteFile):81 - Deleting tempFile data 18e62e5f-419b-470b-adbb-7ec20fc738767644103284512748971.avro
2022-06-20 16:21:49 destination > 2022-06-20 16:21:49 INFO i.a.i.d.r.SerializedBufferingStrategy(close):119 - Closing buffer for stream vendor_config
2022-06-20 16:21:49 destination > 2022-06-20 16:21:49 INFO i.a.i.d.r.SerializedBufferingStrategy(close):119 - Closing buffer for stream deposit
2022-06-20 16:21:49 destination > 2022-06-20 16:21:49 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):137 - Copying into tables in destination started for 4 streams
2022-06-20 16:21:49 destination > 2022-06-20 16:21:49 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTmpTableFromStage):122 - Uploading records from staging files to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_vih_vendor_config}} (dataset raw_checkmate): [1.avro]
2022-06-20 16:21:49 destination > 2022-06-20 16:21:49 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):126 - Uploading staged file: gs://synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro
2022-06-20 16:21:49 destination > 2022-06-20 16:21:49 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):135 - [JobId{project=mainapi-282501, job=ba487fa6-5d06-4a47-9d2a-3f85cf17e2b1, location=US}] Created a new job to upload records to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_vih_vendor_config}} (dataset raw_checkmate): Job{job=JobId{project=mainapi-282501, job=ba487fa6-5d06-4a47-9d2a-3f85cf17e2b1, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655742109425, endTime=null, startTime=1655742109533, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@mainapi-282501.iam.gserviceaccount.com, etag=QjFZxg3iA9UgDoVOdx1Hxg==, generatedId=mainapi-282501:US.ba487fa6-5d06-4a47-9d2a-3f85cf17e2b1, selfLink=https://www.googleapis.com/bigquery/v2/projects/mainapi-282501/jobs/ba487fa6-5d06-4a47-9d2a-3f85cf17e2b1?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, projectId=mainapi-282501, tableId=_airbyte_tmp_vih_vendor_config}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}
2022-06-20 16:21:49 destination > 2022-06-20 16:21:49 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Waiting for job finish Job{job=JobId{project=mainapi-282501, job=ba487fa6-5d06-4a47-9d2a-3f85cf17e2b1, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655742109425, endTime=null, startTime=1655742109533, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@mainapi-282501.iam.gserviceaccount.com, etag=QjFZxg3iA9UgDoVOdx1Hxg==, generatedId=mainapi-282501:US.ba487fa6-5d06-4a47-9d2a-3f85cf17e2b1, selfLink=https://www.googleapis.com/bigquery/v2/projects/mainapi-282501/jobs/ba487fa6-5d06-4a47-9d2a-3f85cf17e2b1?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, projectId=mainapi-282501, tableId=_airbyte_tmp_vih_vendor_config}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null}
2022-06-20 16:21:52 destination > 2022-06-20 16:21:52 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):329 - Job finish Job{job=JobId{project=mainapi-282501, job=ba487fa6-5d06-4a47-9d2a-3f85cf17e2b1, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655742109425, endTime=null, startTime=1655742109533, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@mainapi-282501.iam.gserviceaccount.com, etag=QjFZxg3iA9UgDoVOdx1Hxg==, generatedId=mainapi-282501:US.ba487fa6-5d06-4a47-9d2a-3f85cf17e2b1, selfLink=https://www.googleapis.com/bigquery/v2/projects/mainapi-282501/jobs/ba487fa6-5d06-4a47-9d2a-3f85cf17e2b1?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, projectId=mainapi-282501, tableId=_airbyte_tmp_vih_vendor_config}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null}
2022-06-20 16:21:52 destination > 2022-06-20 16:21:52 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):139 - [JobId{project=mainapi-282501, job=ba487fa6-5d06-4a47-9d2a-3f85cf17e2b1, location=US}] Tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_vih_vendor_config}} (dataset raw_checkmate) is successfully appended with staging files
2022-06-20 16:21:52 destination > 2022-06-20 16:21:52 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTargetTable):162 - Copying data from tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_vih_vendor_config}} to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_vendor_config}} (dataset raw_checkmate, sync mode append_dedup)
2022-06-20 16:21:54 destination > 2022-06-20 16:21:54 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_vih_vendor_config}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_vendor_config}}
2022-06-20 16:21:54 destination > 2022-06-20 16:21:54 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTmpTableFromStage):122 - Uploading records from staging files to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_kfp_inbound_file_metadata}} (dataset raw_checkmate): []
2022-06-20 16:21:54 destination > 2022-06-20 16:21:54 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTargetTable):162 - Copying data from tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_kfp_inbound_file_metadata}} to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_inbound_file_metadata}} (dataset raw_checkmate, sync mode append_dedup)
2022-06-20 16:21:57 destination > 2022-06-20 16:21:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_kfp_inbound_file_metadata}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_inbound_file_metadata}}
2022-06-20 16:21:57 destination > 2022-06-20 16:21:57 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTmpTableFromStage):122 - Uploading records from staging files to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_axw_deposit}} (dataset raw_checkmate): [1.avro]
2022-06-20 16:21:57 destination > 2022-06-20 16:21:57 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):126 - Uploading staged file: gs://synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro
2022-06-20 16:21:57 destination > 2022-06-20 16:21:57 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):135 - [JobId{project=mainapi-282501, job=a88df86b-97a0-404f-9c38-5c64f234c4ad, location=US}] Created a new job to upload records to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_axw_deposit}} (dataset raw_checkmate): Job{job=JobId{project=mainapi-282501, job=a88df86b-97a0-404f-9c38-5c64f234c4ad, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655742117487, endTime=null, startTime=1655742117594, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@mainapi-282501.iam.gserviceaccount.com, etag=YeDNkQjP+NZT4jZ2gT2vaA==, generatedId=mainapi-282501:US.a88df86b-97a0-404f-9c38-5c64f234c4ad, selfLink=https://www.googleapis.com/bigquery/v2/projects/mainapi-282501/jobs/a88df86b-97a0-404f-9c38-5c64f234c4ad?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, projectId=mainapi-282501, tableId=_airbyte_tmp_axw_deposit}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}
2022-06-20 16:21:57 destination > 2022-06-20 16:21:57 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Waiting for job finish Job{job=JobId{project=mainapi-282501, job=a88df86b-97a0-404f-9c38-5c64f234c4ad, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655742117487, endTime=null, startTime=1655742117594, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@mainapi-282501.iam.gserviceaccount.com, etag=YeDNkQjP+NZT4jZ2gT2vaA==, generatedId=mainapi-282501:US.a88df86b-97a0-404f-9c38-5c64f234c4ad, selfLink=https://www.googleapis.com/bigquery/v2/projects/mainapi-282501/jobs/a88df86b-97a0-404f-9c38-5c64f234c4ad?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, projectId=mainapi-282501, tableId=_airbyte_tmp_axw_deposit}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null}
2022-06-20 16:22:01 destination > 2022-06-20 16:22:01 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):329 - Job finish Job{job=JobId{project=mainapi-282501, job=a88df86b-97a0-404f-9c38-5c64f234c4ad, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655742117487, endTime=null, startTime=1655742117594, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@mainapi-282501.iam.gserviceaccount.com, etag=YeDNkQjP+NZT4jZ2gT2vaA==, generatedId=mainapi-282501:US.a88df86b-97a0-404f-9c38-5c64f234c4ad, selfLink=https://www.googleapis.com/bigquery/v2/projects/mainapi-282501/jobs/a88df86b-97a0-404f-9c38-5c64f234c4ad?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, projectId=mainapi-282501, tableId=_airbyte_tmp_axw_deposit}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null}
2022-06-20 16:22:01 destination > 2022-06-20 16:22:01 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):139 - [JobId{project=mainapi-282501, job=a88df86b-97a0-404f-9c38-5c64f234c4ad, location=US}] Tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_axw_deposit}} (dataset raw_checkmate) is successfully appended with staging files
2022-06-20 16:22:01 destination > 2022-06-20 16:22:01 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTargetTable):162 - Copying data from tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_axw_deposit}} to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_deposit}} (dataset raw_checkmate, sync mode append_dedup)
2022-06-20 16:22:03 destination > 2022-06-20 16:22:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_axw_deposit}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_deposit}}
2022-06-20 16:22:03 destination > 2022-06-20 16:22:03 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTmpTableFromStage):122 - Uploading records from staging files to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_fig_bank_config}} (dataset raw_checkmate): []
2022-06-20 16:22:03 destination > 2022-06-20 16:22:03 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTargetTable):162 - Copying data from tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_fig_bank_config}} to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_bank_config}} (dataset raw_checkmate, sync mode append_dedup)
2022-06-20 16:22:05 destination > 2022-06-20 16:22:05 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_fig_bank_config}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_bank_config}}
2022-06-20 16:22:05 destination > 2022-06-20 16:22:05 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):156 - Finalizing tables in destination completed
2022-06-20 16:22:05 destination > 2022-06-20 16:22:05 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):159 - Cleaning up destination started for 4 streams
2022-06-20 16:22:05 destination > 2022-06-20 16:22:05 INFO i.a.i.d.b.BigQueryGcsOperations(dropTableIfExists):172 - Deleting tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_vih_vendor_config}} (dataset raw_checkmate)
2022-06-20 16:22:06 destination > 2022-06-20 16:22:06 INFO i.a.i.d.b.BigQueryGcsOperations(dropStageIfExists):183 - Cleaning up staging path for stream vendor_config (dataset raw_checkmate): airbyte/raw_checkmate_vendor_config
2022-06-20 16:22:06 destination > 2022-06-20 16:22:06 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object airbyte/raw_checkmate_vendor_config/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/
2022-06-20 16:22:06 destination > 2022-06-20 16:22:06 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object airbyte/raw_checkmate_vendor_config/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro
2022-06-20 16:22:06 destination > 2022-06-20 16:22:06 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):270 - Storage bucket airbyte/raw_checkmate_vendor_config has been cleaned-up (2 objects were deleted)...
2022-06-20 16:22:06 destination > 2022-06-20 16:22:06 INFO i.a.i.d.b.BigQueryGcsOperations(dropTableIfExists):172 - Deleting tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_kfp_inbound_file_metadata}} (dataset raw_checkmate)
2022-06-20 16:22:06 destination > 2022-06-20 16:22:06 INFO i.a.i.d.b.BigQueryGcsOperations(dropStageIfExists):183 - Cleaning up staging path for stream inbound_file_metadata (dataset raw_checkmate): airbyte/raw_checkmate_inbound_file_metadata
2022-06-20 16:22:06 destination > 2022-06-20 16:22:06 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object airbyte/raw_checkmate_inbound_file_metadata/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/
2022-06-20 16:22:06 destination > 2022-06-20 16:22:06 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):270 - Storage bucket airbyte/raw_checkmate_inbound_file_metadata has been cleaned-up (1 objects were deleted)...
2022-06-20 16:22:06 destination > 2022-06-20 16:22:06 INFO i.a.i.d.b.BigQueryGcsOperations(dropTableIfExists):172 - Deleting tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_axw_deposit}} (dataset raw_checkmate)
2022-06-20 16:22:06 destination > 2022-06-20 16:22:06 INFO i.a.i.d.b.BigQueryGcsOperations(dropStageIfExists):183 - Cleaning up staging path for stream deposit (dataset raw_checkmate): airbyte/raw_checkmate_deposit
2022-06-20 16:22:06 destination > 2022-06-20 16:22:06 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object airbyte/raw_checkmate_deposit/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/
2022-06-20 16:22:07 destination > 2022-06-20 16:22:07 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object airbyte/raw_checkmate_deposit/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/1.avro
2022-06-20 16:22:07 destination > 2022-06-20 16:22:07 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):270 - Storage bucket airbyte/raw_checkmate_deposit has been cleaned-up (2 objects were deleted)...
2022-06-20 16:22:07 destination > 2022-06-20 16:22:07 INFO i.a.i.d.b.BigQueryGcsOperations(dropTableIfExists):172 - Deleting tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_fig_bank_config}} (dataset raw_checkmate)
2022-06-20 16:22:07 destination > 2022-06-20 16:22:07 INFO i.a.i.d.b.BigQueryGcsOperations(dropStageIfExists):183 - Cleaning up staging path for stream bank_config (dataset raw_checkmate): airbyte/raw_checkmate_bank_config
2022-06-20 16:22:07 destination > 2022-06-20 16:22:07 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object airbyte/raw_checkmate_bank_config/2022/06/20/16/7ecff322-7ed0-4832-b05a-9f3e9c9ab462/
2022-06-20 16:22:07 destination > 2022-06-20 16:22:07 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):270 - Storage bucket airbyte/raw_checkmate_bank_config has been cleaned-up (1 objects were deleted)...
2022-06-20 16:22:07 destination > 2022-06-20 16:22:07 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):164 - Cleaning up destination completed.
2022-06-20 16:22:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):405 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@4bd0aa6d[type=STATE,log=<null>,spec=<null>,connectionStatus=<null>,catalog=<null>,record=<null>,state=io.airbyte.protocol.models.AirbyteStateMessage@45175d67[stateType=<null>,stream=<null>,global=<null>,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"checkmate\",{\"server\":\"checkmate\"}]}":"{\"last_snapshot_record\":true,\"lsn\":360862221408,\"txId\":19622769,\"ts_usec\":1655742105977000,\"snapshot\":true}"}},"streams":[{"stream_name":"bank_config","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"deposit","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"inbound_file_metadata","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"vendor_config","stream_namespace":"public","cursor_field":["timestamp_ch"]}]},additionalProperties={streams=[]}],trace=<null>,additionalProperties={}]
2022-06-20 16:22:07 destination > 2022-06-20 16:22:07 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2022-06-20 16:22:07 INFO i.a.w.g.DefaultReplicationWorker(run):176 - Source and destination threads complete.
2022-06-20 16:22:07 INFO i.a.w.g.DefaultReplicationWorker(run):239 - sync summary: io.airbyte.config.ReplicationAttemptSummary@4abf1be3[status=completed,recordsSynced=19,bytesSynced=429449,startTime=1655742098979,endTime=1655742127730,totalStats=io.airbyte.config.SyncStats@5d27e10e[recordsEmitted=19,bytesEmitted=429449,stateMessagesEmitted=1,recordsCommitted=19],streamStats=[io.airbyte.config.StreamSyncStats@53e5e8d3[streamName=vendor_config,stats=io.airbyte.config.SyncStats@45caf85[recordsEmitted=1,bytesEmitted=377,stateMessagesEmitted=<null>,recordsCommitted=1]], io.airbyte.config.StreamSyncStats@360eccee[streamName=deposit,stats=io.airbyte.config.SyncStats@54c374b0[recordsEmitted=18,bytesEmitted=429072,stateMessagesEmitted=<null>,recordsCommitted=18]]]]
2022-06-20 16:22:07 INFO i.a.w.g.DefaultReplicationWorker(run):266 - Source output at least one state message
2022-06-20 16:22:07 INFO i.a.w.g.DefaultReplicationWorker(run):272 - State capture: Updated state to: Optional[io.airbyte.config.State@281cbd8b[state={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"checkmate\",{\"server\":\"checkmate\"}]}":"{\"last_snapshot_record\":true,\"lsn\":360862221408,\"txId\":19622769,\"ts_usec\":1655742105977000,\"snapshot\":true}"}},"streams":[{"stream_name":"bank_config","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"deposit","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"inbound_file_metadata","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"vendor_config","stream_namespace":"public","cursor_field":["timestamp_ch"]}]}]]
2022-06-20 16:22:07 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling...
2022-06-20 16:22:07 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):157 - sync summary: io.airbyte.config.StandardSyncOutput@4d83b490[standardSyncSummary=io.airbyte.config.StandardSyncSummary@8813344[status=completed,recordsSynced=19,bytesSynced=429449,startTime=1655742098979,endTime=1655742127730,totalStats=io.airbyte.config.SyncStats@5d27e10e[recordsEmitted=19,bytesEmitted=429449,stateMessagesEmitted=1,recordsCommitted=19],streamStats=[io.airbyte.config.StreamSyncStats@53e5e8d3[streamName=vendor_config,stats=io.airbyte.config.SyncStats@45caf85[recordsEmitted=1,bytesEmitted=377,stateMessagesEmitted=<null>,recordsCommitted=1]], io.airbyte.config.StreamSyncStats@360eccee[streamName=deposit,stats=io.airbyte.config.SyncStats@54c374b0[recordsEmitted=18,bytesEmitted=429072,stateMessagesEmitted=<null>,recordsCommitted=18]]]],normalizationSummary=<null>,state=io.airbyte.config.State@281cbd8b[state={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"checkmate\",{\"server\":\"checkmate\"}]}":"{\"last_snapshot_record\":true,\"lsn\":360862221408,\"txId\":19622769,\"ts_usec\":1655742105977000,\"snapshot\":true}"}},"streams":[{"stream_name":"bank_config","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"deposit","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"inbound_file_metadata","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"vendor_config","stream_namespace":"public","cursor_field":["timestamp_ch"]}]}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@111c696b[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@39c3ddf6[stream=io.airbyte.protocol.models.AirbyteStream@69b4d96a[name=bank_config,jsonSchema={"type":"object","properties":{"name":{"type":"string"},"bank_id":{"type":"number"},"_ab_cdc_lsn":{"type":"number"},"timestamp_ch":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"timestamp_cr":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"hold_duration":{"type":"number"},"bank_config_id":{"type":"string"},"vendor_bank_id":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"inbound_upload_path":{"type":"string"},"outbound_upload_path":{"type":"string"},"hold_amount_percentage":{"type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[bank_config_id]],namespace=raw_checkmate,additionalProperties={}],syncMode=incremental,cursorField=[timestamp_ch],destinationSyncMode=append_dedup,primaryKey=[[bank_config_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@68aecc0b[stream=io.airbyte.protocol.models.AirbyteStream@1a0bb744[name=deposit,jsonSchema={"type":"object","properties":{"micr":{"type":"string"},"amount":{"type":"number"},"status":{"type":"string"},"bank_id":{"type":"number"},"currency":{"type":"string"},"party_id":{"type":"string"},"account_id":{"type":"string"},"deposit_id":{"type":"string"},"partner_id":{"type":"number"},"party_type":{"type":"string"},"_ab_cdc_lsn":{"type":"number"},"vendor_info":{"type":"string"},"check_amount":{"type":"number"},"check_number":{"type":"string"},"timestamp_ch":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"timestamp_cr":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"timestamp_de":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"back_image_id":{"type":"string"},"date_captured":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"account_number":{"type":"string"},"date_processed":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"front_image_id":{"type":"string"},"transaction_id":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"ocr_account_number":{"type":"string"},"vendor_reference_id":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[deposit_id]],namespace=raw_checkmate,additionalProperties={}],syncMode=incremental,cursorField=[timestamp_ch],destinationSyncMode=append_dedup,primaryKey=[[deposit_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@3d80f59e[stream=io.airbyte.protocol.models.AirbyteStream@72b014cd[name=inbound_file_metadata,jsonSchema={"type":"object","properties":{"file_hash":{"type":"string"},"file_name":{"type":"string"},"_ab_cdc_lsn":{"type":"number"},"timestamp_ch":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"timestamp_cr":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"inbound_file_metadata_id":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[inbound_file_metadata_id]],namespace=raw_checkmate,additionalProperties={}],syncMode=incremental,cursorField=[timestamp_ch],destinationSyncMode=append_dedup,primaryKey=[[inbound_file_metadata_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@6ce05004[stream=io.airbyte.protocol.models.AirbyteStream@2b167b4b[name=vendor_config,jsonSchema={"type":"object","properties":{"name":{"type":"string"},"_ab_cdc_lsn":{"type":"number"},"timestamp_ch":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"timestamp_cr":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"vendor_config_id":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"inbound_upload_path":{"type":"string"},"outbound_upload_path":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[vendor_config_id]],namespace=raw_checkmate,additionalProperties={}],syncMode=incremental,cursorField=[timestamp_ch],destinationSyncMode=append_dedup,primaryKey=[[vendor_config_id]],additionalProperties={}]],additionalProperties={}],failures=[]]
2022-06-20 16:22:07 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):236 - Stopping temporal heartbeating...
2022-06-20 16:22:07 INFO i.a.c.p.ConfigRepository(updateConnectionState):775 - Updating connection 8b0bff81-e1b7-4b56-a2ee-9c2092d4763a state: io.airbyte.config.State@dea233b[state={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"checkmate\",{\"server\":\"checkmate\"}]}":"{\"last_snapshot_record\":true,\"lsn\":360862221408,\"txId\":19622769,\"ts_usec\":1655742105977000,\"snapshot\":true}"}},"streams":[{"stream_name":"bank_config","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"deposit","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"inbound_file_metadata","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"vendor_config","stream_namespace":"public","cursor_field":["timestamp_ch"]}]}]
2022-06-20 16:22:07 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/81417/1/logs.log
2022-06-20 16:22:07 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.19-alpha
2022-06-20 16:22:07 INFO i.a.w.g.DefaultNormalizationWorker(run):49 - Running normalization.
2022-06-20 16:22:07 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):122 - Running with normalization version: airbyte/normalization:0.2.4
2022-06-20 16:22:07 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/normalization:0.2.4 exists...
2022-06-20 16:22:07 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/normalization:0.2.4 was found locally.
2022-06-20 16:22:07 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 81417
2022-06-20 16:22:07 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/81417/1/normalize --log-driver none --name normalization-normalize-81417-1-qftap --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.39.19-alpha airbyte/normalization:0.2.4 run --integration-type bigquery --config destination_config.json --catalog destination_catalog.json
2022-06-20 16:22:08 normalization > Running: transform-config --config destination_config.json --integration-type bigquery --out /data/81417/1/normalize
2022-06-20 16:22:08 normalization > Namespace(config='destination_config.json', integration_type=<DestinationType.BIGQUERY: 'bigquery'>, out='/data/81417/1/normalize')
2022-06-20 16:22:08 normalization > transform_bigquery
2022-06-20 16:22:08 normalization > Running: transform-catalog --integration-type bigquery --profile-config-dir /data/81417/1/normalize --catalog destination_catalog.json --out /data/81417/1/normalize/models/generated/ --json-column _airbyte_data
2022-06-20 16:22:09 normalization > Processing destination_catalog.json...
2022-06-20 16:22:09 normalization >   Generating airbyte_ctes/raw_checkmate/bank_config_ab1.sql from bank_config
2022-06-20 16:22:09 normalization >   Generating airbyte_ctes/raw_checkmate/bank_config_ab2.sql from bank_config
2022-06-20 16:22:09 normalization >   Generating airbyte_views/raw_checkmate/bank_config_stg.sql from bank_config
2022-06-20 16:22:09 normalization >   Generating airbyte_incremental/scd/raw_checkmate/bank_config_scd.sql from bank_config
2022-06-20 16:22:09 normalization >   Generating airbyte_incremental/raw_checkmate/bank_config.sql from bank_config
2022-06-20 16:22:09 normalization >   Generating airbyte_ctes/raw_checkmate/deposit_ab1.sql from deposit
2022-06-20 16:22:09 normalization >   Generating airbyte_ctes/raw_checkmate/deposit_ab2.sql from deposit
2022-06-20 16:22:09 normalization >   Generating airbyte_views/raw_checkmate/deposit_stg.sql from deposit
2022-06-20 16:22:09 normalization >   Generating airbyte_incremental/scd/raw_checkmate/deposit_scd.sql from deposit
2022-06-20 16:22:09 normalization >   Generating airbyte_incremental/raw_checkmate/deposit.sql from deposit
2022-06-20 16:22:09 normalization >   Generating airbyte_ctes/raw_checkmate/inbound_file_metadata_ab1.sql from inbound_file_metadata
2022-06-20 16:22:09 normalization >   Generating airbyte_ctes/raw_checkmate/inbound_file_metadata_ab2.sql from inbound_file_metadata
2022-06-20 16:22:09 normalization >   Generating airbyte_views/raw_checkmate/inbound_file_metadata_stg.sql from inbound_file_metadata
2022-06-20 16:22:09 normalization >   Generating airbyte_incremental/scd/raw_checkmate/inbound_file_metadata_scd.sql from inbound_file_metadata
2022-06-20 16:22:09 normalization >   Generating airbyte_incremental/raw_checkmate/inbound_file_metadata.sql from inbound_file_metadata
2022-06-20 16:22:09 normalization >   Generating airbyte_ctes/raw_checkmate/vendor_config_ab1.sql from vendor_config
2022-06-20 16:22:09 normalization >   Generating airbyte_ctes/raw_checkmate/vendor_config_ab2.sql from vendor_config
2022-06-20 16:22:09 normalization >   Generating airbyte_views/raw_checkmate/vendor_config_stg.sql from vendor_config
2022-06-20 16:22:09 normalization >   Generating airbyte_incremental/scd/raw_checkmate/vendor_config_scd.sql from vendor_config
2022-06-20 16:22:09 normalization >   Generating airbyte_incremental/raw_checkmate/vendor_config.sql from vendor_config
2022-06-20 16:22:09 normalization > detected no config file for ssh, assuming ssh is off.
2022-06-20 16:22:13 normalization >            [--event-buffer-size EVENT_BUFFER_SIZE]
2022-06-20 16:22:13 normalization >   --event-buffer-size EVENT_BUFFER_SIZE
2022-06-20 16:22:13 normalization > 
2022-06-20 16:22:13 normalization > DBT >=1.0.0 detected; using 10K event buffer size
2022-06-20 16:22:13 normalization > 
2022-06-20 16:22:17 normalization > 16:22:17  Running with dbt=1.0.0
2022-06-20 16:22:17 normalization > 16:22:17  Partial parse save file not found. Starting full parse.
2022-06-20 16:22:20 normalization > 16:22:20  [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources.
2022-06-20 16:22:20 normalization > There are 1 unused configuration paths:
2022-06-20 16:22:20 normalization > - models.airbyte_utils.generated.airbyte_tables
2022-06-20 16:22:20 normalization > 
2022-06-20 16:22:20 normalization > 16:22:20  Found 20 models, 0 tests, 0 snapshots, 0 analyses, 548 macros, 0 operations, 0 seed files, 4 sources, 0 exposures, 0 metrics
2022-06-20 16:22:20 normalization > 16:22:20  
2022-06-20 16:22:21 normalization > 16:22:21  Concurrency: 8 threads (target='prod')
2022-06-20 16:22:21 normalization > 16:22:21  
2022-06-20 16:22:21 normalization > 16:22:21  1 of 12 START view model _airbyte_raw_checkmate.bank_config_stg......................................................... [RUN]
2022-06-20 16:22:21 normalization > 16:22:21  2 of 12 START view model _airbyte_raw_checkmate.deposit_stg............................................................. [RUN]
2022-06-20 16:22:21 normalization > 16:22:21  3 of 12 START view model _airbyte_raw_checkmate.inbound_file_metadata_stg............................................... [RUN]
2022-06-20 16:22:21 normalization > 16:22:21  4 of 12 START view model _airbyte_raw_checkmate.vendor_config_stg....................................................... [RUN]
2022-06-20 16:22:22 normalization > 16:22:22  1 of 12 OK created view model _airbyte_raw_checkmate.bank_config_stg.................................................... [OK in 1.13s]
2022-06-20 16:22:22 normalization > 16:22:22  4 of 12 OK created view model _airbyte_raw_checkmate.vendor_config_stg.................................................. [OK in 1.04s]
2022-06-20 16:22:22 normalization > 16:22:22  3 of 12 OK created view model _airbyte_raw_checkmate.inbound_file_metadata_stg.......................................... [OK in 1.06s]
2022-06-20 16:22:22 normalization > 16:22:22  2 of 12 OK created view model _airbyte_raw_checkmate.deposit_stg........................................................ [OK in 1.07s]
2022-06-20 16:22:22 normalization > 16:22:22  5 of 12 START incremental model raw_checkmate.bank_config_scd........................................................... [RUN]
2022-06-20 16:22:22 normalization > 16:22:22  6 of 12 START incremental model raw_checkmate.vendor_config_scd......................................................... [RUN]
2022-06-20 16:22:22 normalization > 16:22:22  7 of 12 START incremental model raw_checkmate.deposit_scd............................................................... [RUN]
2022-06-20 16:22:22 normalization > 16:22:22  8 of 12 START incremental model raw_checkmate.inbound_file_metadata_scd................................................. [RUN]
2022-06-20 16:22:23 normalization > 16:22:23  16:22:23 + `mainapi-282501`.raw_checkmate.`deposit_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-06-20 16:22:29 normalization > 16:22:29  7 of 12 ERROR creating incremental model raw_checkmate.deposit_scd...................................................... [ERROR in 6.44s]
2022-06-20 16:22:29 normalization > 16:22:29  9 of 12 SKIP relation raw_checkmate.deposit............................................................................. [SKIP]
2022-06-20 16:22:34 normalization > 16:22:34  5 of 12 OK created incremental model raw_checkmate.bank_config_scd...................................................... [MERGE (0.0 rows, 0 processed) in 12.10s]
2022-06-20 16:22:34 normalization > 16:22:34  10 of 12 START incremental model raw_checkmate.bank_config.............................................................. [RUN]
2022-06-20 16:22:35 normalization > 16:22:35  8 of 12 OK created incremental model raw_checkmate.inbound_file_metadata_scd............................................ [MERGE (0.0 rows, 0 processed) in 12.43s]
2022-06-20 16:22:35 normalization > 16:22:35  11 of 12 START incremental model raw_checkmate.inbound_file_metadata.................................................... [RUN]
2022-06-20 16:22:37 normalization > 16:22:37  6 of 12 OK created incremental model raw_checkmate.vendor_config_scd.................................................... [MERGE (2.0 rows, 1004.0 Bytes processed) in 14.71s]
2022-06-20 16:22:37 normalization > 16:22:37  12 of 12 START incremental model raw_checkmate.vendor_config............................................................ [RUN]
2022-06-20 16:22:40 normalization > 16:22:40  11 of 12 OK created incremental model raw_checkmate.inbound_file_metadata............................................... [MERGE (0.0 rows, 0 processed) in 5.60s]
2022-06-20 16:22:41 normalization > 16:22:41  10 of 12 OK created incremental model raw_checkmate.bank_config......................................................... [MERGE (0.0 rows, 0 processed) in 6.14s]
2022-06-20 16:22:43 normalization > 16:22:43  12 of 12 OK created incremental model raw_checkmate.vendor_config....................................................... [MERGE (1.0 rows, 564.0 Bytes processed) in 6.19s]
2022-06-20 16:22:43 normalization > 16:22:43  
2022-06-20 16:22:43 normalization > 16:22:43  Finished running 4 view models, 8 incremental models in 23.11s.
2022-06-20 16:22:43 normalization > 16:22:43  
2022-06-20 16:22:43 normalization > 16:22:43  Completed with 1 error and 0 warnings:
2022-06-20 16:22:43 normalization > 16:22:43  
2022-06-20 16:22:43 normalization > 16:22:43  Database Error in model deposit_scd (models/generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql)
2022-06-20 16:22:43 normalization > 16:22:43    Invalid timestamp string "0000-12-30T00:00:00Z"
2022-06-20 16:22:43 normalization > 16:22:43    compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql
2022-06-20 16:22:43 normalization > 16:22:43  
2022-06-20 16:22:43 normalization > 16:22:43  Done. PASS=10 WARN=0 ERROR=1 SKIP=1 TOTAL=12
2022-06-20 16:22:44 normalization > 
2022-06-20 16:22:44 normalization > Diagnosing dbt debug to check if destination is available for dbt and well configured (1):
2022-06-20 16:22:44 normalization > 
2022-06-20 16:22:47 normalization > 16:22:47  Running with dbt=1.0.0
2022-06-20 16:22:47 normalization > dbt version: 1.0.0
2022-06-20 16:22:47 normalization > python version: 3.9.9
2022-06-20 16:22:47 normalization > python path: /usr/local/bin/python
2022-06-20 16:22:47 normalization > os info: Linux-5.13.0-1024-gcp-x86_64-with-glibc2.31
2022-06-20 16:22:47 normalization > Using profiles.yml file at /data/81417/1/normalize/profiles.yml
2022-06-20 16:22:47 normalization > Using dbt_project.yml file at /data/81417/1/normalize/dbt_project.yml
2022-06-20 16:22:47 normalization > 
2022-06-20 16:22:48 normalization > Configuration:
2022-06-20 16:22:48 normalization >   profiles.yml file [OK found and valid]
2022-06-20 16:22:48 normalization >   dbt_project.yml file [OK found and valid]
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > Required dependencies:
2022-06-20 16:22:48 normalization >  - git [OK found]
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > Connection:
2022-06-20 16:22:48 normalization >   method: service-account-json
2022-06-20 16:22:48 normalization >   database: mainapi-282501
2022-06-20 16:22:48 normalization >   schema: airbyte
2022-06-20 16:22:48 normalization >   location: US
2022-06-20 16:22:48 normalization >   priority: interactive
2022-06-20 16:22:48 normalization >   timeout_seconds: 300
2022-06-20 16:22:48 normalization >   maximum_bytes_billed: None
2022-06-20 16:22:48 normalization >   execution_project: mainapi-282501
2022-06-20 16:22:48 normalization >   Connection test: [OK connection ok]
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > All checks passed!
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > Forward dbt output logs to diagnose/debug errors (0):
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > ============================== 2022-06-20 16:22:17.794563 | c463d5fa-33da-44f8-8b1f-6a6a8512dd06 ==============================
2022-06-20 16:22:48 normalization > 16:22:17.794563 [info ] [MainThread]: Running with dbt=1.0.0
2022-06-20 16:22:48 normalization > 16:22:17.795331 [debug] [MainThread]: running dbt with arguments Namespace(record_timing_info=None, debug=None, log_format=None, write_json=None, use_colors=None, printer_width=None, warn_error=None, version_check=None, partial_parse=None, single_threaded=False, use_experimental_parser=None, static_parser=None, profiles_dir='/data/81417/1/normalize', send_anonymous_usage_stats=None, fail_fast=None, event_buffer_size='10000', project_dir='/data/81417/1/normalize', profile=None, target=None, vars='{}', log_cache_events=False, threads=None, select=None, exclude=None, selector_name=None, state=None, defer=None, full_refresh=False, cls=<class 'dbt.task.run.RunTask'>, which='run', rpc_method='run')
2022-06-20 16:22:48 normalization > 16:22:17.795805 [debug] [MainThread]: Tracking: do not track
2022-06-20 16:22:48 normalization > 16:22:17.837718 [info ] [MainThread]: Partial parse save file not found. Starting full parse.
2022-06-20 16:22:48 normalization > 16:22:17.883002 [debug] [MainThread]: Parsing macros/configuration.sql
2022-06-20 16:22:48 normalization > 16:22:17.888183 [debug] [MainThread]: Parsing macros/should_full_refresh.sql
2022-06-20 16:22:48 normalization > 16:22:17.898083 [debug] [MainThread]: Parsing macros/incremental.sql
2022-06-20 16:22:48 normalization > 16:22:17.909493 [debug] [MainThread]: Parsing macros/get_custom_schema.sql
2022-06-20 16:22:48 normalization > 16:22:17.910761 [debug] [MainThread]: Parsing macros/star_intersect.sql
2022-06-20 16:22:48 normalization > 16:22:17.922795 [debug] [MainThread]: Parsing macros/schema_tests/equal_rowcount.sql
2022-06-20 16:22:48 normalization > 16:22:17.925143 [debug] [MainThread]: Parsing macros/schema_tests/equality.sql
2022-06-20 16:22:48 normalization > 16:22:17.937848 [debug] [MainThread]: Parsing macros/cross_db_utils/except.sql
2022-06-20 16:22:48 normalization > 16:22:17.939490 [debug] [MainThread]: Parsing macros/cross_db_utils/current_timestamp.sql
2022-06-20 16:22:48 normalization > 16:22:17.940541 [debug] [MainThread]: Parsing macros/cross_db_utils/columns.sql
2022-06-20 16:22:48 normalization > 16:22:17.945852 [debug] [MainThread]: Parsing macros/cross_db_utils/hash.sql
2022-06-20 16:22:48 normalization > 16:22:17.947141 [debug] [MainThread]: Parsing macros/cross_db_utils/json_operations.sql
2022-06-20 16:22:48 normalization > 16:22:18.018030 [debug] [MainThread]: Parsing macros/cross_db_utils/quote.sql
2022-06-20 16:22:48 normalization > 16:22:18.020902 [debug] [MainThread]: Parsing macros/cross_db_utils/type_conversions.sql
2022-06-20 16:22:48 normalization > 16:22:18.035815 [debug] [MainThread]: Parsing macros/cross_db_utils/surrogate_key.sql
2022-06-20 16:22:48 normalization > 16:22:18.039579 [debug] [MainThread]: Parsing macros/cross_db_utils/datatypes.sql
2022-06-20 16:22:48 normalization > 16:22:18.058759 [debug] [MainThread]: Parsing macros/cross_db_utils/concat.sql
2022-06-20 16:22:48 normalization > 16:22:18.062637 [debug] [MainThread]: Parsing macros/cross_db_utils/array.sql
2022-06-20 16:22:48 normalization > 16:22:18.088578 [debug] [MainThread]: Parsing macros/adapters.sql
2022-06-20 16:22:48 normalization > 16:22:18.135842 [debug] [MainThread]: Parsing macros/catalog.sql
2022-06-20 16:22:48 normalization > 16:22:18.149091 [debug] [MainThread]: Parsing macros/etc.sql
2022-06-20 16:22:48 normalization > 16:22:18.152517 [debug] [MainThread]: Parsing macros/materializations/table.sql
2022-06-20 16:22:48 normalization > 16:22:18.159686 [debug] [MainThread]: Parsing macros/materializations/copy.sql
2022-06-20 16:22:48 normalization > 16:22:18.164298 [debug] [MainThread]: Parsing macros/materializations/seed.sql
2022-06-20 16:22:48 normalization > 16:22:18.168727 [debug] [MainThread]: Parsing macros/materializations/incremental.sql
2022-06-20 16:22:48 normalization > 16:22:18.196632 [debug] [MainThread]: Parsing macros/materializations/view.sql
2022-06-20 16:22:48 normalization > 16:22:18.201543 [debug] [MainThread]: Parsing macros/materializations/snapshot.sql
2022-06-20 16:22:48 normalization > 16:22:18.204585 [debug] [MainThread]: Parsing macros/etc/statement.sql
2022-06-20 16:22:48 normalization > 16:22:18.213003 [debug] [MainThread]: Parsing macros/etc/datetime.sql
2022-06-20 16:22:48 normalization > 16:22:18.230862 [debug] [MainThread]: Parsing macros/materializations/configs.sql
2022-06-20 16:22:48 normalization > 16:22:18.235459 [debug] [MainThread]: Parsing macros/materializations/hooks.sql
2022-06-20 16:22:48 normalization > 16:22:18.242814 [debug] [MainThread]: Parsing macros/materializations/tests/where_subquery.sql
2022-06-20 16:22:48 normalization > 16:22:18.246153 [debug] [MainThread]: Parsing macros/materializations/tests/helpers.sql
2022-06-20 16:22:48 normalization > 16:22:18.249787 [debug] [MainThread]: Parsing macros/materializations/tests/test.sql
2022-06-20 16:22:48 normalization > 16:22:18.258421 [debug] [MainThread]: Parsing macros/materializations/seeds/seed.sql
2022-06-20 16:22:48 normalization > 16:22:18.270065 [debug] [MainThread]: Parsing macros/materializations/seeds/helpers.sql
2022-06-20 16:22:48 normalization > 16:22:18.302858 [debug] [MainThread]: Parsing macros/materializations/models/table/table.sql
2022-06-20 16:22:48 normalization > 16:22:18.316906 [debug] [MainThread]: Parsing macros/materializations/models/table/create_table_as.sql
2022-06-20 16:22:48 normalization > 16:22:18.322194 [debug] [MainThread]: Parsing macros/materializations/models/incremental/incremental.sql
2022-06-20 16:22:48 normalization > 16:22:18.341117 [debug] [MainThread]: Parsing macros/materializations/models/incremental/column_helpers.sql
2022-06-20 16:22:48 normalization > 16:22:18.349995 [debug] [MainThread]: Parsing macros/materializations/models/incremental/merge.sql
2022-06-20 16:22:48 normalization > 16:22:18.372634 [debug] [MainThread]: Parsing macros/materializations/models/incremental/on_schema_change.sql
2022-06-20 16:22:48 normalization > 16:22:18.404536 [debug] [MainThread]: Parsing macros/materializations/models/incremental/is_incremental.sql
2022-06-20 16:22:48 normalization > 16:22:18.407393 [debug] [MainThread]: Parsing macros/materializations/models/view/create_or_replace_view.sql
2022-06-20 16:22:48 normalization > 16:22:18.412321 [debug] [MainThread]: Parsing macros/materializations/models/view/create_view_as.sql
2022-06-20 16:22:48 normalization > 16:22:18.416345 [debug] [MainThread]: Parsing macros/materializations/models/view/view.sql
2022-06-20 16:22:48 normalization > 16:22:18.429743 [debug] [MainThread]: Parsing macros/materializations/models/view/helpers.sql
2022-06-20 16:22:48 normalization > 16:22:18.432282 [debug] [MainThread]: Parsing macros/materializations/snapshots/snapshot_merge.sql
2022-06-20 16:22:48 normalization > 16:22:18.435347 [debug] [MainThread]: Parsing macros/materializations/snapshots/snapshot.sql
2022-06-20 16:22:48 normalization > 16:22:18.457455 [debug] [MainThread]: Parsing macros/materializations/snapshots/helpers.sql
2022-06-20 16:22:48 normalization > 16:22:18.479928 [debug] [MainThread]: Parsing macros/materializations/snapshots/strategies.sql
2022-06-20 16:22:48 normalization > 16:22:18.512025 [debug] [MainThread]: Parsing macros/adapters/persist_docs.sql
2022-06-20 16:22:48 normalization > 16:22:18.520296 [debug] [MainThread]: Parsing macros/adapters/columns.sql
2022-06-20 16:22:48 normalization > 16:22:18.539232 [debug] [MainThread]: Parsing macros/adapters/indexes.sql
2022-06-20 16:22:48 normalization > 16:22:18.544255 [debug] [MainThread]: Parsing macros/adapters/relation.sql
2022-06-20 16:22:48 normalization > 16:22:18.562805 [debug] [MainThread]: Parsing macros/adapters/schema.sql
2022-06-20 16:22:48 normalization > 16:22:18.567594 [debug] [MainThread]: Parsing macros/adapters/freshness.sql
2022-06-20 16:22:48 normalization > 16:22:18.573484 [debug] [MainThread]: Parsing macros/adapters/metadata.sql
2022-06-20 16:22:48 normalization > 16:22:18.587196 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_database.sql
2022-06-20 16:22:48 normalization > 16:22:18.590192 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_schema.sql
2022-06-20 16:22:48 normalization > 16:22:18.594929 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_alias.sql
2022-06-20 16:22:48 normalization > 16:22:18.597447 [debug] [MainThread]: Parsing macros/generic_test_sql/not_null.sql
2022-06-20 16:22:48 normalization > 16:22:18.598375 [debug] [MainThread]: Parsing macros/generic_test_sql/accepted_values.sql
2022-06-20 16:22:48 normalization > 16:22:18.600755 [debug] [MainThread]: Parsing macros/generic_test_sql/unique.sql
2022-06-20 16:22:48 normalization > 16:22:18.601908 [debug] [MainThread]: Parsing macros/generic_test_sql/relationships.sql
2022-06-20 16:22:48 normalization > 16:22:18.603517 [debug] [MainThread]: Parsing tests/generic/builtin.sql
2022-06-20 16:22:48 normalization > 16:22:18.608783 [debug] [MainThread]: Parsing macros/web/get_url_path.sql
2022-06-20 16:22:48 normalization > 16:22:18.613481 [debug] [MainThread]: Parsing macros/web/get_url_host.sql
2022-06-20 16:22:48 normalization > 16:22:18.616897 [debug] [MainThread]: Parsing macros/web/get_url_parameter.sql
2022-06-20 16:22:48 normalization > 16:22:18.619721 [debug] [MainThread]: Parsing macros/materializations/insert_by_period_materialization.sql
2022-06-20 16:22:48 normalization > 16:22:18.666911 [debug] [MainThread]: Parsing macros/schema_tests/test_not_null_where.sql
2022-06-20 16:22:48 normalization > 16:22:18.670026 [debug] [MainThread]: Parsing macros/schema_tests/test_unique_where.sql
2022-06-20 16:22:48 normalization > 16:22:18.672939 [debug] [MainThread]: Parsing macros/schema_tests/at_least_one.sql
2022-06-20 16:22:48 normalization > 16:22:18.675371 [debug] [MainThread]: Parsing macros/schema_tests/not_constant.sql
2022-06-20 16:22:48 normalization > 16:22:18.677684 [debug] [MainThread]: Parsing macros/schema_tests/expression_is_true.sql
2022-06-20 16:22:48 normalization > 16:22:18.680963 [debug] [MainThread]: Parsing macros/schema_tests/recency.sql
2022-06-20 16:22:48 normalization > 16:22:18.684218 [debug] [MainThread]: Parsing macros/schema_tests/equal_rowcount.sql
2022-06-20 16:22:48 normalization > 16:22:18.687264 [debug] [MainThread]: Parsing macros/schema_tests/not_null_proportion.sql
2022-06-20 16:22:48 normalization > 16:22:18.691253 [debug] [MainThread]: Parsing macros/schema_tests/accepted_range.sql
2022-06-20 16:22:48 normalization > 16:22:18.696528 [debug] [MainThread]: Parsing macros/schema_tests/not_accepted_values.sql
2022-06-20 16:22:48 normalization > 16:22:18.700516 [debug] [MainThread]: Parsing macros/schema_tests/cardinality_equality.sql
2022-06-20 16:22:48 normalization > 16:22:18.704225 [debug] [MainThread]: Parsing macros/schema_tests/unique_combination_of_columns.sql
2022-06-20 16:22:48 normalization > 16:22:18.709414 [debug] [MainThread]: Parsing macros/schema_tests/mutually_exclusive_ranges.sql
2022-06-20 16:22:48 normalization > 16:22:18.727503 [debug] [MainThread]: Parsing macros/schema_tests/fewer_rows_than.sql
2022-06-20 16:22:48 normalization > 16:22:18.731058 [debug] [MainThread]: Parsing macros/schema_tests/equality.sql
2022-06-20 16:22:48 normalization > 16:22:18.737909 [debug] [MainThread]: Parsing macros/schema_tests/relationships_where.sql
2022-06-20 16:22:48 normalization > 16:22:18.742186 [debug] [MainThread]: Parsing macros/schema_tests/sequential_values.sql
2022-06-20 16:22:48 normalization > 16:22:18.747711 [debug] [MainThread]: Parsing macros/cross_db_utils/except.sql
2022-06-20 16:22:48 normalization > 16:22:18.750055 [debug] [MainThread]: Parsing macros/cross_db_utils/length.sql
2022-06-20 16:22:48 normalization > 16:22:18.752426 [debug] [MainThread]: Parsing macros/cross_db_utils/position.sql
2022-06-20 16:22:48 normalization > 16:22:18.755515 [debug] [MainThread]: Parsing macros/cross_db_utils/current_timestamp.sql
2022-06-20 16:22:48 normalization > 16:22:18.761803 [debug] [MainThread]: Parsing macros/cross_db_utils/intersect.sql
2022-06-20 16:22:48 normalization > 16:22:18.764125 [debug] [MainThread]: Parsing macros/cross_db_utils/replace.sql
2022-06-20 16:22:48 normalization > 16:22:18.766327 [debug] [MainThread]: Parsing macros/cross_db_utils/escape_single_quotes.sql
2022-06-20 16:22:48 normalization > 16:22:18.769387 [debug] [MainThread]: Parsing macros/cross_db_utils/any_value.sql
2022-06-20 16:22:48 normalization > 16:22:18.771673 [debug] [MainThread]: Parsing macros/cross_db_utils/last_day.sql
2022-06-20 16:22:48 normalization > 16:22:18.777945 [debug] [MainThread]: Parsing macros/cross_db_utils/cast_bool_to_text.sql
2022-06-20 16:22:48 normalization > 16:22:18.780576 [debug] [MainThread]: Parsing macros/cross_db_utils/dateadd.sql
2022-06-20 16:22:48 normalization > 16:22:18.785823 [debug] [MainThread]: Parsing macros/cross_db_utils/literal.sql
2022-06-20 16:22:48 normalization > 16:22:18.787555 [debug] [MainThread]: Parsing macros/cross_db_utils/safe_cast.sql
2022-06-20 16:22:48 normalization > 16:22:18.790750 [debug] [MainThread]: Parsing macros/cross_db_utils/date_trunc.sql
2022-06-20 16:22:48 normalization > 16:22:18.793393 [debug] [MainThread]: Parsing macros/cross_db_utils/bool_or.sql
2022-06-20 16:22:48 normalization > 16:22:18.796142 [debug] [MainThread]: Parsing macros/cross_db_utils/width_bucket.sql
2022-06-20 16:22:48 normalization > 16:22:18.806537 [debug] [MainThread]: Parsing macros/cross_db_utils/hash.sql
2022-06-20 16:22:48 normalization > 16:22:18.809221 [debug] [MainThread]: Parsing macros/cross_db_utils/_is_ephemeral.sql
2022-06-20 16:22:48 normalization > 16:22:18.813873 [debug] [MainThread]: Parsing macros/cross_db_utils/_is_relation.sql
2022-06-20 16:22:48 normalization > 16:22:18.816173 [debug] [MainThread]: Parsing macros/cross_db_utils/right.sql
2022-06-20 16:22:48 normalization > 16:22:18.820505 [debug] [MainThread]: Parsing macros/cross_db_utils/split_part.sql
2022-06-20 16:22:48 normalization > 16:22:18.823788 [debug] [MainThread]: Parsing macros/cross_db_utils/datediff.sql
2022-06-20 16:22:48 normalization > 16:22:18.846219 [debug] [MainThread]: Parsing macros/cross_db_utils/datatypes.sql
2022-06-20 16:22:48 normalization > 16:22:18.859264 [debug] [MainThread]: Parsing macros/cross_db_utils/concat.sql
2022-06-20 16:22:48 normalization > 16:22:18.861477 [debug] [MainThread]: Parsing macros/cross_db_utils/identifier.sql
2022-06-20 16:22:48 normalization > 16:22:18.865008 [debug] [MainThread]: Parsing macros/sql/get_tables_by_prefix_sql.sql
2022-06-20 16:22:48 normalization > 16:22:18.868473 [debug] [MainThread]: Parsing macros/sql/get_column_values.sql
2022-06-20 16:22:48 normalization > 16:22:18.879763 [debug] [MainThread]: Parsing macros/sql/get_query_results_as_dict.sql
2022-06-20 16:22:48 normalization > 16:22:18.884362 [debug] [MainThread]: Parsing macros/sql/get_relations_by_pattern.sql
2022-06-20 16:22:48 normalization > 16:22:18.891144 [debug] [MainThread]: Parsing macros/sql/get_relations_by_prefix.sql
2022-06-20 16:22:48 normalization > 16:22:18.897661 [debug] [MainThread]: Parsing macros/sql/haversine_distance.sql
2022-06-20 16:22:48 normalization > 16:22:18.908833 [debug] [MainThread]: Parsing macros/sql/get_tables_by_pattern_sql.sql
2022-06-20 16:22:48 normalization > 16:22:18.921146 [debug] [MainThread]: Parsing macros/sql/pivot.sql
2022-06-20 16:22:48 normalization > 16:22:18.929077 [debug] [MainThread]: Parsing macros/sql/date_spine.sql
2022-06-20 16:22:48 normalization > 16:22:18.937253 [debug] [MainThread]: Parsing macros/sql/star.sql
2022-06-20 16:22:48 normalization > 16:22:18.945377 [debug] [MainThread]: Parsing macros/sql/union.sql
2022-06-20 16:22:48 normalization > 16:22:18.966010 [debug] [MainThread]: Parsing macros/sql/get_table_types_sql.sql
2022-06-20 16:22:48 normalization > 16:22:18.968534 [debug] [MainThread]: Parsing macros/sql/safe_add.sql
2022-06-20 16:22:48 normalization > 16:22:18.971433 [debug] [MainThread]: Parsing macros/sql/surrogate_key.sql
2022-06-20 16:22:48 normalization > 16:22:18.977488 [debug] [MainThread]: Parsing macros/sql/groupby.sql
2022-06-20 16:22:48 normalization > 16:22:18.979844 [debug] [MainThread]: Parsing macros/sql/generate_series.sql
2022-06-20 16:22:48 normalization > 16:22:18.987585 [debug] [MainThread]: Parsing macros/sql/nullcheck.sql
2022-06-20 16:22:48 normalization > 16:22:18.990577 [debug] [MainThread]: Parsing macros/sql/unpivot.sql
2022-06-20 16:22:48 normalization > 16:22:19.006973 [debug] [MainThread]: Parsing macros/sql/nullcheck_table.sql
2022-06-20 16:22:48 normalization > 16:22:19.010152 [debug] [MainThread]: Parsing macros/jinja_helpers/log_info.sql
2022-06-20 16:22:48 normalization > 16:22:19.012209 [debug] [MainThread]: Parsing macros/jinja_helpers/pretty_time.sql
2022-06-20 16:22:48 normalization > 16:22:19.014492 [debug] [MainThread]: Parsing macros/jinja_helpers/slugify.sql
2022-06-20 16:22:48 normalization > 16:22:19.016617 [debug] [MainThread]: Parsing macros/jinja_helpers/pretty_log_format.sql
2022-06-20 16:22:48 normalization > 16:22:19.760954 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/raw_checkmate/vendor_config_scd.sql
2022-06-20 16:22:48 normalization > 16:22:19.845985 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/raw_checkmate/vendor_config_scd.sql
2022-06-20 16:22:48 normalization > 16:22:19.849044 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/raw_checkmate/bank_config_scd.sql
2022-06-20 16:22:48 normalization > 16:22:19.883701 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/raw_checkmate/bank_config_scd.sql
2022-06-20 16:22:48 normalization > 16:22:19.886701 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql
2022-06-20 16:22:48 normalization > 16:22:19.922901 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql
2022-06-20 16:22:48 normalization > 16:22:19.925806 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/raw_checkmate/inbound_file_metadata_scd.sql
2022-06-20 16:22:48 normalization > 16:22:20.027847 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/raw_checkmate/inbound_file_metadata_scd.sql
2022-06-20 16:22:48 normalization > 16:22:20.030309 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/raw_checkmate/inbound_file_metadata.sql
2022-06-20 16:22:48 normalization > 16:22:20.047190 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/raw_checkmate/inbound_file_metadata.sql
2022-06-20 16:22:48 normalization > 16:22:20.049346 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/raw_checkmate/bank_config.sql
2022-06-20 16:22:48 normalization > 16:22:20.061234 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/raw_checkmate/bank_config.sql
2022-06-20 16:22:48 normalization > 16:22:20.063518 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/raw_checkmate/deposit.sql
2022-06-20 16:22:48 normalization > 16:22:20.075813 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/raw_checkmate/deposit.sql
2022-06-20 16:22:48 normalization > 16:22:20.078005 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/raw_checkmate/vendor_config.sql
2022-06-20 16:22:48 normalization > 16:22:20.089765 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/raw_checkmate/vendor_config.sql
2022-06-20 16:22:48 normalization > 16:22:20.094718 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/bank_config_ab2.sql
2022-06-20 16:22:48 normalization > 16:22:20.126876 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/bank_config_ab2.sql
2022-06-20 16:22:48 normalization > 16:22:20.129325 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/inbound_file_metadata_ab2.sql
2022-06-20 16:22:48 normalization > 16:22:20.146484 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/inbound_file_metadata_ab2.sql
2022-06-20 16:22:48 normalization > 16:22:20.148815 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/bank_config_ab1.sql
2022-06-20 16:22:48 normalization > 16:22:20.187957 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/bank_config_ab1.sql
2022-06-20 16:22:48 normalization > 16:22:20.190642 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/deposit_ab1.sql
2022-06-20 16:22:48 normalization > 16:22:20.240252 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/deposit_ab1.sql
2022-06-20 16:22:48 normalization > 16:22:20.242630 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/vendor_config_ab2.sql
2022-06-20 16:22:48 normalization > 16:22:20.261155 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/vendor_config_ab2.sql
2022-06-20 16:22:48 normalization > 16:22:20.263880 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/deposit_ab2.sql
2022-06-20 16:22:48 normalization > 16:22:20.296061 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/deposit_ab2.sql
2022-06-20 16:22:48 normalization > 16:22:20.298441 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/inbound_file_metadata_ab1.sql
2022-06-20 16:22:48 normalization > 16:22:20.321642 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/inbound_file_metadata_ab1.sql
2022-06-20 16:22:48 normalization > 16:22:20.324011 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/vendor_config_ab1.sql
2022-06-20 16:22:48 normalization > 16:22:20.346906 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/vendor_config_ab1.sql
2022-06-20 16:22:48 normalization > 16:22:20.349130 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/raw_checkmate/vendor_config_stg.sql
2022-06-20 16:22:48 normalization > 16:22:20.366142 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/raw_checkmate/vendor_config_stg.sql
2022-06-20 16:22:48 normalization > 16:22:20.368634 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/raw_checkmate/deposit_stg.sql
2022-06-20 16:22:48 normalization > 16:22:20.393174 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/raw_checkmate/deposit_stg.sql
2022-06-20 16:22:48 normalization > 16:22:20.396106 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/raw_checkmate/bank_config_stg.sql
2022-06-20 16:22:48 normalization > 16:22:20.413934 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/raw_checkmate/bank_config_stg.sql
2022-06-20 16:22:48 normalization > 16:22:20.416162 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/raw_checkmate/inbound_file_metadata_stg.sql
2022-06-20 16:22:48 normalization > 16:22:20.434529 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/raw_checkmate/inbound_file_metadata_stg.sql
2022-06-20 16:22:48 normalization > 16:22:20.557017 [warn ] [MainThread]: [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources.
2022-06-20 16:22:48 normalization > There are 1 unused configuration paths:
2022-06-20 16:22:48 normalization > - models.airbyte_utils.generated.airbyte_tables
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 16:22:20.589633 [info ] [MainThread]: Found 20 models, 0 tests, 0 snapshots, 0 analyses, 548 macros, 0 operations, 0 seed files, 4 sources, 0 exposures, 0 metrics
2022-06-20 16:22:48 normalization > 16:22:20.593020 [info ] [MainThread]: 
2022-06-20 16:22:48 normalization > 16:22:20.594179 [debug] [MainThread]: Acquiring new bigquery connection "master"
2022-06-20 16:22:48 normalization > 16:22:20.596832 [debug] [ThreadPool]: Acquiring new bigquery connection "list_mainapi-282501"
2022-06-20 16:22:48 normalization > 16:22:20.597952 [debug] [ThreadPool]: Acquiring new bigquery connection "list_mainapi-282501"
2022-06-20 16:22:48 normalization > 16:22:20.598672 [debug] [ThreadPool]: Opening a new connection, currently in state init
2022-06-20 16:22:48 normalization > 16:22:20.599057 [debug] [ThreadPool]: Opening a new connection, currently in state init
2022-06-20 16:22:48 normalization > 16:22:20.855504 [debug] [ThreadPool]: Acquiring new bigquery connection "create_mainapi-282501__airbyte_raw_checkmate"
2022-06-20 16:22:48 normalization > 16:22:20.856454 [debug] [ThreadPool]: Acquiring new bigquery connection "create_mainapi-282501__airbyte_raw_checkmate"
2022-06-20 16:22:48 normalization > 16:22:20.856679 [debug] [ThreadPool]: BigQuery adapter: Creating schema "mainapi-282501._airbyte_raw_checkmate".
2022-06-20 16:22:48 normalization > 16:22:20.856886 [debug] [ThreadPool]: Opening a new connection, currently in state closed
2022-06-20 16:22:48 normalization > 16:22:21.123757 [debug] [ThreadPool]: Acquiring new bigquery connection "list_mainapi-282501__airbyte_raw_checkmate"
2022-06-20 16:22:48 normalization > 16:22:21.124776 [debug] [ThreadPool]: Acquiring new bigquery connection "list_mainapi-282501_raw_checkmate"
2022-06-20 16:22:48 normalization > 16:22:21.125322 [debug] [ThreadPool]: Opening a new connection, currently in state closed
2022-06-20 16:22:48 normalization > 16:22:21.125681 [debug] [ThreadPool]: Opening a new connection, currently in state closed
2022-06-20 16:22:48 normalization > 16:22:21.250350 [info ] [MainThread]: Concurrency: 8 threads (target='prod')
2022-06-20 16:22:48 normalization > 16:22:21.250919 [info ] [MainThread]: 
2022-06-20 16:22:48 normalization > 16:22:21.276510 [debug] [Thread-1  ]: Began running node model.airbyte_utils.bank_config_ab1
2022-06-20 16:22:48 normalization > 16:22:21.276841 [debug] [Thread-2  ]: Began running node model.airbyte_utils.deposit_ab1
2022-06-20 16:22:48 normalization > 16:22:21.277220 [debug] [Thread-3  ]: Began running node model.airbyte_utils.inbound_file_metadata_ab1
2022-06-20 16:22:48 normalization > 16:22:21.278173 [debug] [Thread-1  ]: Acquiring new bigquery connection "model.airbyte_utils.bank_config_ab1"
2022-06-20 16:22:48 normalization > 16:22:21.278507 [debug] [Thread-4  ]: Began running node model.airbyte_utils.vendor_config_ab1
2022-06-20 16:22:48 normalization > 16:22:21.279326 [debug] [Thread-2  ]: Acquiring new bigquery connection "model.airbyte_utils.deposit_ab1"
2022-06-20 16:22:48 normalization > 16:22:21.280466 [debug] [Thread-3  ]: Acquiring new bigquery connection "model.airbyte_utils.inbound_file_metadata_ab1"
2022-06-20 16:22:48 normalization > 16:22:21.280777 [debug] [Thread-1  ]: Began compiling node model.airbyte_utils.bank_config_ab1
2022-06-20 16:22:48 normalization > 16:22:21.281699 [debug] [Thread-4  ]: Acquiring new bigquery connection "model.airbyte_utils.vendor_config_ab1"
2022-06-20 16:22:48 normalization > 16:22:21.282006 [debug] [Thread-2  ]: Began compiling node model.airbyte_utils.deposit_ab1
2022-06-20 16:22:48 normalization > 16:22:21.282331 [debug] [Thread-3  ]: Began compiling node model.airbyte_utils.inbound_file_metadata_ab1
2022-06-20 16:22:48 normalization > 16:22:21.282703 [debug] [Thread-1  ]: Compiling model.airbyte_utils.bank_config_ab1
2022-06-20 16:22:48 normalization > 16:22:21.283011 [debug] [Thread-4  ]: Began compiling node model.airbyte_utils.vendor_config_ab1
2022-06-20 16:22:48 normalization > 16:22:21.283273 [debug] [Thread-2  ]: Compiling model.airbyte_utils.deposit_ab1
2022-06-20 16:22:48 normalization > 16:22:21.283561 [debug] [Thread-3  ]: Compiling model.airbyte_utils.inbound_file_metadata_ab1
2022-06-20 16:22:48 normalization > 16:22:21.312875 [debug] [Thread-1  ]: Writing injected SQL for node "model.airbyte_utils.bank_config_ab1"
2022-06-20 16:22:48 normalization > 16:22:21.313298 [debug] [Thread-4  ]: Compiling model.airbyte_utils.vendor_config_ab1
2022-06-20 16:22:48 normalization > 16:22:21.382953 [debug] [Thread-2  ]: Writing injected SQL for node "model.airbyte_utils.deposit_ab1"
2022-06-20 16:22:48 normalization > 16:22:21.408657 [debug] [Thread-4  ]: Writing injected SQL for node "model.airbyte_utils.vendor_config_ab1"
2022-06-20 16:22:48 normalization > 16:22:21.409777 [debug] [Thread-1  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:21.423625 [debug] [Thread-1  ]: Finished running node model.airbyte_utils.bank_config_ab1
2022-06-20 16:22:48 normalization > 16:22:21.425462 [debug] [Thread-3  ]: Writing injected SQL for node "model.airbyte_utils.inbound_file_metadata_ab1"
2022-06-20 16:22:48 normalization > 16:22:21.427202 [debug] [Thread-6  ]: Began running node model.airbyte_utils.bank_config_ab2
2022-06-20 16:22:48 normalization > 16:22:21.428259 [debug] [Thread-6  ]: Acquiring new bigquery connection "model.airbyte_utils.bank_config_ab2"
2022-06-20 16:22:48 normalization > 16:22:21.428926 [debug] [Thread-6  ]: Began compiling node model.airbyte_utils.bank_config_ab2
2022-06-20 16:22:48 normalization > 16:22:21.429593 [debug] [Thread-2  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:21.429846 [debug] [Thread-4  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:21.430138 [debug] [Thread-6  ]: Compiling model.airbyte_utils.bank_config_ab2
2022-06-20 16:22:48 normalization > 16:22:21.430449 [debug] [Thread-3  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:21.431498 [debug] [Thread-2  ]: Finished running node model.airbyte_utils.deposit_ab1
2022-06-20 16:22:48 normalization > 16:22:21.432325 [debug] [Thread-4  ]: Finished running node model.airbyte_utils.vendor_config_ab1
2022-06-20 16:22:48 normalization > 16:22:21.454359 [debug] [Thread-3  ]: Finished running node model.airbyte_utils.inbound_file_metadata_ab1
2022-06-20 16:22:48 normalization > 16:22:21.480854 [debug] [Thread-8  ]: Began running node model.airbyte_utils.deposit_ab2
2022-06-20 16:22:48 normalization > 16:22:21.492386 [debug] [Thread-6  ]: Writing injected SQL for node "model.airbyte_utils.bank_config_ab2"
2022-06-20 16:22:48 normalization > 16:22:21.493464 [debug] [Thread-1  ]: Began running node model.airbyte_utils.inbound_file_metadata_ab2
2022-06-20 16:22:48 normalization > 16:22:21.494554 [debug] [Thread-8  ]: Acquiring new bigquery connection "model.airbyte_utils.deposit_ab2"
2022-06-20 16:22:48 normalization > 16:22:21.494872 [debug] [Thread-7  ]: Began running node model.airbyte_utils.vendor_config_ab2
2022-06-20 16:22:48 normalization > 16:22:21.496226 [debug] [Thread-1  ]: Acquiring new bigquery connection "model.airbyte_utils.inbound_file_metadata_ab2"
2022-06-20 16:22:48 normalization > 16:22:21.496829 [debug] [Thread-8  ]: Began compiling node model.airbyte_utils.deposit_ab2
2022-06-20 16:22:48 normalization > 16:22:21.497110 [debug] [Thread-6  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:21.498164 [debug] [Thread-7  ]: Acquiring new bigquery connection "model.airbyte_utils.vendor_config_ab2"
2022-06-20 16:22:48 normalization > 16:22:21.498646 [debug] [Thread-1  ]: Began compiling node model.airbyte_utils.inbound_file_metadata_ab2
2022-06-20 16:22:48 normalization > 16:22:21.499054 [debug] [Thread-8  ]: Compiling model.airbyte_utils.deposit_ab2
2022-06-20 16:22:48 normalization > 16:22:21.500062 [debug] [Thread-6  ]: Finished running node model.airbyte_utils.bank_config_ab2
2022-06-20 16:22:48 normalization > 16:22:21.500382 [debug] [Thread-7  ]: Began compiling node model.airbyte_utils.vendor_config_ab2
2022-06-20 16:22:48 normalization > 16:22:21.500742 [debug] [Thread-1  ]: Compiling model.airbyte_utils.inbound_file_metadata_ab2
2022-06-20 16:22:48 normalization > 16:22:21.528086 [debug] [Thread-4  ]: Began running node model.airbyte_utils.bank_config_stg
2022-06-20 16:22:48 normalization > 16:22:21.543872 [debug] [Thread-7  ]: Compiling model.airbyte_utils.vendor_config_ab2
2022-06-20 16:22:48 normalization > 16:22:21.606604 [info ] [Thread-4  ]: 1 of 12 START view model _airbyte_raw_checkmate.bank_config_stg......................................................... [RUN]
2022-06-20 16:22:48 normalization > 16:22:21.609281 [debug] [Thread-8  ]: Writing injected SQL for node "model.airbyte_utils.deposit_ab2"
2022-06-20 16:22:48 normalization > 16:22:21.625084 [debug] [Thread-1  ]: Writing injected SQL for node "model.airbyte_utils.inbound_file_metadata_ab2"
2022-06-20 16:22:48 normalization > 16:22:21.642764 [debug] [Thread-4  ]: Acquiring new bigquery connection "model.airbyte_utils.bank_config_stg"
2022-06-20 16:22:48 normalization > 16:22:21.664988 [debug] [Thread-7  ]: Writing injected SQL for node "model.airbyte_utils.vendor_config_ab2"
2022-06-20 16:22:48 normalization > 16:22:21.665609 [debug] [Thread-8  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:21.666090 [debug] [Thread-4  ]: Began compiling node model.airbyte_utils.bank_config_stg
2022-06-20 16:22:48 normalization > 16:22:21.666554 [debug] [Thread-1  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:21.667722 [debug] [Thread-8  ]: Finished running node model.airbyte_utils.deposit_ab2
2022-06-20 16:22:48 normalization > 16:22:21.668008 [debug] [Thread-7  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:21.668368 [debug] [Thread-4  ]: Compiling model.airbyte_utils.bank_config_stg
2022-06-20 16:22:48 normalization > 16:22:21.669271 [debug] [Thread-1  ]: Finished running node model.airbyte_utils.inbound_file_metadata_ab2
2022-06-20 16:22:48 normalization > 16:22:21.670283 [debug] [Thread-3  ]: Began running node model.airbyte_utils.deposit_stg
2022-06-20 16:22:48 normalization > 16:22:21.671124 [debug] [Thread-7  ]: Finished running node model.airbyte_utils.vendor_config_ab2
2022-06-20 16:22:48 normalization > 16:22:21.698600 [debug] [Thread-6  ]: Began running node model.airbyte_utils.inbound_file_metadata_stg
2022-06-20 16:22:48 normalization > 16:22:21.699221 [info ] [Thread-3  ]: 2 of 12 START view model _airbyte_raw_checkmate.deposit_stg............................................................. [RUN]
2022-06-20 16:22:48 normalization > 16:22:21.722082 [debug] [Thread-4  ]: Writing injected SQL for node "model.airbyte_utils.bank_config_stg"
2022-06-20 16:22:48 normalization > 16:22:21.723522 [info ] [Thread-6  ]: 3 of 12 START view model _airbyte_raw_checkmate.inbound_file_metadata_stg............................................... [RUN]
2022-06-20 16:22:48 normalization > 16:22:21.725085 [debug] [Thread-3  ]: Acquiring new bigquery connection "model.airbyte_utils.deposit_stg"
2022-06-20 16:22:48 normalization > 16:22:21.725503 [debug] [Thread-8  ]: Began running node model.airbyte_utils.vendor_config_stg
2022-06-20 16:22:48 normalization > 16:22:21.726998 [debug] [Thread-6  ]: Acquiring new bigquery connection "model.airbyte_utils.inbound_file_metadata_stg"
2022-06-20 16:22:48 normalization > 16:22:21.727379 [debug] [Thread-3  ]: Began compiling node model.airbyte_utils.deposit_stg
2022-06-20 16:22:48 normalization > 16:22:21.727912 [info ] [Thread-8  ]: 4 of 12 START view model _airbyte_raw_checkmate.vendor_config_stg....................................................... [RUN]
2022-06-20 16:22:48 normalization > 16:22:21.728295 [debug] [Thread-6  ]: Began compiling node model.airbyte_utils.inbound_file_metadata_stg
2022-06-20 16:22:48 normalization > 16:22:21.728740 [debug] [Thread-4  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:21.729018 [debug] [Thread-3  ]: Compiling model.airbyte_utils.deposit_stg
2022-06-20 16:22:48 normalization > 16:22:21.730367 [debug] [Thread-8  ]: Acquiring new bigquery connection "model.airbyte_utils.vendor_config_stg"
2022-06-20 16:22:48 normalization > 16:22:21.730704 [debug] [Thread-6  ]: Compiling model.airbyte_utils.inbound_file_metadata_stg
2022-06-20 16:22:48 normalization > 16:22:21.731054 [debug] [Thread-4  ]: Began executing node model.airbyte_utils.bank_config_stg
2022-06-20 16:22:48 normalization > 16:22:21.752294 [debug] [Thread-8  ]: Began compiling node model.airbyte_utils.vendor_config_stg
2022-06-20 16:22:48 normalization > 16:22:21.856256 [debug] [Thread-8  ]: Compiling model.airbyte_utils.vendor_config_stg
2022-06-20 16:22:48 normalization > 16:22:21.871878 [debug] [Thread-3  ]: Writing injected SQL for node "model.airbyte_utils.deposit_stg"
2022-06-20 16:22:48 normalization > 16:22:21.909688 [debug] [Thread-6  ]: Writing injected SQL for node "model.airbyte_utils.inbound_file_metadata_stg"
2022-06-20 16:22:48 normalization > 16:22:21.941628 [debug] [Thread-3  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:21.955369 [debug] [Thread-8  ]: Writing injected SQL for node "model.airbyte_utils.vendor_config_stg"
2022-06-20 16:22:48 normalization > 16:22:21.965584 [debug] [Thread-4  ]: Writing runtime SQL for node "model.airbyte_utils.bank_config_stg"
2022-06-20 16:22:48 normalization > 16:22:21.966271 [debug] [Thread-3  ]: Began executing node model.airbyte_utils.deposit_stg
2022-06-20 16:22:48 normalization > 16:22:21.967400 [debug] [Thread-6  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:21.967747 [debug] [Thread-8  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:21.980702 [debug] [Thread-3  ]: Writing runtime SQL for node "model.airbyte_utils.deposit_stg"
2022-06-20 16:22:48 normalization > 16:22:21.981159 [debug] [Thread-6  ]: Began executing node model.airbyte_utils.inbound_file_metadata_stg
2022-06-20 16:22:48 normalization > 16:22:21.981572 [debug] [Thread-8  ]: Began executing node model.airbyte_utils.vendor_config_stg
2022-06-20 16:22:48 normalization > 16:22:22.061352 [debug] [Thread-3  ]: Opening a new connection, currently in state closed
2022-06-20 16:22:48 normalization > 16:22:22.061947 [debug] [Thread-4  ]: Opening a new connection, currently in state closed
2022-06-20 16:22:48 normalization > 16:22:22.068358 [debug] [Thread-8  ]: Writing runtime SQL for node "model.airbyte_utils.vendor_config_stg"
2022-06-20 16:22:48 normalization > 16:22:22.083923 [debug] [Thread-6  ]: Writing runtime SQL for node "model.airbyte_utils.inbound_file_metadata_stg"
2022-06-20 16:22:48 normalization > 16:22:22.084434 [debug] [Thread-3  ]: On model.airbyte_utils.deposit_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.deposit_stg"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   create or replace view `mainapi-282501`._airbyte_raw_checkmate.`deposit_stg`
2022-06-20 16:22:48 normalization >   OPTIONS()
2022-06-20 16:22:48 normalization >   as 
2022-06-20 16:22:48 normalization > with __dbt__cte__deposit_ab1 as (
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema
2022-06-20 16:22:48 normalization > -- depends_on: `mainapi-282501`.raw_checkmate._airbyte_raw_deposit
2022-06-20 16:22:48 normalization > select
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['micr']") as micr,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['amount']") as amount,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['status']") as status,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['bank_id']") as bank_id,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['currency']") as currency,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['party_id']") as party_id,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['account_id']") as account_id,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['deposit_id']") as deposit_id,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['partner_id']") as partner_id,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['party_type']") as party_type,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['vendor_info']") as vendor_info,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['check_amount']") as check_amount,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['check_number']") as check_number,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_ch']") as timestamp_ch,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_cr']") as timestamp_cr,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_de']") as timestamp_de,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['back_image_id']") as back_image_id,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['date_captured']") as date_captured,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['account_number']") as account_number,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['date_processed']") as date_processed,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['front_image_id']") as front_image_id,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['transaction_id']") as transaction_id,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['ocr_account_number']") as ocr_account_number,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['vendor_reference_id']") as vendor_reference_id,
2022-06-20 16:22:48 normalization >     _airbyte_ab_id,
2022-06-20 16:22:48 normalization >     _airbyte_emitted_at,
2022-06-20 16:22:48 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:22:48 normalization > from `mainapi-282501`.raw_checkmate._airbyte_raw_deposit as table_alias
2022-06-20 16:22:48 normalization > -- deposit
2022-06-20 16:22:48 normalization > where 1 = 1
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > ),  __dbt__cte__deposit_ab2 as (
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type
2022-06-20 16:22:48 normalization > -- depends_on: __dbt__cte__deposit_ab1
2022-06-20 16:22:48 normalization > select
2022-06-20 16:22:48 normalization >     cast(micr as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as micr,
2022-06-20 16:22:48 normalization >     cast(amount as 
2022-06-20 16:22:48 normalization >     float64
2022-06-20 16:22:48 normalization > ) as amount,
2022-06-20 16:22:48 normalization >     cast(status as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as status,
2022-06-20 16:22:48 normalization >     cast(bank_id as 
2022-06-20 16:22:48 normalization >     float64
2022-06-20 16:22:48 normalization > ) as bank_id,
2022-06-20 16:22:48 normalization >     cast(currency as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as currency,
2022-06-20 16:22:48 normalization >     cast(party_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as party_id,
2022-06-20 16:22:48 normalization >     cast(account_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as account_id,
2022-06-20 16:22:48 normalization >     cast(deposit_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as deposit_id,
2022-06-20 16:22:48 normalization >     cast(partner_id as 
2022-06-20 16:22:48 normalization >     float64
2022-06-20 16:22:48 normalization > ) as partner_id,
2022-06-20 16:22:48 normalization >     cast(party_type as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as party_type,
2022-06-20 16:22:48 normalization >     cast(_ab_cdc_lsn as 
2022-06-20 16:22:48 normalization >     float64
2022-06-20 16:22:48 normalization > ) as _ab_cdc_lsn,
2022-06-20 16:22:48 normalization >     cast(vendor_info as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as vendor_info,
2022-06-20 16:22:48 normalization >     cast(check_amount as 
2022-06-20 16:22:48 normalization >     float64
2022-06-20 16:22:48 normalization > ) as check_amount,
2022-06-20 16:22:48 normalization >     cast(check_number as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as check_number,
2022-06-20 16:22:48 normalization >     cast(nullif(timestamp_ch, '') as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) as timestamp_ch,
2022-06-20 16:22:48 normalization >     cast(nullif(timestamp_cr, '') as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) as timestamp_cr,
2022-06-20 16:22:48 normalization >     cast(nullif(timestamp_de, '') as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) as timestamp_de,
2022-06-20 16:22:48 normalization >     cast(back_image_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as back_image_id,
2022-06-20 16:22:48 normalization >     cast(nullif(date_captured, '') as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) as date_captured,
2022-06-20 16:22:48 normalization >     cast(account_number as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as account_number,
2022-06-20 16:22:48 normalization >     cast(nullif(date_processed, '') as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) as date_processed,
2022-06-20 16:22:48 normalization >     cast(front_image_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as front_image_id,
2022-06-20 16:22:48 normalization >     cast(transaction_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as transaction_id,
2022-06-20 16:22:48 normalization >     cast(_ab_cdc_deleted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as _ab_cdc_deleted_at,
2022-06-20 16:22:48 normalization >     cast(_ab_cdc_updated_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as _ab_cdc_updated_at,
2022-06-20 16:22:48 normalization >     cast(ocr_account_number as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as ocr_account_number,
2022-06-20 16:22:48 normalization >     cast(vendor_reference_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as vendor_reference_id,
2022-06-20 16:22:48 normalization >     _airbyte_ab_id,
2022-06-20 16:22:48 normalization >     _airbyte_emitted_at,
2022-06-20 16:22:48 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:22:48 normalization > from __dbt__cte__deposit_ab1
2022-06-20 16:22:48 normalization > -- deposit
2022-06-20 16:22:48 normalization > where 1 = 1
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > )-- SQL model to build a hash column based on the values of this record
2022-06-20 16:22:48 normalization > -- depends_on: __dbt__cte__deposit_ab2
2022-06-20 16:22:48 normalization > select
2022-06-20 16:22:48 normalization >     to_hex(md5(cast(concat(coalesce(cast(micr as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(amount as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(status as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(bank_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(currency as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(party_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(account_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(deposit_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(partner_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(party_type as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(vendor_info as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(check_amount as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(check_number as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(timestamp_ch as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(timestamp_cr as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(timestamp_de as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(back_image_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(date_captured as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(account_number as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(date_processed as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(front_image_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(transaction_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(ocr_account_number as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(vendor_reference_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), '')) as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ))) as _airbyte_deposit_hashid,
2022-06-20 16:22:48 normalization >     tmp.*
2022-06-20 16:22:48 normalization > from __dbt__cte__deposit_ab2 tmp
2022-06-20 16:22:48 normalization > -- deposit
2022-06-20 16:22:48 normalization > where 1 = 1
2022-06-20 16:22:48 normalization > ;
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 16:22:22.087665 [debug] [Thread-6  ]: Opening a new connection, currently in state closed
2022-06-20 16:22:48 normalization > 16:22:22.088196 [debug] [Thread-8  ]: Opening a new connection, currently in state closed
2022-06-20 16:22:48 normalization > 16:22:22.092993 [debug] [Thread-4  ]: On model.airbyte_utils.bank_config_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.bank_config_stg"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   create or replace view `mainapi-282501`._airbyte_raw_checkmate.`bank_config_stg`
2022-06-20 16:22:48 normalization >   OPTIONS()
2022-06-20 16:22:48 normalization >   as 
2022-06-20 16:22:48 normalization > with __dbt__cte__bank_config_ab1 as (
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema
2022-06-20 16:22:48 normalization > -- depends_on: `mainapi-282501`.raw_checkmate._airbyte_raw_bank_config
2022-06-20 16:22:48 normalization > select
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['name']") as name,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['bank_id']") as bank_id,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_ch']") as timestamp_ch,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_cr']") as timestamp_cr,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['hold_duration']") as hold_duration,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['bank_config_id']") as bank_config_id,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['vendor_bank_id']") as vendor_bank_id,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['inbound_upload_path']") as inbound_upload_path,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['outbound_upload_path']") as outbound_upload_path,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['hold_amount_percentage']") as hold_amount_percentage,
2022-06-20 16:22:48 normalization >     _airbyte_ab_id,
2022-06-20 16:22:48 normalization >     _airbyte_emitted_at,
2022-06-20 16:22:48 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:22:48 normalization > from `mainapi-282501`.raw_checkmate._airbyte_raw_bank_config as table_alias
2022-06-20 16:22:48 normalization > -- bank_config
2022-06-20 16:22:48 normalization > where 1 = 1
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > ),  __dbt__cte__bank_config_ab2 as (
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type
2022-06-20 16:22:48 normalization > -- depends_on: __dbt__cte__bank_config_ab1
2022-06-20 16:22:48 normalization > select
2022-06-20 16:22:48 normalization >     cast(name as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as name,
2022-06-20 16:22:48 normalization >     cast(bank_id as 
2022-06-20 16:22:48 normalization >     float64
2022-06-20 16:22:48 normalization > ) as bank_id,
2022-06-20 16:22:48 normalization >     cast(_ab_cdc_lsn as 
2022-06-20 16:22:48 normalization >     float64
2022-06-20 16:22:48 normalization > ) as _ab_cdc_lsn,
2022-06-20 16:22:48 normalization >     cast(nullif(timestamp_ch, '') as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) as timestamp_ch,
2022-06-20 16:22:48 normalization >     cast(nullif(timestamp_cr, '') as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) as timestamp_cr,
2022-06-20 16:22:48 normalization >     cast(hold_duration as 
2022-06-20 16:22:48 normalization >     float64
2022-06-20 16:22:48 normalization > ) as hold_duration,
2022-06-20 16:22:48 normalization >     cast(bank_config_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as bank_config_id,
2022-06-20 16:22:48 normalization >     cast(vendor_bank_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as vendor_bank_id,
2022-06-20 16:22:48 normalization >     cast(_ab_cdc_deleted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as _ab_cdc_deleted_at,
2022-06-20 16:22:48 normalization >     cast(_ab_cdc_updated_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as _ab_cdc_updated_at,
2022-06-20 16:22:48 normalization >     cast(inbound_upload_path as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as inbound_upload_path,
2022-06-20 16:22:48 normalization >     cast(outbound_upload_path as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as outbound_upload_path,
2022-06-20 16:22:48 normalization >     cast(hold_amount_percentage as 
2022-06-20 16:22:48 normalization >     float64
2022-06-20 16:22:48 normalization > ) as hold_amount_percentage,
2022-06-20 16:22:48 normalization >     _airbyte_ab_id,
2022-06-20 16:22:48 normalization >     _airbyte_emitted_at,
2022-06-20 16:22:48 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:22:48 normalization > from __dbt__cte__bank_config_ab1
2022-06-20 16:22:48 normalization > -- bank_config
2022-06-20 16:22:48 normalization > where 1 = 1
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > )-- SQL model to build a hash column based on the values of this record
2022-06-20 16:22:48 normalization > -- depends_on: __dbt__cte__bank_config_ab2
2022-06-20 16:22:48 normalization > select
2022-06-20 16:22:48 normalization >     to_hex(md5(cast(concat(coalesce(cast(name as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(bank_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(timestamp_ch as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(timestamp_cr as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(hold_duration as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(bank_config_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(vendor_bank_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(inbound_upload_path as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(outbound_upload_path as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(hold_amount_percentage as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), '')) as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ))) as _airbyte_bank_config_hashid,
2022-06-20 16:22:48 normalization >     tmp.*
2022-06-20 16:22:48 normalization > from __dbt__cte__bank_config_ab2 tmp
2022-06-20 16:22:48 normalization > -- bank_config
2022-06-20 16:22:48 normalization > where 1 = 1
2022-06-20 16:22:48 normalization > ;
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 16:22:22.100016 [debug] [Thread-8  ]: On model.airbyte_utils.vendor_config_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.vendor_config_stg"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   create or replace view `mainapi-282501`._airbyte_raw_checkmate.`vendor_config_stg`
2022-06-20 16:22:48 normalization >   OPTIONS()
2022-06-20 16:22:48 normalization >   as 
2022-06-20 16:22:48 normalization > with __dbt__cte__vendor_config_ab1 as (
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema
2022-06-20 16:22:48 normalization > -- depends_on: `mainapi-282501`.raw_checkmate._airbyte_raw_vendor_config
2022-06-20 16:22:48 normalization > select
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['name']") as name,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_ch']") as timestamp_ch,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_cr']") as timestamp_cr,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['vendor_config_id']") as vendor_config_id,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['inbound_upload_path']") as inbound_upload_path,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['outbound_upload_path']") as outbound_upload_path,
2022-06-20 16:22:48 normalization >     _airbyte_ab_id,
2022-06-20 16:22:48 normalization >     _airbyte_emitted_at,
2022-06-20 16:22:48 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:22:48 normalization > from `mainapi-282501`.raw_checkmate._airbyte_raw_vendor_config as table_alias
2022-06-20 16:22:48 normalization > -- vendor_config
2022-06-20 16:22:48 normalization > where 1 = 1
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > ),  __dbt__cte__vendor_config_ab2 as (
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type
2022-06-20 16:22:48 normalization > -- depends_on: __dbt__cte__vendor_config_ab1
2022-06-20 16:22:48 normalization > select
2022-06-20 16:22:48 normalization >     cast(name as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as name,
2022-06-20 16:22:48 normalization >     cast(_ab_cdc_lsn as 
2022-06-20 16:22:48 normalization >     float64
2022-06-20 16:22:48 normalization > ) as _ab_cdc_lsn,
2022-06-20 16:22:48 normalization >     cast(nullif(timestamp_ch, '') as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) as timestamp_ch,
2022-06-20 16:22:48 normalization >     cast(nullif(timestamp_cr, '') as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) as timestamp_cr,
2022-06-20 16:22:48 normalization >     cast(vendor_config_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as vendor_config_id,
2022-06-20 16:22:48 normalization >     cast(_ab_cdc_deleted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as _ab_cdc_deleted_at,
2022-06-20 16:22:48 normalization >     cast(_ab_cdc_updated_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as _ab_cdc_updated_at,
2022-06-20 16:22:48 normalization >     cast(inbound_upload_path as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as inbound_upload_path,
2022-06-20 16:22:48 normalization >     cast(outbound_upload_path as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as outbound_upload_path,
2022-06-20 16:22:48 normalization >     _airbyte_ab_id,
2022-06-20 16:22:48 normalization >     _airbyte_emitted_at,
2022-06-20 16:22:48 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:22:48 normalization > from __dbt__cte__vendor_config_ab1
2022-06-20 16:22:48 normalization > -- vendor_config
2022-06-20 16:22:48 normalization > where 1 = 1
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > )-- SQL model to build a hash column based on the values of this record
2022-06-20 16:22:48 normalization > -- depends_on: __dbt__cte__vendor_config_ab2
2022-06-20 16:22:48 normalization > select
2022-06-20 16:22:48 normalization >     to_hex(md5(cast(concat(coalesce(cast(name as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(timestamp_ch as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(timestamp_cr as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(vendor_config_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(inbound_upload_path as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(outbound_upload_path as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), '')) as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ))) as _airbyte_vendor_config_hashid,
2022-06-20 16:22:48 normalization >     tmp.*
2022-06-20 16:22:48 normalization > from __dbt__cte__vendor_config_ab2 tmp
2022-06-20 16:22:48 normalization > -- vendor_config
2022-06-20 16:22:48 normalization > where 1 = 1
2022-06-20 16:22:48 normalization > ;
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 16:22:22.100526 [debug] [Thread-6  ]: On model.airbyte_utils.inbound_file_metadata_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.inbound_file_metadata_stg"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   create or replace view `mainapi-282501`._airbyte_raw_checkmate.`inbound_file_metadata_stg`
2022-06-20 16:22:48 normalization >   OPTIONS()
2022-06-20 16:22:48 normalization >   as 
2022-06-20 16:22:48 normalization > with __dbt__cte__inbound_file_metadata_ab1 as (
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema
2022-06-20 16:22:48 normalization > -- depends_on: `mainapi-282501`.raw_checkmate._airbyte_raw_inbound_file_metadata
2022-06-20 16:22:48 normalization > select
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['file_hash']") as file_hash,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['file_name']") as file_name,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_ch']") as timestamp_ch,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_cr']") as timestamp_cr,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at,
2022-06-20 16:22:48 normalization >     json_extract_scalar(_airbyte_data, "$['inbound_file_metadata_id']") as inbound_file_metadata_id,
2022-06-20 16:22:48 normalization >     _airbyte_ab_id,
2022-06-20 16:22:48 normalization >     _airbyte_emitted_at,
2022-06-20 16:22:48 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:22:48 normalization > from `mainapi-282501`.raw_checkmate._airbyte_raw_inbound_file_metadata as table_alias
2022-06-20 16:22:48 normalization > -- inbound_file_metadata
2022-06-20 16:22:48 normalization > where 1 = 1
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > ),  __dbt__cte__inbound_file_metadata_ab2 as (
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type
2022-06-20 16:22:48 normalization > -- depends_on: __dbt__cte__inbound_file_metadata_ab1
2022-06-20 16:22:48 normalization > select
2022-06-20 16:22:48 normalization >     cast(file_hash as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as file_hash,
2022-06-20 16:22:48 normalization >     cast(file_name as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as file_name,
2022-06-20 16:22:48 normalization >     cast(_ab_cdc_lsn as 
2022-06-20 16:22:48 normalization >     float64
2022-06-20 16:22:48 normalization > ) as _ab_cdc_lsn,
2022-06-20 16:22:48 normalization >     cast(nullif(timestamp_ch, '') as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) as timestamp_ch,
2022-06-20 16:22:48 normalization >     cast(nullif(timestamp_cr, '') as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) as timestamp_cr,
2022-06-20 16:22:48 normalization >     cast(_ab_cdc_deleted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as _ab_cdc_deleted_at,
2022-06-20 16:22:48 normalization >     cast(_ab_cdc_updated_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as _ab_cdc_updated_at,
2022-06-20 16:22:48 normalization >     cast(inbound_file_metadata_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ) as inbound_file_metadata_id,
2022-06-20 16:22:48 normalization >     _airbyte_ab_id,
2022-06-20 16:22:48 normalization >     _airbyte_emitted_at,
2022-06-20 16:22:48 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:22:48 normalization > from __dbt__cte__inbound_file_metadata_ab1
2022-06-20 16:22:48 normalization > -- inbound_file_metadata
2022-06-20 16:22:48 normalization > where 1 = 1
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > )-- SQL model to build a hash column based on the values of this record
2022-06-20 16:22:48 normalization > -- depends_on: __dbt__cte__inbound_file_metadata_ab2
2022-06-20 16:22:48 normalization > select
2022-06-20 16:22:48 normalization >     to_hex(md5(cast(concat(coalesce(cast(file_hash as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(file_name as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(timestamp_ch as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(timestamp_cr as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(inbound_file_metadata_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), '')) as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ))) as _airbyte_inbound_file_metadata_hashid,
2022-06-20 16:22:48 normalization >     tmp.*
2022-06-20 16:22:48 normalization > from __dbt__cte__inbound_file_metadata_ab2 tmp
2022-06-20 16:22:48 normalization > -- inbound_file_metadata
2022-06-20 16:22:48 normalization > where 1 = 1
2022-06-20 16:22:48 normalization > ;
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 16:22:22.761625 [debug] [Thread-4  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:22.767706 [info ] [Thread-4  ]: 1 of 12 OK created view model _airbyte_raw_checkmate.bank_config_stg.................................................... [OK in 1.13s]
2022-06-20 16:22:48 normalization > 16:22:22.772784 [debug] [Thread-8  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:22.774675 [info ] [Thread-8  ]: 4 of 12 OK created view model _airbyte_raw_checkmate.vendor_config_stg.................................................. [OK in 1.04s]
2022-06-20 16:22:48 normalization > 16:22:22.775238 [debug] [Thread-4  ]: Finished running node model.airbyte_utils.bank_config_stg
2022-06-20 16:22:48 normalization > 16:22:22.776137 [debug] [Thread-8  ]: Finished running node model.airbyte_utils.vendor_config_stg
2022-06-20 16:22:48 normalization > 16:22:22.780038 [debug] [Thread-6  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:22.785534 [debug] [Thread-3  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:22.787032 [debug] [Thread-1  ]: Began running node model.airbyte_utils.bank_config_scd
2022-06-20 16:22:48 normalization > 16:22:22.787963 [debug] [Thread-7  ]: Began running node model.airbyte_utils.vendor_config_scd
2022-06-20 16:22:48 normalization > 16:22:22.789533 [info ] [Thread-6  ]: 3 of 12 OK created view model _airbyte_raw_checkmate.inbound_file_metadata_stg.......................................... [OK in 1.06s]
2022-06-20 16:22:48 normalization > 16:22:22.790929 [info ] [Thread-3  ]: 2 of 12 OK created view model _airbyte_raw_checkmate.deposit_stg........................................................ [OK in 1.07s]
2022-06-20 16:22:48 normalization > 16:22:22.791524 [info ] [Thread-1  ]: 5 of 12 START incremental model raw_checkmate.bank_config_scd........................................................... [RUN]
2022-06-20 16:22:48 normalization > 16:22:22.792063 [info ] [Thread-7  ]: 6 of 12 START incremental model raw_checkmate.vendor_config_scd......................................................... [RUN]
2022-06-20 16:22:48 normalization > 16:22:22.792915 [debug] [Thread-6  ]: Finished running node model.airbyte_utils.inbound_file_metadata_stg
2022-06-20 16:22:48 normalization > 16:22:22.794010 [debug] [Thread-3  ]: Finished running node model.airbyte_utils.deposit_stg
2022-06-20 16:22:48 normalization > 16:22:22.795784 [debug] [Thread-1  ]: Acquiring new bigquery connection "model.airbyte_utils.bank_config_scd"
2022-06-20 16:22:48 normalization > 16:22:22.798813 [debug] [Thread-7  ]: Acquiring new bigquery connection "model.airbyte_utils.vendor_config_scd"
2022-06-20 16:22:48 normalization > 16:22:22.799970 [debug] [Thread-1  ]: Began compiling node model.airbyte_utils.bank_config_scd
2022-06-20 16:22:48 normalization > 16:22:22.800408 [debug] [Thread-4  ]: Began running node model.airbyte_utils.deposit_scd
2022-06-20 16:22:48 normalization > 16:22:22.800805 [debug] [Thread-8  ]: Began running node model.airbyte_utils.inbound_file_metadata_scd
2022-06-20 16:22:48 normalization > 16:22:22.801124 [debug] [Thread-7  ]: Began compiling node model.airbyte_utils.vendor_config_scd
2022-06-20 16:22:48 normalization > 16:22:22.801558 [debug] [Thread-1  ]: Compiling model.airbyte_utils.bank_config_scd
2022-06-20 16:22:48 normalization > 16:22:22.802114 [info ] [Thread-4  ]: 7 of 12 START incremental model raw_checkmate.deposit_scd............................................................... [RUN]
2022-06-20 16:22:48 normalization > 16:22:22.802660 [info ] [Thread-8  ]: 8 of 12 START incremental model raw_checkmate.inbound_file_metadata_scd................................................. [RUN]
2022-06-20 16:22:48 normalization > 16:22:22.803011 [debug] [Thread-7  ]: Compiling model.airbyte_utils.vendor_config_scd
2022-06-20 16:22:48 normalization > 16:22:22.836414 [debug] [Thread-4  ]: Acquiring new bigquery connection "model.airbyte_utils.deposit_scd"
2022-06-20 16:22:48 normalization > 16:22:22.838082 [debug] [Thread-8  ]: Acquiring new bigquery connection "model.airbyte_utils.inbound_file_metadata_scd"
2022-06-20 16:22:48 normalization > 16:22:22.862936 [debug] [Thread-1  ]: Opening a new connection, currently in state closed
2022-06-20 16:22:48 normalization > 16:22:22.879272 [debug] [Thread-4  ]: Began compiling node model.airbyte_utils.deposit_scd
2022-06-20 16:22:48 normalization > 16:22:22.887480 [debug] [Thread-7  ]: Opening a new connection, currently in state closed
2022-06-20 16:22:48 normalization > 16:22:22.888020 [debug] [Thread-8  ]: Began compiling node model.airbyte_utils.inbound_file_metadata_scd
2022-06-20 16:22:48 normalization > 16:22:22.888834 [debug] [Thread-4  ]: Compiling model.airbyte_utils.deposit_scd
2022-06-20 16:22:48 normalization > 16:22:22.889555 [debug] [Thread-8  ]: Compiling model.airbyte_utils.inbound_file_metadata_scd
2022-06-20 16:22:48 normalization > 16:22:22.938404 [debug] [Thread-4  ]: Writing injected SQL for node "model.airbyte_utils.deposit_scd"
2022-06-20 16:22:48 normalization > 16:22:22.984147 [debug] [Thread-8  ]: Opening a new connection, currently in state closed
2022-06-20 16:22:48 normalization > 16:22:22.985382 [debug] [Thread-4  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:22.987156 [debug] [Thread-4  ]: Began executing node model.airbyte_utils.deposit_scd
2022-06-20 16:22:48 normalization > 16:22:23.049776 [debug] [Thread-4  ]: Opening a new connection, currently in state closed
2022-06-20 16:22:48 normalization > 16:22:23.224543 [debug] [Thread-4  ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/mainapi-282501/datasets/raw_checkmate/tables/deposit_scd?prettyPrint=false: Not found: Table mainapi-282501:raw_checkmate.deposit_scd
2022-06-20 16:22:48 normalization > 16:22:23.273038 [info ] [Thread-4  ]: 16:22:23 + `mainapi-282501`.raw_checkmate.`deposit_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-06-20 16:22:48 normalization > 16:22:23.374684 [debug] [Thread-4  ]: Writing runtime SQL for node "model.airbyte_utils.deposit_scd"
2022-06-20 16:22:48 normalization > 16:22:23.376907 [debug] [Thread-4  ]: On model.airbyte_utils.deposit_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.deposit_scd"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`deposit_scd`
2022-06-20 16:22:48 normalization >   partition by range_bucket(
2022-06-20 16:22:48 normalization >             _airbyte_active_row,
2022-06-20 16:22:48 normalization >             generate_array(0, 1, 1)
2022-06-20 16:22:48 normalization >         )
2022-06-20 16:22:48 normalization >   cluster by _airbyte_unique_key_scd, _airbyte_emitted_at
2022-06-20 16:22:48 normalization >   OPTIONS()
2022-06-20 16:22:48 normalization >   as (
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > -- depends_on: ref('deposit_stg')
2022-06-20 16:22:48 normalization > with
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > input_data as (
2022-06-20 16:22:48 normalization >     select *
2022-06-20 16:22:48 normalization >     from `mainapi-282501`._airbyte_raw_checkmate.`deposit_stg`
2022-06-20 16:22:48 normalization >     -- deposit from `mainapi-282501`.raw_checkmate._airbyte_raw_deposit
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > scd_data as (
2022-06-20 16:22:48 normalization >     -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key
2022-06-20 16:22:48 normalization >     select
2022-06-20 16:22:48 normalization >       to_hex(md5(cast(concat(coalesce(cast(deposit_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), '')) as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ))) as _airbyte_unique_key,
2022-06-20 16:22:48 normalization >       micr,
2022-06-20 16:22:48 normalization >       amount,
2022-06-20 16:22:48 normalization >       status,
2022-06-20 16:22:48 normalization >       bank_id,
2022-06-20 16:22:48 normalization >       currency,
2022-06-20 16:22:48 normalization >       party_id,
2022-06-20 16:22:48 normalization >       account_id,
2022-06-20 16:22:48 normalization >       deposit_id,
2022-06-20 16:22:48 normalization >       partner_id,
2022-06-20 16:22:48 normalization >       party_type,
2022-06-20 16:22:48 normalization >       _ab_cdc_lsn,
2022-06-20 16:22:48 normalization >       vendor_info,
2022-06-20 16:22:48 normalization >       check_amount,
2022-06-20 16:22:48 normalization >       check_number,
2022-06-20 16:22:48 normalization >       timestamp_ch,
2022-06-20 16:22:48 normalization >       timestamp_cr,
2022-06-20 16:22:48 normalization >       timestamp_de,
2022-06-20 16:22:48 normalization >       back_image_id,
2022-06-20 16:22:48 normalization >       date_captured,
2022-06-20 16:22:48 normalization >       account_number,
2022-06-20 16:22:48 normalization >       date_processed,
2022-06-20 16:22:48 normalization >       front_image_id,
2022-06-20 16:22:48 normalization >       transaction_id,
2022-06-20 16:22:48 normalization >       _ab_cdc_deleted_at,
2022-06-20 16:22:48 normalization >       _ab_cdc_updated_at,
2022-06-20 16:22:48 normalization >       ocr_account_number,
2022-06-20 16:22:48 normalization >       vendor_reference_id,
2022-06-20 16:22:48 normalization >       timestamp_ch as _airbyte_start_at,
2022-06-20 16:22:48 normalization >       lag(timestamp_ch) over (
2022-06-20 16:22:48 normalization >         partition by deposit_id
2022-06-20 16:22:48 normalization >         order by
2022-06-20 16:22:48 normalization >             timestamp_ch is null asc,
2022-06-20 16:22:48 normalization >             timestamp_ch desc,
2022-06-20 16:22:48 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:22:48 normalization >             _airbyte_emitted_at desc
2022-06-20 16:22:48 normalization >       ) as _airbyte_end_at,
2022-06-20 16:22:48 normalization >       case when row_number() over (
2022-06-20 16:22:48 normalization >         partition by deposit_id
2022-06-20 16:22:48 normalization >         order by
2022-06-20 16:22:48 normalization >             timestamp_ch is null asc,
2022-06-20 16:22:48 normalization >             timestamp_ch desc,
2022-06-20 16:22:48 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:22:48 normalization >             _airbyte_emitted_at desc
2022-06-20 16:22:48 normalization >       ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row,
2022-06-20 16:22:48 normalization >       _airbyte_ab_id,
2022-06-20 16:22:48 normalization >       _airbyte_emitted_at,
2022-06-20 16:22:48 normalization >       _airbyte_deposit_hashid
2022-06-20 16:22:48 normalization >     from input_data
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 normalization > dedup_data as (
2022-06-20 16:22:48 normalization >     select
2022-06-20 16:22:48 normalization >         -- we need to ensure de-duplicated rows for merge/update queries
2022-06-20 16:22:48 normalization >         -- additionally, we generate a unique key for the scd table
2022-06-20 16:22:48 normalization >         row_number() over (
2022-06-20 16:22:48 normalization >             partition by
2022-06-20 16:22:48 normalization >                 _airbyte_unique_key,
2022-06-20 16:22:48 normalization >                 _airbyte_start_at,
2022-06-20 16:22:48 normalization >                 _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), cast(_ab_cdc_updated_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > )
2022-06-20 16:22:48 normalization >             order by _airbyte_active_row desc, _airbyte_ab_id
2022-06-20 16:22:48 normalization >         ) as _airbyte_row_num,
2022-06-20 16:22:48 normalization >         to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), '')) as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ))) as _airbyte_unique_key_scd,
2022-06-20 16:22:48 normalization >         scd_data.*
2022-06-20 16:22:48 normalization >     from scd_data
2022-06-20 16:22:48 normalization > )
2022-06-20 16:22:48 normalization > select
2022-06-20 16:22:48 normalization >     _airbyte_unique_key,
2022-06-20 16:22:48 normalization >     _airbyte_unique_key_scd,
2022-06-20 16:22:48 normalization >     micr,
2022-06-20 16:22:48 normalization >     amount,
2022-06-20 16:22:48 normalization >     status,
2022-06-20 16:22:48 normalization >     bank_id,
2022-06-20 16:22:48 normalization >     currency,
2022-06-20 16:22:48 normalization >     party_id,
2022-06-20 16:22:48 normalization >     account_id,
2022-06-20 16:22:48 normalization >     deposit_id,
2022-06-20 16:22:48 normalization >     partner_id,
2022-06-20 16:22:48 normalization >     party_type,
2022-06-20 16:22:48 normalization >     _ab_cdc_lsn,
2022-06-20 16:22:48 normalization >     vendor_info,
2022-06-20 16:22:48 normalization >     check_amount,
2022-06-20 16:22:48 normalization >     check_number,
2022-06-20 16:22:48 normalization >     timestamp_ch,
2022-06-20 16:22:48 normalization >     timestamp_cr,
2022-06-20 16:22:48 normalization >     timestamp_de,
2022-06-20 16:22:48 normalization >     back_image_id,
2022-06-20 16:22:48 normalization >     date_captured,
2022-06-20 16:22:48 normalization >     account_number,
2022-06-20 16:22:48 normalization >     date_processed,
2022-06-20 16:22:48 normalization >     front_image_id,
2022-06-20 16:22:48 normalization >     transaction_id,
2022-06-20 16:22:48 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:22:48 normalization >     _ab_cdc_updated_at,
2022-06-20 16:22:48 normalization >     ocr_account_number,
2022-06-20 16:22:48 normalization >     vendor_reference_id,
2022-06-20 16:22:48 normalization >     _airbyte_start_at,
2022-06-20 16:22:48 normalization >     _airbyte_end_at,
2022-06-20 16:22:48 normalization >     _airbyte_active_row,
2022-06-20 16:22:48 normalization >     _airbyte_ab_id,
2022-06-20 16:22:48 normalization >     _airbyte_emitted_at,
2022-06-20 16:22:48 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:22:48 normalization >     _airbyte_deposit_hashid
2022-06-20 16:22:48 normalization > from dedup_data where _airbyte_row_num = 1
2022-06-20 16:22:48 normalization >   );
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 16:22:23.597075 [debug] [Thread-1  ]: Writing injected SQL for node "model.airbyte_utils.bank_config_scd"
2022-06-20 16:22:48 normalization > 16:22:23.597875 [debug] [Thread-1  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:23.598109 [debug] [Thread-1  ]: Began executing node model.airbyte_utils.bank_config_scd
2022-06-20 16:22:48 normalization > 16:22:23.640472 [debug] [Thread-7  ]: Writing injected SQL for node "model.airbyte_utils.vendor_config_scd"
2022-06-20 16:22:48 normalization > 16:22:23.641664 [debug] [Thread-7  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:23.642114 [debug] [Thread-7  ]: Began executing node model.airbyte_utils.vendor_config_scd
2022-06-20 16:22:48 normalization > 16:22:23.676496 [debug] [Thread-1  ]: On model.airbyte_utils.bank_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.bank_config_scd"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`bank_config_scd__dbt_tmp`
2022-06-20 16:22:48 normalization >   partition by range_bucket(
2022-06-20 16:22:48 normalization >             _airbyte_active_row,
2022-06-20 16:22:48 normalization >             generate_array(0, 1, 1)
2022-06-20 16:22:48 normalization >         )
2022-06-20 16:22:48 normalization >   cluster by _airbyte_unique_key_scd, _airbyte_emitted_at
2022-06-20 16:22:48 normalization >   OPTIONS(
2022-06-20 16:22:48 normalization >       expiration_timestamp=TIMESTAMP_ADD(CURRENT_TIMESTAMP(), INTERVAL 12 hour)
2022-06-20 16:22:48 normalization >     )
2022-06-20 16:22:48 normalization >   as (
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > -- depends_on: ref('bank_config_stg')
2022-06-20 16:22:48 normalization > with
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > new_data as (
2022-06-20 16:22:48 normalization >     -- retrieve incremental "new" data
2022-06-20 16:22:48 normalization >     select
2022-06-20 16:22:48 normalization >         *
2022-06-20 16:22:48 normalization >     from `mainapi-282501`._airbyte_raw_checkmate.`bank_config_stg`
2022-06-20 16:22:48 normalization >     -- bank_config from `mainapi-282501`.raw_checkmate._airbyte_raw_bank_config
2022-06-20 16:22:48 normalization >     where 1 = 1
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > and coalesce(
2022-06-20 16:22:48 normalization >     cast(_airbyte_emitted_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) >= (select max(cast(_airbyte_emitted_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > )) from `mainapi-282501`.raw_checkmate.`bank_config_scd`),
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     true)
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 normalization > new_data_ids as (
2022-06-20 16:22:48 normalization >     -- build a subset of _airbyte_unique_key from rows that are new
2022-06-20 16:22:48 normalization >     select distinct
2022-06-20 16:22:48 normalization >         to_hex(md5(cast(concat(coalesce(cast(bank_config_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), '')) as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ))) as _airbyte_unique_key
2022-06-20 16:22:48 normalization >     from new_data
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 normalization > empty_new_data as (
2022-06-20 16:22:48 normalization >     -- build an empty table to only keep the table's column types
2022-06-20 16:22:48 normalization >     select * from new_data where 1 = 0
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 normalization > previous_active_scd_data as (
2022-06-20 16:22:48 normalization >     -- retrieve "incomplete old" data that needs to be updated with an end date because of new changes
2022-06-20 16:22:48 normalization >     select
2022-06-20 16:22:48 normalization >         this_data.`_airbyte_bank_config_hashid`,
2022-06-20 16:22:48 normalization >   this_data.`name`,
2022-06-20 16:22:48 normalization >   this_data.`bank_id`,
2022-06-20 16:22:48 normalization >   this_data.`_ab_cdc_lsn`,
2022-06-20 16:22:48 normalization >   this_data.`timestamp_ch`,
2022-06-20 16:22:48 normalization >   this_data.`timestamp_cr`,
2022-06-20 16:22:48 normalization >   this_data.`hold_duration`,
2022-06-20 16:22:48 normalization >   this_data.`bank_config_id`,
2022-06-20 16:22:48 normalization >   this_data.`vendor_bank_id`,
2022-06-20 16:22:48 normalization >   this_data.`_ab_cdc_deleted_at`,
2022-06-20 16:22:48 normalization >   this_data.`_ab_cdc_updated_at`,
2022-06-20 16:22:48 normalization >   this_data.`inbound_upload_path`,
2022-06-20 16:22:48 normalization >   this_data.`outbound_upload_path`,
2022-06-20 16:22:48 normalization >   this_data.`hold_amount_percentage`,
2022-06-20 16:22:48 normalization >   this_data.`_airbyte_ab_id`,
2022-06-20 16:22:48 normalization >   this_data.`_airbyte_emitted_at`,
2022-06-20 16:22:48 normalization >   this_data.`_airbyte_normalized_at`
2022-06-20 16:22:48 normalization >     from `mainapi-282501`.raw_checkmate.`bank_config_scd` as this_data
2022-06-20 16:22:48 normalization >     -- make a join with new_data using primary key to filter active data that need to be updated only
2022-06-20 16:22:48 normalization >     join new_data_ids on this_data._airbyte_unique_key = new_data_ids._airbyte_unique_key
2022-06-20 16:22:48 normalization >     -- force left join to NULL values (we just need to transfer column types only for the star_intersect macro on schema changes)
2022-06-20 16:22:48 normalization >     left join empty_new_data as inc_data on this_data._airbyte_ab_id = inc_data._airbyte_ab_id
2022-06-20 16:22:48 normalization >     where _airbyte_active_row = 1
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 normalization > input_data as (
2022-06-20 16:22:48 normalization >     select `_airbyte_bank_config_hashid`,
2022-06-20 16:22:48 normalization >   `name`,
2022-06-20 16:22:48 normalization >   `bank_id`,
2022-06-20 16:22:48 normalization >   `_ab_cdc_lsn`,
2022-06-20 16:22:48 normalization >   `timestamp_ch`,
2022-06-20 16:22:48 normalization >   `timestamp_cr`,
2022-06-20 16:22:48 normalization >   `hold_duration`,
2022-06-20 16:22:48 normalization >   `bank_config_id`,
2022-06-20 16:22:48 normalization >   `vendor_bank_id`,
2022-06-20 16:22:48 normalization >   `_ab_cdc_deleted_at`,
2022-06-20 16:22:48 normalization >   `_ab_cdc_updated_at`,
2022-06-20 16:22:48 normalization >   `inbound_upload_path`,
2022-06-20 16:22:48 normalization >   `outbound_upload_path`,
2022-06-20 16:22:48 normalization >   `hold_amount_percentage`,
2022-06-20 16:22:48 normalization >   `_airbyte_ab_id`,
2022-06-20 16:22:48 normalization >   `_airbyte_emitted_at`,
2022-06-20 16:22:48 normalization >   `_airbyte_normalized_at` from new_data
2022-06-20 16:22:48 normalization >     union all
2022-06-20 16:22:48 normalization >     select `_airbyte_bank_config_hashid`,
2022-06-20 16:22:48 normalization >   `name`,
2022-06-20 16:22:48 normalization >   `bank_id`,
2022-06-20 16:22:48 normalization >   `_ab_cdc_lsn`,
2022-06-20 16:22:48 normalization >   `timestamp_ch`,
2022-06-20 16:22:48 normalization >   `timestamp_cr`,
2022-06-20 16:22:48 normalization >   `hold_duration`,
2022-06-20 16:22:48 normalization >   `bank_config_id`,
2022-06-20 16:22:48 normalization >   `vendor_bank_id`,
2022-06-20 16:22:48 normalization >   `_ab_cdc_deleted_at`,
2022-06-20 16:22:48 normalization >   `_ab_cdc_updated_at`,
2022-06-20 16:22:48 normalization >   `inbound_upload_path`,
2022-06-20 16:22:48 normalization >   `outbound_upload_path`,
2022-06-20 16:22:48 normalization >   `hold_amount_percentage`,
2022-06-20 16:22:48 normalization >   `_airbyte_ab_id`,
2022-06-20 16:22:48 normalization >   `_airbyte_emitted_at`,
2022-06-20 16:22:48 normalization >   `_airbyte_normalized_at` from previous_active_scd_data
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > scd_data as (
2022-06-20 16:22:48 normalization >     -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key
2022-06-20 16:22:48 normalization >     select
2022-06-20 16:22:48 normalization >       to_hex(md5(cast(concat(coalesce(cast(bank_config_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), '')) as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ))) as _airbyte_unique_key,
2022-06-20 16:22:48 normalization >       name,
2022-06-20 16:22:48 normalization >       bank_id,
2022-06-20 16:22:48 normalization >       _ab_cdc_lsn,
2022-06-20 16:22:48 normalization >       timestamp_ch,
2022-06-20 16:22:48 normalization >       timestamp_cr,
2022-06-20 16:22:48 normalization >       hold_duration,
2022-06-20 16:22:48 normalization >       bank_config_id,
2022-06-20 16:22:48 normalization >       vendor_bank_id,
2022-06-20 16:22:48 normalization >       _ab_cdc_deleted_at,
2022-06-20 16:22:48 normalization >       _ab_cdc_updated_at,
2022-06-20 16:22:48 normalization >       inbound_upload_path,
2022-06-20 16:22:48 normalization >       outbound_upload_path,
2022-06-20 16:22:48 normalization >       hold_amount_percentage,
2022-06-20 16:22:48 normalization >       timestamp_ch as _airbyte_start_at,
2022-06-20 16:22:48 normalization >       lag(timestamp_ch) over (
2022-06-20 16:22:48 normalization >         partition by bank_config_id
2022-06-20 16:22:48 normalization >         order by
2022-06-20 16:22:48 normalization >             timestamp_ch is null asc,
2022-06-20 16:22:48 normalization >             timestamp_ch desc,
2022-06-20 16:22:48 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:22:48 normalization >             _airbyte_emitted_at desc
2022-06-20 16:22:48 normalization >       ) as _airbyte_end_at,
2022-06-20 16:22:48 normalization >       case when row_number() over (
2022-06-20 16:22:48 normalization >         partition by bank_config_id
2022-06-20 16:22:48 normalization >         order by
2022-06-20 16:22:48 normalization >             timestamp_ch is null asc,
2022-06-20 16:22:48 normalization >             timestamp_ch desc,
2022-06-20 16:22:48 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:22:48 normalization >             _airbyte_emitted_at desc
2022-06-20 16:22:48 normalization >       ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row,
2022-06-20 16:22:48 normalization >       _airbyte_ab_id,
2022-06-20 16:22:48 normalization >       _airbyte_emitted_at,
2022-06-20 16:22:48 normalization >       _airbyte_bank_config_hashid
2022-06-20 16:22:48 normalization >     from input_data
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 normalization > dedup_data as (
2022-06-20 16:22:48 normalization >     select
2022-06-20 16:22:48 normalization >         -- we need to ensure de-duplicated rows for merge/update queries
2022-06-20 16:22:48 normalization >         -- additionally, we generate a unique key for the scd table
2022-06-20 16:22:48 normalization >         row_number() over (
2022-06-20 16:22:48 normalization >             partition by
2022-06-20 16:22:48 normalization >                 _airbyte_unique_key,
2022-06-20 16:22:48 normalization >                 _airbyte_start_at,
2022-06-20 16:22:48 normalization >                 _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), cast(_ab_cdc_updated_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > )
2022-06-20 16:22:48 normalization >             order by _airbyte_active_row desc, _airbyte_ab_id
2022-06-20 16:22:48 normalization >         ) as _airbyte_row_num,
2022-06-20 16:22:48 normalization >         to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), '')) as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ))) as _airbyte_unique_key_scd,
2022-06-20 16:22:48 normalization >         scd_data.*
2022-06-20 16:22:48 normalization >     from scd_data
2022-06-20 16:22:48 normalization > )
2022-06-20 16:22:48 normalization > select
2022-06-20 16:22:48 normalization >     _airbyte_unique_key,
2022-06-20 16:22:48 normalization >     _airbyte_unique_key_scd,
2022-06-20 16:22:48 normalization >     name,
2022-06-20 16:22:48 normalization >     bank_id,
2022-06-20 16:22:48 normalization >     _ab_cdc_lsn,
2022-06-20 16:22:48 normalization >     timestamp_ch,
2022-06-20 16:22:48 normalization >     timestamp_cr,
2022-06-20 16:22:48 normalization >     hold_duration,
2022-06-20 16:22:48 normalization >     bank_config_id,
2022-06-20 16:22:48 normalization >     vendor_bank_id,
2022-06-20 16:22:48 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:22:48 normalization >     _ab_cdc_updated_at,
2022-06-20 16:22:48 normalization >     inbound_upload_path,
2022-06-20 16:22:48 normalization >     outbound_upload_path,
2022-06-20 16:22:48 normalization >     hold_amount_percentage,
2022-06-20 16:22:48 normalization >     _airbyte_start_at,
2022-06-20 16:22:48 normalization >     _airbyte_end_at,
2022-06-20 16:22:48 normalization >     _airbyte_active_row,
2022-06-20 16:22:48 normalization >     _airbyte_ab_id,
2022-06-20 16:22:48 normalization >     _airbyte_emitted_at,
2022-06-20 16:22:48 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:22:48 normalization >     _airbyte_bank_config_hashid
2022-06-20 16:22:48 normalization > from dedup_data where _airbyte_row_num = 1
2022-06-20 16:22:48 normalization >   );
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 16:22:23.693164 [debug] [Thread-8  ]: Writing injected SQL for node "model.airbyte_utils.inbound_file_metadata_scd"
2022-06-20 16:22:48 normalization > 16:22:23.695356 [debug] [Thread-8  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:23.695783 [debug] [Thread-8  ]: Began executing node model.airbyte_utils.inbound_file_metadata_scd
2022-06-20 16:22:48 normalization > 16:22:23.733939 [debug] [Thread-7  ]: On model.airbyte_utils.vendor_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.vendor_config_scd"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`vendor_config_scd__dbt_tmp`
2022-06-20 16:22:48 normalization >   partition by range_bucket(
2022-06-20 16:22:48 normalization >             _airbyte_active_row,
2022-06-20 16:22:48 normalization >             generate_array(0, 1, 1)
2022-06-20 16:22:48 normalization >         )
2022-06-20 16:22:48 normalization >   cluster by _airbyte_unique_key_scd, _airbyte_emitted_at
2022-06-20 16:22:48 normalization >   OPTIONS(
2022-06-20 16:22:48 normalization >       expiration_timestamp=TIMESTAMP_ADD(CURRENT_TIMESTAMP(), INTERVAL 12 hour)
2022-06-20 16:22:48 normalization >     )
2022-06-20 16:22:48 normalization >   as (
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > -- depends_on: ref('vendor_config_stg')
2022-06-20 16:22:48 normalization > with
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > new_data as (
2022-06-20 16:22:48 normalization >     -- retrieve incremental "new" data
2022-06-20 16:22:48 normalization >     select
2022-06-20 16:22:48 normalization >         *
2022-06-20 16:22:48 normalization >     from `mainapi-282501`._airbyte_raw_checkmate.`vendor_config_stg`
2022-06-20 16:22:48 normalization >     -- vendor_config from `mainapi-282501`.raw_checkmate._airbyte_raw_vendor_config
2022-06-20 16:22:48 normalization >     where 1 = 1
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > and coalesce(
2022-06-20 16:22:48 normalization >     cast(_airbyte_emitted_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) >= (select max(cast(_airbyte_emitted_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > )) from `mainapi-282501`.raw_checkmate.`vendor_config_scd`),
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     true)
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 normalization > new_data_ids as (
2022-06-20 16:22:48 normalization >     -- build a subset of _airbyte_unique_key from rows that are new
2022-06-20 16:22:48 normalization >     select distinct
2022-06-20 16:22:48 normalization >         to_hex(md5(cast(concat(coalesce(cast(vendor_config_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), '')) as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ))) as _airbyte_unique_key
2022-06-20 16:22:48 normalization >     from new_data
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 normalization > empty_new_data as (
2022-06-20 16:22:48 normalization >     -- build an empty table to only keep the table's column types
2022-06-20 16:22:48 normalization >     select * from new_data where 1 = 0
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 normalization > previous_active_scd_data as (
2022-06-20 16:22:48 normalization >     -- retrieve "incomplete old" data that needs to be updated with an end date because of new changes
2022-06-20 16:22:48 normalization >     select
2022-06-20 16:22:48 normalization >         this_data.`_airbyte_vendor_config_hashid`,
2022-06-20 16:22:48 normalization >   this_data.`name`,
2022-06-20 16:22:48 normalization >   this_data.`_ab_cdc_lsn`,
2022-06-20 16:22:48 normalization >   this_data.`timestamp_ch`,
2022-06-20 16:22:48 normalization >   this_data.`timestamp_cr`,
2022-06-20 16:22:48 normalization >   this_data.`vendor_config_id`,
2022-06-20 16:22:48 normalization >   this_data.`_ab_cdc_deleted_at`,
2022-06-20 16:22:48 normalization >   this_data.`_ab_cdc_updated_at`,
2022-06-20 16:22:48 normalization >   this_data.`inbound_upload_path`,
2022-06-20 16:22:48 normalization >   this_data.`outbound_upload_path`,
2022-06-20 16:22:48 normalization >   this_data.`_airbyte_ab_id`,
2022-06-20 16:22:48 normalization >   this_data.`_airbyte_emitted_at`,
2022-06-20 16:22:48 normalization >   this_data.`_airbyte_normalized_at`
2022-06-20 16:22:48 normalization >     from `mainapi-282501`.raw_checkmate.`vendor_config_scd` as this_data
2022-06-20 16:22:48 normalization >     -- make a join with new_data using primary key to filter active data that need to be updated only
2022-06-20 16:22:48 normalization >     join new_data_ids on this_data._airbyte_unique_key = new_data_ids._airbyte_unique_key
2022-06-20 16:22:48 normalization >     -- force left join to NULL values (we just need to transfer column types only for the star_intersect macro on schema changes)
2022-06-20 16:22:48 normalization >     left join empty_new_data as inc_data on this_data._airbyte_ab_id = inc_data._airbyte_ab_id
2022-06-20 16:22:48 normalization >     where _airbyte_active_row = 1
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 normalization > input_data as (
2022-06-20 16:22:48 normalization >     select `_airbyte_vendor_config_hashid`,
2022-06-20 16:22:48 normalization >   `name`,
2022-06-20 16:22:48 normalization >   `_ab_cdc_lsn`,
2022-06-20 16:22:48 normalization >   `timestamp_ch`,
2022-06-20 16:22:48 normalization >   `timestamp_cr`,
2022-06-20 16:22:48 normalization >   `vendor_config_id`,
2022-06-20 16:22:48 normalization >   `_ab_cdc_deleted_at`,
2022-06-20 16:22:48 normalization >   `_ab_cdc_updated_at`,
2022-06-20 16:22:48 normalization >   `inbound_upload_path`,
2022-06-20 16:22:48 normalization >   `outbound_upload_path`,
2022-06-20 16:22:48 normalization >   `_airbyte_ab_id`,
2022-06-20 16:22:48 normalization >   `_airbyte_emitted_at`,
2022-06-20 16:22:48 normalization >   `_airbyte_normalized_at` from new_data
2022-06-20 16:22:48 normalization >     union all
2022-06-20 16:22:48 normalization >     select `_airbyte_vendor_config_hashid`,
2022-06-20 16:22:48 normalization >   `name`,
2022-06-20 16:22:48 normalization >   `_ab_cdc_lsn`,
2022-06-20 16:22:48 normalization >   `timestamp_ch`,
2022-06-20 16:22:48 normalization >   `timestamp_cr`,
2022-06-20 16:22:48 normalization >   `vendor_config_id`,
2022-06-20 16:22:48 normalization >   `_ab_cdc_deleted_at`,
2022-06-20 16:22:48 normalization >   `_ab_cdc_updated_at`,
2022-06-20 16:22:48 normalization >   `inbound_upload_path`,
2022-06-20 16:22:48 normalization >   `outbound_upload_path`,
2022-06-20 16:22:48 normalization >   `_airbyte_ab_id`,
2022-06-20 16:22:48 normalization >   `_airbyte_emitted_at`,
2022-06-20 16:22:48 normalization >   `_airbyte_normalized_at` from previous_active_scd_data
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > scd_data as (
2022-06-20 16:22:48 normalization >     -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key
2022-06-20 16:22:48 normalization >     select
2022-06-20 16:22:48 normalization >       to_hex(md5(cast(concat(coalesce(cast(vendor_config_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), '')) as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ))) as _airbyte_unique_key,
2022-06-20 16:22:48 normalization >       name,
2022-06-20 16:22:48 normalization >       _ab_cdc_lsn,
2022-06-20 16:22:48 normalization >       timestamp_ch,
2022-06-20 16:22:48 normalization >       timestamp_cr,
2022-06-20 16:22:48 normalization >       vendor_config_id,
2022-06-20 16:22:48 normalization >       _ab_cdc_deleted_at,
2022-06-20 16:22:48 normalization >       _ab_cdc_updated_at,
2022-06-20 16:22:48 normalization >       inbound_upload_path,
2022-06-20 16:22:48 normalization >       outbound_upload_path,
2022-06-20 16:22:48 normalization >       timestamp_ch as _airbyte_start_at,
2022-06-20 16:22:48 normalization >       lag(timestamp_ch) over (
2022-06-20 16:22:48 normalization >         partition by vendor_config_id
2022-06-20 16:22:48 normalization >         order by
2022-06-20 16:22:48 normalization >             timestamp_ch is null asc,
2022-06-20 16:22:48 normalization >             timestamp_ch desc,
2022-06-20 16:22:48 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:22:48 normalization >             _airbyte_emitted_at desc
2022-06-20 16:22:48 normalization >       ) as _airbyte_end_at,
2022-06-20 16:22:48 normalization >       case when row_number() over (
2022-06-20 16:22:48 normalization >         partition by vendor_config_id
2022-06-20 16:22:48 normalization >         order by
2022-06-20 16:22:48 normalization >             timestamp_ch is null asc,
2022-06-20 16:22:48 normalization >             timestamp_ch desc,
2022-06-20 16:22:48 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:22:48 normalization >             _airbyte_emitted_at desc
2022-06-20 16:22:48 normalization >       ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row,
2022-06-20 16:22:48 normalization >       _airbyte_ab_id,
2022-06-20 16:22:48 normalization >       _airbyte_emitted_at,
2022-06-20 16:22:48 normalization >       _airbyte_vendor_config_hashid
2022-06-20 16:22:48 normalization >     from input_data
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 normalization > dedup_data as (
2022-06-20 16:22:48 normalization >     select
2022-06-20 16:22:48 normalization >         -- we need to ensure de-duplicated rows for merge/update queries
2022-06-20 16:22:48 normalization >         -- additionally, we generate a unique key for the scd table
2022-06-20 16:22:48 normalization >         row_number() over (
2022-06-20 16:22:48 normalization >             partition by
2022-06-20 16:22:48 normalization >                 _airbyte_unique_key,
2022-06-20 16:22:48 normalization >                 _airbyte_start_at,
2022-06-20 16:22:48 normalization >                 _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), cast(_ab_cdc_updated_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > )
2022-06-20 16:22:48 normalization >             order by _airbyte_active_row desc, _airbyte_ab_id
2022-06-20 16:22:48 normalization >         ) as _airbyte_row_num,
2022-06-20 16:22:48 normalization >         to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), '')) as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ))) as _airbyte_unique_key_scd,
2022-06-20 16:22:48 normalization >         scd_data.*
2022-06-20 16:22:48 normalization >     from scd_data
2022-06-20 16:22:48 normalization > )
2022-06-20 16:22:48 normalization > select
2022-06-20 16:22:48 normalization >     _airbyte_unique_key,
2022-06-20 16:22:48 normalization >     _airbyte_unique_key_scd,
2022-06-20 16:22:48 normalization >     name,
2022-06-20 16:22:48 normalization >     _ab_cdc_lsn,
2022-06-20 16:22:48 normalization >     timestamp_ch,
2022-06-20 16:22:48 normalization >     timestamp_cr,
2022-06-20 16:22:48 normalization >     vendor_config_id,
2022-06-20 16:22:48 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:22:48 normalization >     _ab_cdc_updated_at,
2022-06-20 16:22:48 normalization >     inbound_upload_path,
2022-06-20 16:22:48 normalization >     outbound_upload_path,
2022-06-20 16:22:48 normalization >     _airbyte_start_at,
2022-06-20 16:22:48 normalization >     _airbyte_end_at,
2022-06-20 16:22:48 normalization >     _airbyte_active_row,
2022-06-20 16:22:48 normalization >     _airbyte_ab_id,
2022-06-20 16:22:48 normalization >     _airbyte_emitted_at,
2022-06-20 16:22:48 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:22:48 normalization >     _airbyte_vendor_config_hashid
2022-06-20 16:22:48 normalization > from dedup_data where _airbyte_row_num = 1
2022-06-20 16:22:48 normalization >   );
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 16:22:23.773195 [debug] [Thread-8  ]: On model.airbyte_utils.inbound_file_metadata_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.inbound_file_metadata_scd"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd__dbt_tmp`
2022-06-20 16:22:48 normalization >   partition by range_bucket(
2022-06-20 16:22:48 normalization >             _airbyte_active_row,
2022-06-20 16:22:48 normalization >             generate_array(0, 1, 1)
2022-06-20 16:22:48 normalization >         )
2022-06-20 16:22:48 normalization >   cluster by _airbyte_unique_key_scd, _airbyte_emitted_at
2022-06-20 16:22:48 normalization >   OPTIONS(
2022-06-20 16:22:48 normalization >       expiration_timestamp=TIMESTAMP_ADD(CURRENT_TIMESTAMP(), INTERVAL 12 hour)
2022-06-20 16:22:48 normalization >     )
2022-06-20 16:22:48 normalization >   as (
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > -- depends_on: ref('inbound_file_metadata_stg')
2022-06-20 16:22:48 normalization > with
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > new_data as (
2022-06-20 16:22:48 normalization >     -- retrieve incremental "new" data
2022-06-20 16:22:48 normalization >     select
2022-06-20 16:22:48 normalization >         *
2022-06-20 16:22:48 normalization >     from `mainapi-282501`._airbyte_raw_checkmate.`inbound_file_metadata_stg`
2022-06-20 16:22:48 normalization >     -- inbound_file_metadata from `mainapi-282501`.raw_checkmate._airbyte_raw_inbound_file_metadata
2022-06-20 16:22:48 normalization >     where 1 = 1
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > and coalesce(
2022-06-20 16:22:48 normalization >     cast(_airbyte_emitted_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) >= (select max(cast(_airbyte_emitted_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > )) from `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd`),
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     true)
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):161 - Completing future exceptionally...
io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:63) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at java.lang.Thread.run(Thread.java:833) [?:?]
Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	... 3 more
	Suppressed: io.airbyte.workers.exception.WorkerException: Normalization process wasn't successful
		at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:162) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:48) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at java.lang.Thread.run(Thread.java:833) [?:?]
2022-06-20 16:22:48 normalization > new_data_ids as (
2022-06-20 16:22:48 normalization >     -- build a subset of _airbyte_unique_key from rows that are new
2022-06-20 16:22:48 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling...
2022-06-20 16:22:48 normalization >     select distinct
2022-06-20 16:22:48 normalization >         to_hex(md5(cast(concat(coalesce(cast(inbound_file_metadata_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), '')) as 
2022-06-20 16:22:48 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):236 - Stopping temporal heartbeating...
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ))) as _airbyte_unique_key
2022-06-20 16:22:48 normalization >     from new_data
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 normalization > empty_new_data as (
2022-06-20 16:22:48 normalization >     -- build an empty table to only keep the table's column types
2022-06-20 16:22:48 normalization >     select * from new_data where 1 = 0
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 normalization > previous_active_scd_data as (
2022-06-20 16:22:48 normalization >     -- retrieve "incomplete old" data that needs to be updated with an end date because of new changes
2022-06-20 16:22:48 normalization >     select
2022-06-20 16:22:48 normalization >         this_data.`_airbyte_inbound_file_metadata_hashid`,
2022-06-20 16:22:48 normalization >   this_data.`file_hash`,
2022-06-20 16:22:48 normalization >   this_data.`file_name`,
2022-06-20 16:22:48 normalization >   this_data.`_ab_cdc_lsn`,
2022-06-20 16:22:48 normalization >   this_data.`timestamp_ch`,
2022-06-20 16:22:48 normalization >   this_data.`timestamp_cr`,
2022-06-20 16:22:48 normalization >   this_data.`_ab_cdc_deleted_at`,
2022-06-20 16:22:48 normalization >   this_data.`_ab_cdc_updated_at`,
2022-06-20 16:22:48 normalization >   this_data.`inbound_file_metadata_id`,
2022-06-20 16:22:48 WARN i.t.i.a.POJOActivityTaskHandler(activityFailureToResult):307 - Activity failure. ActivityId=ca75a437-f787-3625-b63b-2e88475035f0, activityType=Normalize, attempt=1
java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:234) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.normalize(NormalizationActivityImpl.java:75) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at jdk.internal.reflect.GeneratedMethodAccessor419.invoke(Unknown Source) ~[?:?]
	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
	at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?]
	at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?]
	at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?]
	at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?]
	at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?]
	at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?]
	at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
	at java.lang.Thread.run(Thread.java:833) [?:?]
Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:56) ~[temporal-serviceclient-1.8.1.jar:?]
	at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:448) ~[temporal-sdk-1.8.1.jar:?]
	at io.temporal.activity.Activity.wrap(Activity.java:51) ~[temporal-sdk-1.8.1.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:138) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:229) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	... 13 more
Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?]
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:132) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:229) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	... 13 more
Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:63) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	... 1 more
Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	... 1 more
	Suppressed: io.airbyte.workers.exception.WorkerException: Normalization process wasn't successful
		at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:162) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:48) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at java.lang.Thread.run(Thread.java:833) [?:?]
2022-06-20 16:22:48 normalization >   this_data.`_airbyte_ab_id`,
2022-06-20 16:22:48 normalization >   this_data.`_airbyte_emitted_at`,
2022-06-20 16:22:48 normalization >   this_data.`_airbyte_normalized_at`
2022-06-20 16:22:48 normalization >     from `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd` as this_data
2022-06-20 16:22:48 normalization >     -- make a join with new_data using primary key to filter active data that need to be updated only
2022-06-20 16:22:48 normalization >     join new_data_ids on this_data._airbyte_unique_key = new_data_ids._airbyte_unique_key
2022-06-20 16:22:48 normalization >     -- force left join to NULL values (we just need to transfer column types only for the star_intersect macro on schema changes)
2022-06-20 16:22:48 normalization >     left join empty_new_data as inc_data on this_data._airbyte_ab_id = inc_data._airbyte_ab_id
2022-06-20 16:22:48 normalization >     where _airbyte_active_row = 1
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 normalization > input_data as (
2022-06-20 16:22:48 normalization >     select `_airbyte_inbound_file_metadata_hashid`,
2022-06-20 16:22:48 normalization >   `file_hash`,
2022-06-20 16:22:48 normalization >   `file_name`,
2022-06-20 16:22:48 normalization >   `_ab_cdc_lsn`,
2022-06-20 16:22:48 normalization >   `timestamp_ch`,
2022-06-20 16:22:48 normalization >   `timestamp_cr`,
2022-06-20 16:22:48 normalization >   `_ab_cdc_deleted_at`,
2022-06-20 16:22:48 normalization >   `_ab_cdc_updated_at`,
2022-06-20 16:22:48 normalization >   `inbound_file_metadata_id`,
2022-06-20 16:22:48 normalization >   `_airbyte_ab_id`,
2022-06-20 16:22:48 normalization >   `_airbyte_emitted_at`,
2022-06-20 16:22:48 normalization >   `_airbyte_normalized_at` from new_data
2022-06-20 16:22:48 normalization >     union all
2022-06-20 16:22:48 normalization >     select `_airbyte_inbound_file_metadata_hashid`,
2022-06-20 16:22:48 normalization >   `file_hash`,
2022-06-20 16:22:48 normalization >   `file_name`,
2022-06-20 16:22:48 normalization >   `_ab_cdc_lsn`,
2022-06-20 16:22:48 normalization >   `timestamp_ch`,
2022-06-20 16:22:48 normalization >   `timestamp_cr`,
2022-06-20 16:22:48 normalization >   `_ab_cdc_deleted_at`,
2022-06-20 16:22:48 normalization >   `_ab_cdc_updated_at`,
2022-06-20 16:22:48 normalization >   `inbound_file_metadata_id`,
2022-06-20 16:22:48 normalization >   `_airbyte_ab_id`,
2022-06-20 16:22:48 normalization >   `_airbyte_emitted_at`,
2022-06-20 16:22:48 normalization >   `_airbyte_normalized_at` from previous_active_scd_data
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > scd_data as (
2022-06-20 16:22:48 normalization >     -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key
2022-06-20 16:22:48 normalization >     select
2022-06-20 16:22:48 normalization >       to_hex(md5(cast(concat(coalesce(cast(inbound_file_metadata_id as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), '')) as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ))) as _airbyte_unique_key,
2022-06-20 16:22:48 normalization >       file_hash,
2022-06-20 16:22:48 normalization >       file_name,
2022-06-20 16:22:48 normalization >       _ab_cdc_lsn,
2022-06-20 16:22:48 normalization >       timestamp_ch,
2022-06-20 16:22:48 normalization >       timestamp_cr,
2022-06-20 16:22:48 normalization >       _ab_cdc_deleted_at,
2022-06-20 16:22:48 normalization >       _ab_cdc_updated_at,
2022-06-20 16:22:48 normalization >       inbound_file_metadata_id,
2022-06-20 16:22:48 normalization >       timestamp_ch as _airbyte_start_at,
2022-06-20 16:22:48 normalization >       lag(timestamp_ch) over (
2022-06-20 16:22:48 normalization >         partition by inbound_file_metadata_id
2022-06-20 16:22:48 normalization >         order by
2022-06-20 16:22:48 normalization >             timestamp_ch is null asc,
2022-06-20 16:22:48 normalization >             timestamp_ch desc,
2022-06-20 16:22:48 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:22:48 normalization >             _airbyte_emitted_at desc
2022-06-20 16:22:48 normalization >       ) as _airbyte_end_at,
2022-06-20 16:22:48 normalization >       case when row_number() over (
2022-06-20 16:22:48 normalization >         partition by inbound_file_metadata_id
2022-06-20 16:22:48 normalization >         order by
2022-06-20 16:22:48 normalization >             timestamp_ch is null asc,
2022-06-20 16:22:48 normalization >             timestamp_ch desc,
2022-06-20 16:22:48 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:22:48 normalization >             _airbyte_emitted_at desc
2022-06-20 16:22:48 normalization >       ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row,
2022-06-20 16:22:48 normalization >       _airbyte_ab_id,
2022-06-20 16:22:48 normalization >       _airbyte_emitted_at,
2022-06-20 16:22:48 normalization >       _airbyte_inbound_file_metadata_hashid
2022-06-20 16:22:48 normalization >     from input_data
2022-06-20 16:22:48 normalization > ),
2022-06-20 16:22:48 normalization > dedup_data as (
2022-06-20 16:22:48 normalization >     select
2022-06-20 16:22:48 normalization >         -- we need to ensure de-duplicated rows for merge/update queries
2022-06-20 16:22:48 normalization >         -- additionally, we generate a unique key for the scd table
2022-06-20 16:22:48 normalization >         row_number() over (
2022-06-20 16:22:48 normalization >             partition by
2022-06-20 16:22:48 normalization >                 _airbyte_unique_key,
2022-06-20 16:22:48 normalization >                 _airbyte_start_at,
2022-06-20 16:22:48 normalization >                 _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), cast(_ab_cdc_updated_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > )
2022-06-20 16:22:48 normalization >             order by _airbyte_active_row desc, _airbyte_ab_id
2022-06-20 16:22:48 normalization >         ) as _airbyte_row_num,
2022-06-20 16:22:48 normalization >         to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ), '')) as 
2022-06-20 16:22:48 normalization >     string
2022-06-20 16:22:48 normalization > ))) as _airbyte_unique_key_scd,
2022-06-20 16:22:48 normalization >         scd_data.*
2022-06-20 16:22:48 normalization >     from scd_data
2022-06-20 16:22:48 normalization > )
2022-06-20 16:22:48 normalization > select
2022-06-20 16:22:48 normalization >     _airbyte_unique_key,
2022-06-20 16:22:48 normalization >     _airbyte_unique_key_scd,
2022-06-20 16:22:48 normalization >     file_hash,
2022-06-20 16:22:48 normalization >     file_name,
2022-06-20 16:22:48 normalization >     _ab_cdc_lsn,
2022-06-20 16:22:48 normalization >     timestamp_ch,
2022-06-20 16:22:48 normalization >     timestamp_cr,
2022-06-20 16:22:48 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:22:48 normalization >     _ab_cdc_updated_at,
2022-06-20 16:22:48 normalization >     inbound_file_metadata_id,
2022-06-20 16:22:48 normalization >     _airbyte_start_at,
2022-06-20 16:22:48 normalization >     _airbyte_end_at,
2022-06-20 16:22:48 normalization >     _airbyte_active_row,
2022-06-20 16:22:48 normalization >     _airbyte_ab_id,
2022-06-20 16:22:48 normalization >     _airbyte_emitted_at,
2022-06-20 16:22:48 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:22:48 normalization >     _airbyte_inbound_file_metadata_hashid
2022-06-20 16:22:48 normalization > from dedup_data where _airbyte_row_num = 1
2022-06-20 16:22:48 normalization >   );
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 16:22:24.264315 [debug] [Thread-4  ]: BigQuery adapter: Retry attempt 1 of 3 after error: BadRequest('Invalid timestamp string "0000-12-30T00:00:00Z"')
2022-06-20 16:22:48 normalization > 16:22:25.533739 [debug] [Thread-4  ]: BigQuery adapter: Retry attempt 2 of 3 after error: BadRequest('Invalid timestamp string "0000-12-30T00:00:00Z"')
2022-06-20 16:22:48 normalization > 16:22:27.374820 [debug] [Thread-4  ]: BigQuery adapter: Retry attempt 3 of 3 after error: BadRequest('Invalid timestamp string "0000-12-30T00:00:00Z"')
2022-06-20 16:22:48 normalization > 16:22:27.897069 [debug] [Thread-8  ]: 
2022-06-20 16:22:48 normalization >     In `mainapi-282501`.`raw_checkmate`.`inbound_file_metadata_scd`:
2022-06-20 16:22:48 normalization >         Schema changed: False
2022-06-20 16:22:48 normalization >         Source columns not in target: []
2022-06-20 16:22:48 normalization >         Target columns not in source: []
2022-06-20 16:22:48 normalization >         New column types: []
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 16:22:27.927321 [debug] [Thread-8  ]: Writing runtime SQL for node "model.airbyte_utils.inbound_file_metadata_scd"
2022-06-20 16:22:48 normalization > 16:22:27.928019 [debug] [Thread-8  ]: On model.airbyte_utils.inbound_file_metadata_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.inbound_file_metadata_scd"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >         
2022-06-20 16:22:48 normalization >         
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     merge into `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd` as DBT_INTERNAL_DEST
2022-06-20 16:22:48 normalization >         using (
2022-06-20 16:22:48 normalization >           select * from `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd__dbt_tmp`
2022-06-20 16:22:48 normalization >         ) as DBT_INTERNAL_SOURCE
2022-06-20 16:22:48 normalization >         on 
2022-06-20 16:22:48 normalization >             DBT_INTERNAL_SOURCE._airbyte_unique_key_scd = DBT_INTERNAL_DEST._airbyte_unique_key_scd
2022-06-20 16:22:48 normalization >         
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     when matched then update set
2022-06-20 16:22:48 normalization >         `_airbyte_unique_key` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key`,`_airbyte_unique_key_scd` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key_scd`,`file_hash` = DBT_INTERNAL_SOURCE.`file_hash`,`file_name` = DBT_INTERNAL_SOURCE.`file_name`,`_ab_cdc_lsn` = DBT_INTERNAL_SOURCE.`_ab_cdc_lsn`,`timestamp_ch` = DBT_INTERNAL_SOURCE.`timestamp_ch`,`timestamp_cr` = DBT_INTERNAL_SOURCE.`timestamp_cr`,`_ab_cdc_deleted_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_deleted_at`,`_ab_cdc_updated_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_updated_at`,`inbound_file_metadata_id` = DBT_INTERNAL_SOURCE.`inbound_file_metadata_id`,`_airbyte_start_at` = DBT_INTERNAL_SOURCE.`_airbyte_start_at`,`_airbyte_end_at` = DBT_INTERNAL_SOURCE.`_airbyte_end_at`,`_airbyte_active_row` = DBT_INTERNAL_SOURCE.`_airbyte_active_row`,`_airbyte_ab_id` = DBT_INTERNAL_SOURCE.`_airbyte_ab_id`,`_airbyte_emitted_at` = DBT_INTERNAL_SOURCE.`_airbyte_emitted_at`,`_airbyte_normalized_at` = DBT_INTERNAL_SOURCE.`_airbyte_normalized_at`,`_airbyte_inbound_file_metadata_hashid` = DBT_INTERNAL_SOURCE.`_airbyte_inbound_file_metadata_hashid`
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     when not matched then insert
2022-06-20 16:22:48 normalization >         (`_airbyte_unique_key`, `_airbyte_unique_key_scd`, `file_hash`, `file_name`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_file_metadata_id`, `_airbyte_start_at`, `_airbyte_end_at`, `_airbyte_active_row`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_inbound_file_metadata_hashid`)
2022-06-20 16:22:48 normalization >     values
2022-06-20 16:22:48 normalization >         (`_airbyte_unique_key`, `_airbyte_unique_key_scd`, `file_hash`, `file_name`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_file_metadata_id`, `_airbyte_start_at`, `_airbyte_end_at`, `_airbyte_active_row`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_inbound_file_metadata_hashid`)
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 16:22:28.310542 [debug] [Thread-1  ]: 
2022-06-20 16:22:48 normalization >     In `mainapi-282501`.`raw_checkmate`.`bank_config_scd`:
2022-06-20 16:22:48 normalization >         Schema changed: False
2022-06-20 16:22:48 normalization >         Source columns not in target: []
2022-06-20 16:22:48 normalization >         Target columns not in source: []
2022-06-20 16:22:48 normalization >         New column types: []
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 16:22:28.312975 [debug] [Thread-1  ]: Writing runtime SQL for node "model.airbyte_utils.bank_config_scd"
2022-06-20 16:22:48 normalization > 16:22:28.313497 [debug] [Thread-1  ]: On model.airbyte_utils.bank_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.bank_config_scd"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >         
2022-06-20 16:22:48 normalization >         
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     merge into `mainapi-282501`.raw_checkmate.`bank_config_scd` as DBT_INTERNAL_DEST
2022-06-20 16:22:48 normalization >         using (
2022-06-20 16:22:48 normalization >           select * from `mainapi-282501`.raw_checkmate.`bank_config_scd__dbt_tmp`
2022-06-20 16:22:48 normalization >         ) as DBT_INTERNAL_SOURCE
2022-06-20 16:22:48 normalization >         on 
2022-06-20 16:22:48 normalization >             DBT_INTERNAL_SOURCE._airbyte_unique_key_scd = DBT_INTERNAL_DEST._airbyte_unique_key_scd
2022-06-20 16:22:48 normalization >         
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     when matched then update set
2022-06-20 16:22:48 normalization >         `_airbyte_unique_key` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key`,`_airbyte_unique_key_scd` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key_scd`,`name` = DBT_INTERNAL_SOURCE.`name`,`bank_id` = DBT_INTERNAL_SOURCE.`bank_id`,`_ab_cdc_lsn` = DBT_INTERNAL_SOURCE.`_ab_cdc_lsn`,`timestamp_ch` = DBT_INTERNAL_SOURCE.`timestamp_ch`,`timestamp_cr` = DBT_INTERNAL_SOURCE.`timestamp_cr`,`hold_duration` = DBT_INTERNAL_SOURCE.`hold_duration`,`bank_config_id` = DBT_INTERNAL_SOURCE.`bank_config_id`,`vendor_bank_id` = DBT_INTERNAL_SOURCE.`vendor_bank_id`,`_ab_cdc_deleted_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_deleted_at`,`_ab_cdc_updated_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_updated_at`,`inbound_upload_path` = DBT_INTERNAL_SOURCE.`inbound_upload_path`,`outbound_upload_path` = DBT_INTERNAL_SOURCE.`outbound_upload_path`,`hold_amount_percentage` = DBT_INTERNAL_SOURCE.`hold_amount_percentage`,`_airbyte_start_at` = DBT_INTERNAL_SOURCE.`_airbyte_start_at`,`_airbyte_end_at` = DBT_INTERNAL_SOURCE.`_airbyte_end_at`,`_airbyte_active_row` = DBT_INTERNAL_SOURCE.`_airbyte_active_row`,`_airbyte_ab_id` = DBT_INTERNAL_SOURCE.`_airbyte_ab_id`,`_airbyte_emitted_at` = DBT_INTERNAL_SOURCE.`_airbyte_emitted_at`,`_airbyte_normalized_at` = DBT_INTERNAL_SOURCE.`_airbyte_normalized_at`,`_airbyte_bank_config_hashid` = DBT_INTERNAL_SOURCE.`_airbyte_bank_config_hashid`
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     when not matched then insert
2022-06-20 16:22:48 normalization >         (`_airbyte_unique_key`, `_airbyte_unique_key_scd`, `name`, `bank_id`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `hold_duration`, `bank_config_id`, `vendor_bank_id`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_upload_path`, `outbound_upload_path`, `hold_amount_percentage`, `_airbyte_start_at`, `_airbyte_end_at`, `_airbyte_active_row`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_bank_config_hashid`)
2022-06-20 16:22:48 normalization >     values
2022-06-20 16:22:48 normalization >         (`_airbyte_unique_key`, `_airbyte_unique_key_scd`, `name`, `bank_id`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `hold_duration`, `bank_config_id`, `vendor_bank_id`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_upload_path`, `outbound_upload_path`, `hold_amount_percentage`, `_airbyte_start_at`, `_airbyte_end_at`, `_airbyte_active_row`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_bank_config_hashid`)
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 16:22:29.175636 [debug] [Thread-7  ]: 
2022-06-20 16:22:48 normalization >     In `mainapi-282501`.`raw_checkmate`.`vendor_config_scd`:
2022-06-20 16:22:48 normalization >         Schema changed: False
2022-06-20 16:22:48 normalization >         Source columns not in target: []
2022-06-20 16:22:48 normalization >         Target columns not in source: []
2022-06-20 16:22:48 normalization >         New column types: []
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 16:22:29.178079 [debug] [Thread-7  ]: Writing runtime SQL for node "model.airbyte_utils.vendor_config_scd"
2022-06-20 16:22:48 normalization > 16:22:29.179067 [debug] [Thread-7  ]: On model.airbyte_utils.vendor_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.vendor_config_scd"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >         
2022-06-20 16:22:48 normalization >         
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     merge into `mainapi-282501`.raw_checkmate.`vendor_config_scd` as DBT_INTERNAL_DEST
2022-06-20 16:22:48 normalization >         using (
2022-06-20 16:22:48 normalization >           select * from `mainapi-282501`.raw_checkmate.`vendor_config_scd__dbt_tmp`
2022-06-20 16:22:48 normalization >         ) as DBT_INTERNAL_SOURCE
2022-06-20 16:22:48 normalization >         on 
2022-06-20 16:22:48 normalization >             DBT_INTERNAL_SOURCE._airbyte_unique_key_scd = DBT_INTERNAL_DEST._airbyte_unique_key_scd
2022-06-20 16:22:48 normalization >         
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     when matched then update set
2022-06-20 16:22:48 normalization >         `_airbyte_unique_key` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key`,`_airbyte_unique_key_scd` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key_scd`,`name` = DBT_INTERNAL_SOURCE.`name`,`_ab_cdc_lsn` = DBT_INTERNAL_SOURCE.`_ab_cdc_lsn`,`timestamp_ch` = DBT_INTERNAL_SOURCE.`timestamp_ch`,`timestamp_cr` = DBT_INTERNAL_SOURCE.`timestamp_cr`,`vendor_config_id` = DBT_INTERNAL_SOURCE.`vendor_config_id`,`_ab_cdc_deleted_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_deleted_at`,`_ab_cdc_updated_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_updated_at`,`inbound_upload_path` = DBT_INTERNAL_SOURCE.`inbound_upload_path`,`outbound_upload_path` = DBT_INTERNAL_SOURCE.`outbound_upload_path`,`_airbyte_start_at` = DBT_INTERNAL_SOURCE.`_airbyte_start_at`,`_airbyte_end_at` = DBT_INTERNAL_SOURCE.`_airbyte_end_at`,`_airbyte_active_row` = DBT_INTERNAL_SOURCE.`_airbyte_active_row`,`_airbyte_ab_id` = DBT_INTERNAL_SOURCE.`_airbyte_ab_id`,`_airbyte_emitted_at` = DBT_INTERNAL_SOURCE.`_airbyte_emitted_at`,`_airbyte_normalized_at` = DBT_INTERNAL_SOURCE.`_airbyte_normalized_at`,`_airbyte_vendor_config_hashid` = DBT_INTERNAL_SOURCE.`_airbyte_vendor_config_hashid`
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     when not matched then insert
2022-06-20 16:22:48 normalization >         (`_airbyte_unique_key`, `_airbyte_unique_key_scd`, `name`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `vendor_config_id`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_upload_path`, `outbound_upload_path`, `_airbyte_start_at`, `_airbyte_end_at`, `_airbyte_active_row`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_vendor_config_hashid`)
2022-06-20 16:22:48 normalization >     values
2022-06-20 16:22:48 normalization >         (`_airbyte_unique_key`, `_airbyte_unique_key_scd`, `name`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `vendor_config_id`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_upload_path`, `outbound_upload_path`, `_airbyte_start_at`, `_airbyte_end_at`, `_airbyte_active_row`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_vendor_config_hashid`)
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 16:22:29.275788 [debug] [Thread-4  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:29.276801 [debug] [Thread-4  ]: Database Error in model deposit_scd (models/generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql)
2022-06-20 16:22:48 normalization >   Invalid timestamp string "0000-12-30T00:00:00Z"
2022-06-20 16:22:48 normalization >   compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql
2022-06-20 16:22:48 normalization > 16:22:29.277389 [error] [Thread-4  ]: 7 of 12 ERROR creating incremental model raw_checkmate.deposit_scd...................................................... [ERROR in 6.44s]
2022-06-20 16:22:48 normalization > 16:22:29.277928 [debug] [Thread-4  ]: Finished running node model.airbyte_utils.deposit_scd
2022-06-20 16:22:48 normalization > 16:22:29.278997 [debug] [Thread-2  ]: Began running node model.airbyte_utils.deposit
2022-06-20 16:22:48 normalization > 16:22:29.279287 [info ] [Thread-2  ]: 9 of 12 SKIP relation raw_checkmate.deposit............................................................................. [SKIP]
2022-06-20 16:22:48 normalization > 16:22:29.279758 [debug] [Thread-2  ]: Finished running node model.airbyte_utils.deposit
2022-06-20 16:22:48 normalization > 16:22:30.961480 [debug] [Thread-8  ]: On model.airbyte_utils.inbound_file_metadata_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.inbound_file_metadata_scd"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >         -- Delete records which are no longer active:
2022-06-20 16:22:48 normalization >                     -- This query is equivalent, but the left join version is more performant:
2022-06-20 16:22:48 normalization >                     -- delete from final_table where unique_key in (
2022-06-20 16:22:48 normalization >                     --     select unique_key from scd_table where 1 = 1 <incremental_clause(normalized_at, final_table)>
2022-06-20 16:22:48 normalization >                     -- ) and unique_key not in (
2022-06-20 16:22:48 normalization >                     --     select unique_key from scd_table where active_row = 1 <incremental_clause(normalized_at, final_table)>
2022-06-20 16:22:48 normalization >                     -- )
2022-06-20 16:22:48 normalization >                     -- We're incremental against normalized_at rather than emitted_at because we need to fetch the SCD
2022-06-20 16:22:48 normalization >                     -- entries that were _updated_ recently. This is because a deleted record will have an SCD record
2022-06-20 16:22:48 normalization >                     -- which was emitted a long time ago, but recently re-normalized to have active_row = 0.
2022-06-20 16:22:48 normalization >                     delete from `mainapi-282501`.`raw_checkmate`.`inbound_file_metadata` final_table where final_table._airbyte_unique_key in (
2022-06-20 16:22:48 normalization >                         select recent_records.unique_key
2022-06-20 16:22:48 normalization >                         from (
2022-06-20 16:22:48 normalization >                                 select distinct _airbyte_unique_key as unique_key
2022-06-20 16:22:48 normalization >                                 from `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd`
2022-06-20 16:22:48 normalization >                                 where 1=1 
2022-06-20 16:22:48 normalization > and coalesce(
2022-06-20 16:22:48 normalization >     cast(_airbyte_normalized_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) >= (select max(cast(_airbyte_normalized_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > )) from raw_checkmate.`inbound_file_metadata`),
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     true)
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >                             ) recent_records
2022-06-20 16:22:48 normalization >                             left join (
2022-06-20 16:22:48 normalization >                                 select _airbyte_unique_key as unique_key, count(_airbyte_unique_key) as active_count
2022-06-20 16:22:48 normalization >                                 from `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd`
2022-06-20 16:22:48 normalization >                                 where _airbyte_active_row = 1 
2022-06-20 16:22:48 normalization > and coalesce(
2022-06-20 16:22:48 normalization >     cast(_airbyte_normalized_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) >= (select max(cast(_airbyte_normalized_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > )) from raw_checkmate.`inbound_file_metadata`),
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     true)
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >                                 group by _airbyte_unique_key
2022-06-20 16:22:48 normalization >                             ) active_counts
2022-06-20 16:22:48 normalization >                             on recent_records.unique_key = active_counts.unique_key
2022-06-20 16:22:48 normalization >                         where active_count is null or active_count = 0
2022-06-20 16:22:48 normalization >                     )
2022-06-20 16:22:48 normalization >       
2022-06-20 16:22:48 normalization > 16:22:31.109637 [debug] [Thread-1  ]: On model.airbyte_utils.bank_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.bank_config_scd"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >         -- Delete records which are no longer active:
2022-06-20 16:22:48 normalization >                     -- This query is equivalent, but the left join version is more performant:
2022-06-20 16:22:48 normalization >                     -- delete from final_table where unique_key in (
2022-06-20 16:22:48 normalization >                     --     select unique_key from scd_table where 1 = 1 <incremental_clause(normalized_at, final_table)>
2022-06-20 16:22:48 normalization >                     -- ) and unique_key not in (
2022-06-20 16:22:48 normalization >                     --     select unique_key from scd_table where active_row = 1 <incremental_clause(normalized_at, final_table)>
2022-06-20 16:22:48 normalization >                     -- )
2022-06-20 16:22:48 normalization >                     -- We're incremental against normalized_at rather than emitted_at because we need to fetch the SCD
2022-06-20 16:22:48 normalization >                     -- entries that were _updated_ recently. This is because a deleted record will have an SCD record
2022-06-20 16:22:48 normalization >                     -- which was emitted a long time ago, but recently re-normalized to have active_row = 0.
2022-06-20 16:22:48 normalization >                     delete from `mainapi-282501`.`raw_checkmate`.`bank_config` final_table where final_table._airbyte_unique_key in (
2022-06-20 16:22:48 normalization >                         select recent_records.unique_key
2022-06-20 16:22:48 normalization >                         from (
2022-06-20 16:22:48 normalization >                                 select distinct _airbyte_unique_key as unique_key
2022-06-20 16:22:48 normalization >                                 from `mainapi-282501`.raw_checkmate.`bank_config_scd`
2022-06-20 16:22:48 normalization >                                 where 1=1 
2022-06-20 16:22:48 normalization > and coalesce(
2022-06-20 16:22:48 normalization >     cast(_airbyte_normalized_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) >= (select max(cast(_airbyte_normalized_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > )) from raw_checkmate.`bank_config`),
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     true)
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >                             ) recent_records
2022-06-20 16:22:48 normalization >                             left join (
2022-06-20 16:22:48 normalization >                                 select _airbyte_unique_key as unique_key, count(_airbyte_unique_key) as active_count
2022-06-20 16:22:48 normalization >                                 from `mainapi-282501`.raw_checkmate.`bank_config_scd`
2022-06-20 16:22:48 normalization >                                 where _airbyte_active_row = 1 
2022-06-20 16:22:48 normalization > and coalesce(
2022-06-20 16:22:48 normalization >     cast(_airbyte_normalized_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) >= (select max(cast(_airbyte_normalized_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > )) from raw_checkmate.`bank_config`),
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     true)
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >                                 group by _airbyte_unique_key
2022-06-20 16:22:48 normalization >                             ) active_counts
2022-06-20 16:22:48 normalization >                             on recent_records.unique_key = active_counts.unique_key
2022-06-20 16:22:48 normalization >                         where active_count is null or active_count = 0
2022-06-20 16:22:48 normalization >                     )
2022-06-20 16:22:48 normalization >       
2022-06-20 16:22:48 normalization > 16:22:32.876000 [debug] [Thread-7  ]: On model.airbyte_utils.vendor_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.vendor_config_scd"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >         -- Delete records which are no longer active:
2022-06-20 16:22:48 normalization >                     -- This query is equivalent, but the left join version is more performant:
2022-06-20 16:22:48 normalization >                     -- delete from final_table where unique_key in (
2022-06-20 16:22:48 normalization >                     --     select unique_key from scd_table where 1 = 1 <incremental_clause(normalized_at, final_table)>
2022-06-20 16:22:48 normalization >                     -- ) and unique_key not in (
2022-06-20 16:22:48 normalization >                     --     select unique_key from scd_table where active_row = 1 <incremental_clause(normalized_at, final_table)>
2022-06-20 16:22:48 normalization >                     -- )
2022-06-20 16:22:48 normalization >                     -- We're incremental against normalized_at rather than emitted_at because we need to fetch the SCD
2022-06-20 16:22:48 normalization >                     -- entries that were _updated_ recently. This is because a deleted record will have an SCD record
2022-06-20 16:22:48 normalization >                     -- which was emitted a long time ago, but recently re-normalized to have active_row = 0.
2022-06-20 16:22:48 normalization >                     delete from `mainapi-282501`.`raw_checkmate`.`vendor_config` final_table where final_table._airbyte_unique_key in (
2022-06-20 16:22:48 normalization >                         select recent_records.unique_key
2022-06-20 16:22:48 normalization >                         from (
2022-06-20 16:22:48 normalization >                                 select distinct _airbyte_unique_key as unique_key
2022-06-20 16:22:48 normalization >                                 from `mainapi-282501`.raw_checkmate.`vendor_config_scd`
2022-06-20 16:22:48 normalization >                                 where 1=1 
2022-06-20 16:22:48 normalization > and coalesce(
2022-06-20 16:22:48 normalization >     cast(_airbyte_normalized_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) >= (select max(cast(_airbyte_normalized_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > )) from raw_checkmate.`vendor_config`),
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     true)
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >                             ) recent_records
2022-06-20 16:22:48 normalization >                             left join (
2022-06-20 16:22:48 normalization >                                 select _airbyte_unique_key as unique_key, count(_airbyte_unique_key) as active_count
2022-06-20 16:22:48 normalization >                                 from `mainapi-282501`.raw_checkmate.`vendor_config_scd`
2022-06-20 16:22:48 normalization >                                 where _airbyte_active_row = 1 
2022-06-20 16:22:48 normalization > and coalesce(
2022-06-20 16:22:48 normalization >     cast(_airbyte_normalized_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) >= (select max(cast(_airbyte_normalized_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > )) from raw_checkmate.`vendor_config`),
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     true)
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >                                 group by _airbyte_unique_key
2022-06-20 16:22:48 normalization >                             ) active_counts
2022-06-20 16:22:48 normalization >                             on recent_records.unique_key = active_counts.unique_key
2022-06-20 16:22:48 normalization >                         where active_count is null or active_count = 0
2022-06-20 16:22:48 normalization >                     )
2022-06-20 16:22:48 normalization >       
2022-06-20 16:22:48 normalization > 16:22:34.296321 [debug] [Thread-1  ]: On model.airbyte_utils.bank_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.bank_config_scd"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >         drop view _airbyte_raw_checkmate.bank_config_stg
2022-06-20 16:22:48 normalization >       
2022-06-20 16:22:48 normalization > 16:22:34.691380 [debug] [Thread-8  ]: On model.airbyte_utils.inbound_file_metadata_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.inbound_file_metadata_scd"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >         drop view _airbyte_raw_checkmate.inbound_file_metadata_stg
2022-06-20 16:22:48 normalization >       
2022-06-20 16:22:48 normalization > 16:22:34.897881 [debug] [Thread-1  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:34.899043 [info ] [Thread-1  ]: 5 of 12 OK created incremental model raw_checkmate.bank_config_scd...................................................... [MERGE (0.0 rows, 0 processed) in 12.10s]
2022-06-20 16:22:48 normalization > 16:22:34.899560 [debug] [Thread-1  ]: Finished running node model.airbyte_utils.bank_config_scd
2022-06-20 16:22:48 normalization > 16:22:34.900671 [debug] [Thread-3  ]: Began running node model.airbyte_utils.bank_config
2022-06-20 16:22:48 normalization > 16:22:34.901092 [info ] [Thread-3  ]: 10 of 12 START incremental model raw_checkmate.bank_config.............................................................. [RUN]
2022-06-20 16:22:48 normalization > 16:22:34.902223 [debug] [Thread-3  ]: Acquiring new bigquery connection "model.airbyte_utils.bank_config"
2022-06-20 16:22:48 normalization > 16:22:34.902440 [debug] [Thread-3  ]: Began compiling node model.airbyte_utils.bank_config
2022-06-20 16:22:48 normalization > 16:22:34.902632 [debug] [Thread-3  ]: Compiling model.airbyte_utils.bank_config
2022-06-20 16:22:48 normalization > 16:22:34.913316 [debug] [Thread-3  ]: Opening a new connection, currently in state closed
2022-06-20 16:22:48 normalization > 16:22:35.045275 [debug] [Thread-3  ]: Writing injected SQL for node "model.airbyte_utils.bank_config"
2022-06-20 16:22:48 normalization > 16:22:35.046092 [debug] [Thread-3  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:35.046381 [debug] [Thread-3  ]: Began executing node model.airbyte_utils.bank_config
2022-06-20 16:22:48 normalization > 16:22:35.153181 [debug] [Thread-3  ]: On model.airbyte_utils.bank_config: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.bank_config"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`bank_config__dbt_tmp`
2022-06-20 16:22:48 normalization >   partition by timestamp_trunc(_airbyte_emitted_at, day)
2022-06-20 16:22:48 normalization >   cluster by _airbyte_unique_key, _airbyte_emitted_at
2022-06-20 16:22:48 normalization >   OPTIONS(
2022-06-20 16:22:48 normalization >       expiration_timestamp=TIMESTAMP_ADD(CURRENT_TIMESTAMP(), INTERVAL 12 hour)
2022-06-20 16:22:48 normalization >     )
2022-06-20 16:22:48 normalization >   as (
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > -- Final base SQL model
2022-06-20 16:22:48 normalization > -- depends_on: `mainapi-282501`.raw_checkmate.`bank_config_scd`
2022-06-20 16:22:48 normalization > select
2022-06-20 16:22:48 normalization >     _airbyte_unique_key,
2022-06-20 16:22:48 normalization >     name,
2022-06-20 16:22:48 normalization >     bank_id,
2022-06-20 16:22:48 normalization >     _ab_cdc_lsn,
2022-06-20 16:22:48 normalization >     timestamp_ch,
2022-06-20 16:22:48 normalization >     timestamp_cr,
2022-06-20 16:22:48 normalization >     hold_duration,
2022-06-20 16:22:48 normalization >     bank_config_id,
2022-06-20 16:22:48 normalization >     vendor_bank_id,
2022-06-20 16:22:48 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:22:48 normalization >     _ab_cdc_updated_at,
2022-06-20 16:22:48 normalization >     inbound_upload_path,
2022-06-20 16:22:48 normalization >     outbound_upload_path,
2022-06-20 16:22:48 normalization >     hold_amount_percentage,
2022-06-20 16:22:48 normalization >     _airbyte_ab_id,
2022-06-20 16:22:48 normalization >     _airbyte_emitted_at,
2022-06-20 16:22:48 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:22:48 normalization >     _airbyte_bank_config_hashid
2022-06-20 16:22:48 normalization > from `mainapi-282501`.raw_checkmate.`bank_config_scd`
2022-06-20 16:22:48 normalization > -- bank_config from `mainapi-282501`.raw_checkmate._airbyte_raw_bank_config
2022-06-20 16:22:48 normalization > where 1 = 1
2022-06-20 16:22:48 normalization > and _airbyte_active_row = 1
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > and coalesce(
2022-06-20 16:22:48 normalization >     cast(_airbyte_emitted_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) >= (select max(cast(_airbyte_emitted_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > )) from `mainapi-282501`.raw_checkmate.`bank_config`),
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     true)
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   );
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 16:22:35.263518 [debug] [Thread-8  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:35.264621 [info ] [Thread-8  ]: 8 of 12 OK created incremental model raw_checkmate.inbound_file_metadata_scd............................................ [MERGE (0.0 rows, 0 processed) in 12.43s]
2022-06-20 16:22:48 normalization > 16:22:35.265126 [debug] [Thread-8  ]: Finished running node model.airbyte_utils.inbound_file_metadata_scd
2022-06-20 16:22:48 normalization > 16:22:35.266096 [debug] [Thread-4  ]: Began running node model.airbyte_utils.inbound_file_metadata
2022-06-20 16:22:48 normalization > 16:22:35.266553 [info ] [Thread-4  ]: 11 of 12 START incremental model raw_checkmate.inbound_file_metadata.................................................... [RUN]
2022-06-20 16:22:48 normalization > 16:22:35.267637 [debug] [Thread-4  ]: Acquiring new bigquery connection "model.airbyte_utils.inbound_file_metadata"
2022-06-20 16:22:48 normalization > 16:22:35.267867 [debug] [Thread-4  ]: Began compiling node model.airbyte_utils.inbound_file_metadata
2022-06-20 16:22:48 normalization > 16:22:35.268062 [debug] [Thread-4  ]: Compiling model.airbyte_utils.inbound_file_metadata
2022-06-20 16:22:48 normalization > 16:22:35.280094 [debug] [Thread-4  ]: Opening a new connection, currently in state closed
2022-06-20 16:22:48 normalization > 16:22:35.376232 [debug] [Thread-4  ]: Writing injected SQL for node "model.airbyte_utils.inbound_file_metadata"
2022-06-20 16:22:48 normalization > 16:22:35.376880 [debug] [Thread-4  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:35.377099 [debug] [Thread-4  ]: Began executing node model.airbyte_utils.inbound_file_metadata
2022-06-20 16:22:48 normalization > 16:22:35.470880 [debug] [Thread-4  ]: On model.airbyte_utils.inbound_file_metadata: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.inbound_file_metadata"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`inbound_file_metadata__dbt_tmp`
2022-06-20 16:22:48 normalization >   partition by timestamp_trunc(_airbyte_emitted_at, day)
2022-06-20 16:22:48 normalization >   cluster by _airbyte_unique_key, _airbyte_emitted_at
2022-06-20 16:22:48 normalization >   OPTIONS(
2022-06-20 16:22:48 normalization >       expiration_timestamp=TIMESTAMP_ADD(CURRENT_TIMESTAMP(), INTERVAL 12 hour)
2022-06-20 16:22:48 normalization >     )
2022-06-20 16:22:48 normalization >   as (
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > -- Final base SQL model
2022-06-20 16:22:48 normalization > -- depends_on: `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd`
2022-06-20 16:22:48 normalization > select
2022-06-20 16:22:48 normalization >     _airbyte_unique_key,
2022-06-20 16:22:48 normalization >     file_hash,
2022-06-20 16:22:48 normalization >     file_name,
2022-06-20 16:22:48 normalization >     _ab_cdc_lsn,
2022-06-20 16:22:48 normalization >     timestamp_ch,
2022-06-20 16:22:48 normalization >     timestamp_cr,
2022-06-20 16:22:48 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:22:48 normalization >     _ab_cdc_updated_at,
2022-06-20 16:22:48 normalization >     inbound_file_metadata_id,
2022-06-20 16:22:48 normalization >     _airbyte_ab_id,
2022-06-20 16:22:48 normalization >     _airbyte_emitted_at,
2022-06-20 16:22:48 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:22:48 normalization >     _airbyte_inbound_file_metadata_hashid
2022-06-20 16:22:48 normalization > from `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd`
2022-06-20 16:22:48 normalization > -- inbound_file_metadata from `mainapi-282501`.raw_checkmate._airbyte_raw_inbound_file_metadata
2022-06-20 16:22:48 normalization > where 1 = 1
2022-06-20 16:22:48 normalization > and _airbyte_active_row = 1
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > and coalesce(
2022-06-20 16:22:48 normalization >     cast(_airbyte_emitted_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) >= (select max(cast(_airbyte_emitted_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > )) from `mainapi-282501`.raw_checkmate.`inbound_file_metadata`),
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     true)
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   );
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 16:22:37.001442 [debug] [Thread-7  ]: On model.airbyte_utils.vendor_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.vendor_config_scd"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >         drop view _airbyte_raw_checkmate.vendor_config_stg
2022-06-20 16:22:48 normalization >       
2022-06-20 16:22:48 normalization > 16:22:37.506083 [debug] [Thread-7  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:37.507245 [info ] [Thread-7  ]: 6 of 12 OK created incremental model raw_checkmate.vendor_config_scd.................................................... [MERGE (2.0 rows, 1004.0 Bytes processed) in 14.71s]
2022-06-20 16:22:48 normalization > 16:22:37.507861 [debug] [Thread-7  ]: Finished running node model.airbyte_utils.vendor_config_scd
2022-06-20 16:22:48 normalization > 16:22:37.509038 [debug] [Thread-2  ]: Began running node model.airbyte_utils.vendor_config
2022-06-20 16:22:48 normalization > 16:22:37.509506 [info ] [Thread-2  ]: 12 of 12 START incremental model raw_checkmate.vendor_config............................................................ [RUN]
2022-06-20 16:22:48 normalization > 16:22:37.510849 [debug] [Thread-2  ]: Acquiring new bigquery connection "model.airbyte_utils.vendor_config"
2022-06-20 16:22:48 normalization > 16:22:37.511114 [debug] [Thread-2  ]: Began compiling node model.airbyte_utils.vendor_config
2022-06-20 16:22:48 normalization > 16:22:37.511315 [debug] [Thread-2  ]: Compiling model.airbyte_utils.vendor_config
2022-06-20 16:22:48 normalization > 16:22:37.522932 [debug] [Thread-2  ]: Opening a new connection, currently in state closed
2022-06-20 16:22:48 normalization > 16:22:37.650280 [debug] [Thread-2  ]: Writing injected SQL for node "model.airbyte_utils.vendor_config"
2022-06-20 16:22:48 normalization > 16:22:37.651057 [debug] [Thread-2  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:37.651293 [debug] [Thread-2  ]: Began executing node model.airbyte_utils.vendor_config
2022-06-20 16:22:48 normalization > 16:22:37.709286 [debug] [Thread-2  ]: On model.airbyte_utils.vendor_config: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.vendor_config"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`vendor_config__dbt_tmp`
2022-06-20 16:22:48 normalization >   partition by timestamp_trunc(_airbyte_emitted_at, day)
2022-06-20 16:22:48 normalization >   cluster by _airbyte_unique_key, _airbyte_emitted_at
2022-06-20 16:22:48 normalization >   OPTIONS(
2022-06-20 16:22:48 normalization >       expiration_timestamp=TIMESTAMP_ADD(CURRENT_TIMESTAMP(), INTERVAL 12 hour)
2022-06-20 16:22:48 normalization >     )
2022-06-20 16:22:48 normalization >   as (
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > -- Final base SQL model
2022-06-20 16:22:48 normalization > -- depends_on: `mainapi-282501`.raw_checkmate.`vendor_config_scd`
2022-06-20 16:22:48 normalization > select
2022-06-20 16:22:48 normalization >     _airbyte_unique_key,
2022-06-20 16:22:48 normalization >     name,
2022-06-20 16:22:48 normalization >     _ab_cdc_lsn,
2022-06-20 16:22:48 normalization >     timestamp_ch,
2022-06-20 16:22:48 normalization >     timestamp_cr,
2022-06-20 16:22:48 normalization >     vendor_config_id,
2022-06-20 16:22:48 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:22:48 normalization >     _ab_cdc_updated_at,
2022-06-20 16:22:48 normalization >     inbound_upload_path,
2022-06-20 16:22:48 normalization >     outbound_upload_path,
2022-06-20 16:22:48 normalization >     _airbyte_ab_id,
2022-06-20 16:22:48 normalization >     _airbyte_emitted_at,
2022-06-20 16:22:48 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:22:48 normalization >     _airbyte_vendor_config_hashid
2022-06-20 16:22:48 normalization > from `mainapi-282501`.raw_checkmate.`vendor_config_scd`
2022-06-20 16:22:48 normalization > -- vendor_config from `mainapi-282501`.raw_checkmate._airbyte_raw_vendor_config
2022-06-20 16:22:48 normalization > where 1 = 1
2022-06-20 16:22:48 normalization > and _airbyte_active_row = 1
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > and coalesce(
2022-06-20 16:22:48 normalization >     cast(_airbyte_emitted_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > ) >= (select max(cast(_airbyte_emitted_at as 
2022-06-20 16:22:48 normalization >     timestamp
2022-06-20 16:22:48 normalization > )) from `mainapi-282501`.raw_checkmate.`vendor_config`),
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     true)
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   );
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 16:22:37.881962 [debug] [Thread-4  ]: 
2022-06-20 16:22:48 normalization >     In `mainapi-282501`.`raw_checkmate`.`inbound_file_metadata`:
2022-06-20 16:22:48 normalization >         Schema changed: False
2022-06-20 16:22:48 normalization >         Source columns not in target: []
2022-06-20 16:22:48 normalization >         Target columns not in source: []
2022-06-20 16:22:48 normalization >         New column types: []
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 16:22:37.884555 [debug] [Thread-4  ]: Writing runtime SQL for node "model.airbyte_utils.inbound_file_metadata"
2022-06-20 16:22:48 normalization > 16:22:37.885178 [debug] [Thread-4  ]: On model.airbyte_utils.inbound_file_metadata: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.inbound_file_metadata"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >         
2022-06-20 16:22:48 normalization >         
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     merge into `mainapi-282501`.raw_checkmate.`inbound_file_metadata` as DBT_INTERNAL_DEST
2022-06-20 16:22:48 normalization >         using (
2022-06-20 16:22:48 normalization >           select * from `mainapi-282501`.raw_checkmate.`inbound_file_metadata__dbt_tmp`
2022-06-20 16:22:48 normalization >         ) as DBT_INTERNAL_SOURCE
2022-06-20 16:22:48 normalization >         on 
2022-06-20 16:22:48 normalization >             DBT_INTERNAL_SOURCE._airbyte_unique_key = DBT_INTERNAL_DEST._airbyte_unique_key
2022-06-20 16:22:48 normalization >         
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     when matched then update set
2022-06-20 16:22:48 normalization >         `_airbyte_unique_key` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key`,`file_hash` = DBT_INTERNAL_SOURCE.`file_hash`,`file_name` = DBT_INTERNAL_SOURCE.`file_name`,`_ab_cdc_lsn` = DBT_INTERNAL_SOURCE.`_ab_cdc_lsn`,`timestamp_ch` = DBT_INTERNAL_SOURCE.`timestamp_ch`,`timestamp_cr` = DBT_INTERNAL_SOURCE.`timestamp_cr`,`_ab_cdc_deleted_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_deleted_at`,`_ab_cdc_updated_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_updated_at`,`inbound_file_metadata_id` = DBT_INTERNAL_SOURCE.`inbound_file_metadata_id`,`_airbyte_ab_id` = DBT_INTERNAL_SOURCE.`_airbyte_ab_id`,`_airbyte_emitted_at` = DBT_INTERNAL_SOURCE.`_airbyte_emitted_at`,`_airbyte_normalized_at` = DBT_INTERNAL_SOURCE.`_airbyte_normalized_at`,`_airbyte_inbound_file_metadata_hashid` = DBT_INTERNAL_SOURCE.`_airbyte_inbound_file_metadata_hashid`
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     when not matched then insert
2022-06-20 16:22:48 normalization >         (`_airbyte_unique_key`, `file_hash`, `file_name`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_file_metadata_id`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_inbound_file_metadata_hashid`)
2022-06-20 16:22:48 normalization >     values
2022-06-20 16:22:48 normalization >         (`_airbyte_unique_key`, `file_hash`, `file_name`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_file_metadata_id`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_inbound_file_metadata_hashid`)
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 16:22:38.113663 [debug] [Thread-3  ]: 
2022-06-20 16:22:48 normalization >     In `mainapi-282501`.`raw_checkmate`.`bank_config`:
2022-06-20 16:22:48 normalization >         Schema changed: False
2022-06-20 16:22:48 normalization >         Source columns not in target: []
2022-06-20 16:22:48 normalization >         Target columns not in source: []
2022-06-20 16:22:48 normalization >         New column types: []
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 16:22:38.118486 [debug] [Thread-3  ]: Writing runtime SQL for node "model.airbyte_utils.bank_config"
2022-06-20 16:22:48 normalization > 16:22:38.118998 [debug] [Thread-3  ]: On model.airbyte_utils.bank_config: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.bank_config"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >         
2022-06-20 16:22:48 normalization >         
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     merge into `mainapi-282501`.raw_checkmate.`bank_config` as DBT_INTERNAL_DEST
2022-06-20 16:22:48 normalization >         using (
2022-06-20 16:22:48 normalization >           select * from `mainapi-282501`.raw_checkmate.`bank_config__dbt_tmp`
2022-06-20 16:22:48 normalization >         ) as DBT_INTERNAL_SOURCE
2022-06-20 16:22:48 normalization >         on 
2022-06-20 16:22:48 normalization >             DBT_INTERNAL_SOURCE._airbyte_unique_key = DBT_INTERNAL_DEST._airbyte_unique_key
2022-06-20 16:22:48 normalization >         
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     when matched then update set
2022-06-20 16:22:48 normalization >         `_airbyte_unique_key` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key`,`name` = DBT_INTERNAL_SOURCE.`name`,`bank_id` = DBT_INTERNAL_SOURCE.`bank_id`,`_ab_cdc_lsn` = DBT_INTERNAL_SOURCE.`_ab_cdc_lsn`,`timestamp_ch` = DBT_INTERNAL_SOURCE.`timestamp_ch`,`timestamp_cr` = DBT_INTERNAL_SOURCE.`timestamp_cr`,`hold_duration` = DBT_INTERNAL_SOURCE.`hold_duration`,`bank_config_id` = DBT_INTERNAL_SOURCE.`bank_config_id`,`vendor_bank_id` = DBT_INTERNAL_SOURCE.`vendor_bank_id`,`_ab_cdc_deleted_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_deleted_at`,`_ab_cdc_updated_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_updated_at`,`inbound_upload_path` = DBT_INTERNAL_SOURCE.`inbound_upload_path`,`outbound_upload_path` = DBT_INTERNAL_SOURCE.`outbound_upload_path`,`hold_amount_percentage` = DBT_INTERNAL_SOURCE.`hold_amount_percentage`,`_airbyte_ab_id` = DBT_INTERNAL_SOURCE.`_airbyte_ab_id`,`_airbyte_emitted_at` = DBT_INTERNAL_SOURCE.`_airbyte_emitted_at`,`_airbyte_normalized_at` = DBT_INTERNAL_SOURCE.`_airbyte_normalized_at`,`_airbyte_bank_config_hashid` = DBT_INTERNAL_SOURCE.`_airbyte_bank_config_hashid`
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     when not matched then insert
2022-06-20 16:22:48 normalization >         (`_airbyte_unique_key`, `name`, `bank_id`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `hold_duration`, `bank_config_id`, `vendor_bank_id`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_upload_path`, `outbound_upload_path`, `hold_amount_percentage`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_bank_config_hashid`)
2022-06-20 16:22:48 normalization >     values
2022-06-20 16:22:48 normalization >         (`_airbyte_unique_key`, `name`, `bank_id`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `hold_duration`, `bank_config_id`, `vendor_bank_id`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_upload_path`, `outbound_upload_path`, `hold_amount_percentage`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_bank_config_hashid`)
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 16:22:40.496881 [debug] [Thread-2  ]: 
2022-06-20 16:22:48 normalization >     In `mainapi-282501`.`raw_checkmate`.`vendor_config`:
2022-06-20 16:22:48 normalization >         Schema changed: False
2022-06-20 16:22:48 normalization >         Source columns not in target: []
2022-06-20 16:22:48 normalization >         Target columns not in source: []
2022-06-20 16:22:48 normalization >         New column types: []
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 16:22:40.499013 [debug] [Thread-2  ]: Writing runtime SQL for node "model.airbyte_utils.vendor_config"
2022-06-20 16:22:48 normalization > 16:22:40.499626 [debug] [Thread-2  ]: On model.airbyte_utils.vendor_config: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.vendor_config"} */
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >         
2022-06-20 16:22:48 normalization >         
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     merge into `mainapi-282501`.raw_checkmate.`vendor_config` as DBT_INTERNAL_DEST
2022-06-20 16:22:48 normalization >         using (
2022-06-20 16:22:48 normalization >           select * from `mainapi-282501`.raw_checkmate.`vendor_config__dbt_tmp`
2022-06-20 16:22:48 normalization >         ) as DBT_INTERNAL_SOURCE
2022-06-20 16:22:48 normalization >         on 
2022-06-20 16:22:48 normalization >             DBT_INTERNAL_SOURCE._airbyte_unique_key = DBT_INTERNAL_DEST._airbyte_unique_key
2022-06-20 16:22:48 normalization >         
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization >     when matched then update set
2022-06-20 16:22:48 normalization >         `_airbyte_unique_key` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key`,`name` = DBT_INTERNAL_SOURCE.`name`,`_ab_cdc_lsn` = DBT_INTERNAL_SOURCE.`_ab_cdc_lsn`,`timestamp_ch` = DBT_INTERNAL_SOURCE.`timestamp_ch`,`timestamp_cr` = DBT_INTERNAL_SOURCE.`timestamp_cr`,`vendor_config_id` = DBT_INTERNAL_SOURCE.`vendor_config_id`,`_ab_cdc_deleted_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_deleted_at`,`_ab_cdc_updated_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_updated_at`,`inbound_upload_path` = DBT_INTERNAL_SOURCE.`inbound_upload_path`,`outbound_upload_path` = DBT_INTERNAL_SOURCE.`outbound_upload_path`,`_airbyte_ab_id` = DBT_INTERNAL_SOURCE.`_airbyte_ab_id`,`_airbyte_emitted_at` = DBT_INTERNAL_SOURCE.`_airbyte_emitted_at`,`_airbyte_normalized_at` = DBT_INTERNAL_SOURCE.`_airbyte_normalized_at`,`_airbyte_vendor_config_hashid` = DBT_INTERNAL_SOURCE.`_airbyte_vendor_config_hashid`
2022-06-20 16:22:48 normalization >     
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >     when not matched then insert
2022-06-20 16:22:48 normalization >         (`_airbyte_unique_key`, `name`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `vendor_config_id`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_upload_path`, `outbound_upload_path`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_vendor_config_hashid`)
2022-06-20 16:22:48 normalization >     values
2022-06-20 16:22:48 normalization >         (`_airbyte_unique_key`, `name`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `vendor_config_id`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_upload_path`, `outbound_upload_path`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_vendor_config_hashid`)
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization > 
2022-06-20 16:22:48 normalization >   
2022-06-20 16:22:48 normalization > 16:22:40.870760 [debug] [Thread-4  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:40.871897 [info ] [Thread-4  ]: 11 of 12 OK created incremental model raw_checkmate.inbound_file_metadata............................................... [MERGE (0.0 rows, 0 processed) in 5.60s]
2022-06-20 16:22:48 normalization > 16:22:40.872510 [debug] [Thread-4  ]: Finished running node model.airbyte_utils.inbound_file_metadata
2022-06-20 16:22:48 normalization > 16:22:41.037590 [debug] [Thread-3  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:41.038765 [info ] [Thread-3  ]: 10 of 12 OK created incremental model raw_checkmate.bank_config......................................................... [MERGE (0.0 rows, 0 processed) in 6.14s]
2022-06-20 16:22:48 normalization > 16:22:41.039362 [debug] [Thread-3  ]: Finished running node model.airbyte_utils.bank_config
2022-06-20 16:22:48 normalization > 16:22:43.698942 [debug] [Thread-2  ]: finished collecting timing info
2022-06-20 16:22:48 normalization > 16:22:43.700079 [info ] [Thread-2  ]: 12 of 12 OK created incremental model raw_checkmate.vendor_config....................................................... [MERGE (1.0 rows, 564.0 Bytes processed) in 6.19s]
2022-06-20 16:22:48 normalization > 16:22:43.700605 [debug] [Thread-2  ]: Finished running node model.airbyte_utils.vendor_config
2022-06-20 16:22:48 normalization > 16:22:43.703835 [debug] [MainThread]: Acquiring new bigquery connection "master"
2022-06-20 16:22:48 normalization > 16:22:43.704702 [info ] [MainThread]: 
2022-06-20 16:22:48 normalization > 16:22:43.705088 [info ] [MainThread]: Finished running 4 view models, 8 incremental models in 23.11s.
2022-06-20 16:22:48 normalization > 16:22:43.705598 [debug] [MainThread]: Connection 'master' was properly closed.
2022-06-20 16:22:48 normalization > 16:22:43.705884 [debug] [MainThread]: Connection 'model.airbyte_utils.vendor_config' was properly closed.
2022-06-20 16:22:48 normalization > 16:22:43.706135 [debug] [MainThread]: Connection 'model.airbyte_utils.bank_config_scd' was properly closed.
2022-06-20 16:22:48 normalization > 16:22:43.706401 [debug] [MainThread]: Connection 'model.airbyte_utils.bank_config' was properly closed.
2022-06-20 16:22:48 normalization > 16:22:43.706558 [debug] [MainThread]: Connection 'model.airbyte_utils.inbound_file_metadata' was properly closed.
2022-06-20 16:22:48 normalization > 16:22:43.706705 [debug] [MainThread]: Connection 'model.airbyte_utils.inbound_file_metadata_stg' was properly closed.
2022-06-20 16:22:48 normalization > 16:22:43.706848 [debug] [MainThread]: Connection 'model.airbyte_utils.inbound_file_metadata_scd' was properly closed.
2022-06-20 16:22:48 normalization > 16:22:43.707010 [debug] [MainThread]: Connection 'model.airbyte_utils.vendor_config_scd' was properly closed.
2022-06-20 16:22:48 normalization > 16:22:43.727607 [info ] [MainThread]: 
2022-06-20 16:22:48 normalization > 16:22:43.728088 [info ] [MainThread]: Completed with 1 error and 0 warnings:
2022-06-20 16:22:48 normalization > 16:22:43.728701 [info ] [MainThread]: 
2022-06-20 16:22:48 normalization > 16:22:43.729171 [error] [MainThread]: Database Error in model deposit_scd (models/generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql)
2022-06-20 16:22:48 normalization > 16:22:43.729719 [error] [MainThread]:   Invalid timestamp string "0000-12-30T00:00:00Z"
2022-06-20 16:22:48 normalization > 16:22:43.730180 [error] [MainThread]:   compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql
2022-06-20 16:22:48 normalization > 16:22:43.730677 [info ] [MainThread]: 
2022-06-20 16:22:48 normalization > 16:22:43.731210 [info ] [MainThread]: Done. PASS=10 WARN=0 ERROR=1 SKIP=1 TOTAL=12
2022-06-20 16:22:49 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.plugin: is not defined in the schema and the schema does not allow additional properties, $.publication: is not defined in the schema and the schema does not allow additional properties, $.replication_slot: is not defined in the schema and the schema does not allow additional properties, $.method: does not have a value in the enumeration [Standard], $.method: must be a constant value Standard
2022-06-20 16:22:49 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.credential: is not defined in the schema and the schema does not allow additional properties, $.part_size_mb: is not defined in the schema and the schema does not allow additional properties, $.gcs_bucket_name: is not defined in the schema and the schema does not allow additional properties, $.gcs_bucket_path: is not defined in the schema and the schema does not allow additional properties, $.keep_files_in_gcs-bucket: is not defined in the schema and the schema does not allow additional properties, $.method: must be a constant value Standard
2022-06-20 16:22:49 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $.credential.hmac_key_access_id: object found, string expected, $.credential.hmac_key_secret: object found, string expected
2022-06-20 16:22:49 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/81417/2/logs.log
2022-06-20 16:22:49 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.19-alpha
2022-06-20 16:22:49 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-postgres:0.4.24 exists...
2022-06-20 16:22:49 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-postgres:0.4.24 was found locally.
2022-06-20 16:22:49 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 81417
2022-06-20 16:22:49 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/81417/2 --log-driver none --name source-postgres-check-81417-2-psyid --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:0.4.24 -e AIRBYTE_VERSION=0.39.19-alpha -e WORKER_JOB_ID=81417 airbyte/source-postgres:0.4.24 check --config source_config.json
2022-06-20 16:22:50 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings.
2022-06-20 16:22:50 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:22:50 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:22:50 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2022-06-20 16:22:50 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-06-20 16:22:51 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:51 INFO i.a.i.s.p.PostgresSource(main):409 - starting source: class io.airbyte.integrations.source.postgres.PostgresSource
2022-06-20 16:22:51 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:51 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json}
2022-06-20 16:22:51 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:51 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2022-06-20 16:22:51 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:51 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK
2022-06-20 16:22:51 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:51 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}
2022-06-20 16:22:51 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:51 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:22:51 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:51 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:22:51 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:51 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:22:51 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:51 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:22:51 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:51 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL
2022-06-20 16:22:51 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:51 INFO c.z.h.HikariDataSource(<init>):80 - HikariPool-1 - Starting...
2022-06-20 16:22:51 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:51 INFO c.z.h.HikariDataSource(<init>):82 - HikariPool-1 - Start completed.
2022-06-20 16:22:52 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:52 INFO i.a.i.s.p.PostgresSource(isCdc):258 - using CDC: true
2022-06-20 16:22:52 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:52 INFO i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):93 - Attempting to get metadata from the database to see if we can connect.
2022-06-20 16:22:52 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:52 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$1):173 - Attempting to find the named replication slot using the query: HikariProxyPreparedStatement@358019805 wrapping SELECT * FROM pg_replication_slots WHERE slot_name = 'airbyte_slot_checkmate' AND plugin = 'wal2json' AND database = 'checkmate'
2022-06-20 16:22:52 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:52 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows
2022-06-20 16:22:52 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:52 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$3):191 - Attempting to find the publication using the query: HikariProxyPreparedStatement@623051334 wrapping SELECT * FROM pg_publication WHERE pubname = 'checkmate_publication'
2022-06-20 16:22:52 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:52 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows
2022-06-20 16:22:52 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:52 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated...
2022-06-20 16:22:52 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:52 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed.
2022-06-20 16:22:52 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling...
2022-06-20 16:22:52 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/81417/2/logs.log
2022-06-20 16:22:52 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.19-alpha
2022-06-20 16:22:52 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.8 exists...
2022-06-20 16:22:52 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.8 was found locally.
2022-06-20 16:22:52 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 81417
2022-06-20 16:22:52 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/81417/2 --log-driver none --name destination-bigquery-check-81417-2-qhhjy --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.8 -e AIRBYTE_VERSION=0.39.19-alpha -e WORKER_JOB_ID=81417 airbyte/destination-bigquery:1.1.8 check --config source_config.json
2022-06-20 16:22:53 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings.
2022-06-20 16:22:53 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:22:53 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:22:53 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:22:53 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2022-06-20 16:22:53 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-06-20 16:22:54 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:54 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json}
2022-06-20 16:22:54 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:54 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2022-06-20 16:22:54 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:54 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK
2022-06-20 16:22:54 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:54 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}
2022-06-20 16:22:54 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:54 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:22:54 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:54 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:22:54 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:54 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:22:54 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:54 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):303 - Selected loading method is set to: GCS
2022-06-20 16:22:56 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:56 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"CSV","flattening":"No flattening","part_size_mb":"5"}
2022-06-20 16:22:56 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:56 INFO i.a.i.d.s.S3Destination(testSingleUpload):81 - Started testing if all required credentials assigned to user for single file uploading
2022-06-20 16:22:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:57 INFO i.a.i.d.s.S3Destination(testSingleUpload):91 - Finished checking for normal upload mode
2022-06-20 16:22:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:57 INFO i.a.i.d.s.S3Destination(testMultipartUpload):95 - Started testing if all required credentials assigned to user for multipart upload
2022-06-20 16:22:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:57 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to synctera-data-staging/airbyte/test_1655742177280 with full ID ABPnzm57rkUMlxF8f_Afgi2zv9c5lWf15As6hNZkTQ0g0utXCyTreY2WG1gsRl24u9YEW6s
2022-06-20 16:22:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:57 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000]
2022-06-20 16:22:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:57 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000]
2022-06-20 16:22:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:57 WARN a.m.s.MultiPartOutputStream(close):160 - [MultipartOutputStream for parts 1 - 10000] is already closed
2022-06-20 16:22:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:57 INFO a.m.s.StreamTransferManager(complete):367 - [Manager uploading to synctera-data-staging/airbyte/test_1655742177280 with id ABPnzm57r...24u9YEW6s]: Uploading leftover stream [Part number 1 containing 3.34 MB]
2022-06-20 16:22:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:57 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to synctera-data-staging/airbyte/test_1655742177280 with id ABPnzm57r...24u9YEW6s]: Finished uploading [Part number 1 containing 3.34 MB]
2022-06-20 16:22:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:58 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to synctera-data-staging/airbyte/test_1655742177280 with id ABPnzm57r...24u9YEW6s]: Completed
2022-06-20 16:22:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-06-20 16:22:58 INFO i.a.i.d.s.S3Destination(testMultipartUpload):119 - Finished verification for multipart upload mode
2022-06-20 16:22:59 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling...
2022-06-20 16:22:59 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/81417/2/logs.log
2022-06-20 16:22:59 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.19-alpha
2022-06-20 16:22:59 INFO i.a.w.g.DefaultReplicationWorker(run):115 - start sync worker. job id: 81417 attempt id: 2
2022-06-20 16:22:59 INFO i.a.w.g.DefaultReplicationWorker(run):127 - configured sync modes: {public.bank_config=incremental - append_dedup, public.deposit=incremental - append_dedup, public.vendor_config=incremental - append_dedup, public.inbound_file_metadata=incremental - append_dedup}
2022-06-20 16:22:59 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination...
2022-06-20 16:22:59 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.8 exists...
2022-06-20 16:22:59 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.8 was found locally.
2022-06-20 16:22:59 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 81417
2022-06-20 16:22:59 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/81417/2 --log-driver none --name destination-bigquery-write-81417-2-aultc --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.8 -e AIRBYTE_VERSION=0.39.19-alpha -e WORKER_JOB_ID=81417 airbyte/destination-bigquery:1.1.8 write --config destination_config.json --catalog destination_catalog.json
2022-06-20 16:22:59 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-postgres:0.4.24 exists...
2022-06-20 16:22:59 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-postgres:0.4.24 was found locally.
2022-06-20 16:22:59 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 81417
2022-06-20 16:22:59 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/81417/2 --log-driver none --name source-postgres-read-81417-2-ngoar --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=airbyte/source-postgres:0.4.24 -e AIRBYTE_VERSION=0.39.19-alpha -e WORKER_JOB_ID=81417 airbyte/source-postgres:0.4.24 read --config source_config.json --catalog source_catalog.json --state input_state.json
2022-06-20 16:22:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):395 - Destination output thread started.
2022-06-20 16:22:59 INFO i.a.w.g.DefaultReplicationWorker(run):169 - Waiting for source and destination threads to complete.
2022-06-20 16:22:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):298 - Replication thread started.
2022-06-20 16:23:00 source > SLF4J: Class path contains multiple SLF4J bindings.
2022-06-20 16:23:00 source > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:23:00 source > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.30.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:23:00 source > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2022-06-20 16:23:00 destination > SLF4J: Class path contains multiple SLF4J bindings.
2022-06-20 16:23:00 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:23:00 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:23:00 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-06-20 16:23:00 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2022-06-20 16:23:00 source > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-06-20 16:23:00 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-06-20 16:23:02 source > 2022-06-20 16:23:02 INFO i.a.i.s.p.PostgresSource(main):409 - starting source: class io.airbyte.integrations.source.postgres.PostgresSource
2022-06-20 16:23:02 destination > 2022-06-20 16:23:02 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2022-06-20 16:23:02 source > 2022-06-20 16:23:02 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {read=null, catalog=source_catalog.json, state=input_state.json, config=source_config.json}
2022-06-20 16:23:02 source > 2022-06-20 16:23:02 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2022-06-20 16:23:02 source > 2022-06-20 16:23:02 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: READ
2022-06-20 16:23:02 destination > 2022-06-20 16:23:02 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2022-06-20 16:23:02 destination > 2022-06-20 16:23:02 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE
2022-06-20 16:23:02 source > 2022-06-20 16:23:02 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='input_state.json'}
2022-06-20 16:23:02 destination > 2022-06-20 16:23:02 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2022-06-20 16:23:02 destination > 2022-06-20 16:23:02 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:23:02 destination > 2022-06-20 16:23:02 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:23:02 destination > 2022-06-20 16:23:02 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:23:02 source > 2022-06-20 16:23:02 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:23:02 source > 2022-06-20 16:23:02 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:23:02 source > 2022-06-20 16:23:02 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:23:02 source > 2022-06-20 16:23:02 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-06-20 16:23:02 destination > 2022-06-20 16:23:02 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):303 - Selected loading method is set to: GCS
2022-06-20 16:23:03 destination > 2022-06-20 16:23:03 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"AVRO","flattening":"No flattening","part_size_mb":"5"}
2022-06-20 16:23:03 destination > 2022-06-20 16:23:03 INFO i.a.i.d.b.BigQueryUtils(isKeepFilesInGcs):319 - All tmp files will be removed from GCS when replication is finished
2022-06-20 16:23:03 source > 2022-06-20 16:23:03 INFO i.a.i.b.s.SshTunnel(getInstance):170 - Starting connection with method: NO_TUNNEL
2022-06-20 16:23:03 source > 2022-06-20 16:23:03 INFO c.z.h.HikariDataSource(<init>):80 - HikariPool-1 - Starting...
2022-06-20 16:23:03 source > 2022-06-20 16:23:03 INFO c.z.h.HikariDataSource(<init>):82 - HikariPool-1 - Start completed.
2022-06-20 16:23:04 destination > 2022-06-20 16:23:04 INFO i.a.i.d.b.BigQueryDestination(getGcsRecordConsumer):289 - Creating BigQuery staging message consumer with staging ID 6b09b80c-cbe3-4447-afee-1cd731139aab at 2022-06-20T16:23:03.350Z
2022-06-20 16:23:04 source > 2022-06-20 16:23:04 INFO i.a.i.s.p.PostgresSource(isCdc):258 - using CDC: true
2022-06-20 16:23:04 source > 2022-06-20 16:23:04 INFO i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):93 - Attempting to get metadata from the database to see if we can connect.
2022-06-20 16:23:04 destination > 2022-06-20 16:23:04 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$createWriteConfigs$1):86 - BigQuery write config: BigQueryWriteConfig[streamName=bank_config, namespace=raw_checkmate, datasetId=raw_checkmate, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_pyv_bank_config}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_bank_config}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]]
2022-06-20 16:23:04 source > 2022-06-20 16:23:04 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$1):173 - Attempting to find the named replication slot using the query: HikariProxyPreparedStatement@1801422599 wrapping SELECT * FROM pg_replication_slots WHERE slot_name = 'airbyte_slot_checkmate' AND plugin = 'wal2json' AND database = 'checkmate'
2022-06-20 16:23:04 source > 2022-06-20 16:23:04 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows
2022-06-20 16:23:04 destination > 2022-06-20 16:23:04 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$createWriteConfigs$1):86 - BigQuery write config: BigQueryWriteConfig[streamName=deposit, namespace=raw_checkmate, datasetId=raw_checkmate, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_nre_deposit}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_deposit}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]]
2022-06-20 16:23:04 destination > 2022-06-20 16:23:04 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$createWriteConfigs$1):86 - BigQuery write config: BigQueryWriteConfig[streamName=inbound_file_metadata, namespace=raw_checkmate, datasetId=raw_checkmate, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_jtj_inbound_file_metadata}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_inbound_file_metadata}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]]
2022-06-20 16:23:04 destination > 2022-06-20 16:23:04 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$createWriteConfigs$1):86 - BigQuery write config: BigQueryWriteConfig[streamName=vendor_config, namespace=raw_checkmate, datasetId=raw_checkmate, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_qis_vendor_config}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_vendor_config}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]]
2022-06-20 16:23:04 source > 2022-06-20 16:23:04 INFO i.a.i.s.p.PostgresSource(lambda$getCheckOperations$3):191 - Attempting to find the publication using the query: HikariProxyPreparedStatement@1769598893 wrapping SELECT * FROM pg_publication WHERE pubname = 'checkmate_publication'
2022-06-20 16:23:04 source > 2022-06-20 16:23:04 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows
2022-06-20 16:23:04 source > 2022-06-20 16:23:04 INFO c.z.h.HikariDataSource(close):350 - HikariPool-1 - Shutdown initiated...
2022-06-20 16:23:04 source > 2022-06-20 16:23:04 INFO c.z.h.HikariDataSource(close):352 - HikariPool-1 - Shutdown completed.
2022-06-20 16:23:04 source > 2022-06-20 16:23:04 INFO i.a.i.s.r.CdcStateManager(<init>):26 - Initialized CDC state with: null
2022-06-20 16:23:04 source > 2022-06-20 16:23:04 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='bank_config', namespace='public'}, New Cursor Field: timestamp_ch. Resetting cursor value
2022-06-20 16:23:04 source > 2022-06-20 16:23:04 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='deposit', namespace='public'}, New Cursor Field: timestamp_ch. Resetting cursor value
2022-06-20 16:23:04 source > 2022-06-20 16:23:04 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='vendor_config', namespace='public'}, New Cursor Field: timestamp_ch. Resetting cursor value
2022-06-20 16:23:04 source > 2022-06-20 16:23:04 INFO i.a.i.s.r.StateManager(createCursorInfoForStream):118 - No cursor field set in catalog but not present in state. Stream: AirbyteStreamNameNamespacePair{name='inbound_file_metadata', namespace='public'}, New Cursor Field: timestamp_ch. Resetting cursor value
2022-06-20 16:23:04 source > 2022-06-20 16:23:04 INFO c.z.h.HikariDataSource(<init>):80 - HikariPool-2 - Starting...
2022-06-20 16:23:04 source > 2022-06-20 16:23:04 INFO c.z.h.HikariDataSource(<init>):82 - HikariPool-2 - Start completed.
2022-06-20 16:23:04 source > 2022-06-20 16:23:04 INFO i.a.i.s.p.PostgresSource(discoverInternal):144 - Checking schema: public
2022-06-20 16:23:04 source > 2022-06-20 16:23:04 INFO i.a.i.s.j.AbstractJdbcSource(discoverInternal):121 - Internal schemas to exclude: [catalog_history, information_schema, pg_catalog, pg_internal]
2022-06-20 16:23:04 destination > 2022-06-20 16:23:04 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started.
2022-06-20 16:23:04 destination > 2022-06-20 16:23:04 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):98 - Preparing tmp tables in destination started for 4 streams
2022-06-20 16:23:04 destination > 2022-06-20 16:23:04 INFO i.a.i.d.b.BigQueryGcsOperations(createSchemaIfNotExists):86 - Creating dataset raw_checkmate
2022-06-20 16:23:04 source > 2022-06-20 16:23:04 INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(initialize):38 - Set initial fetch size: 10 rows
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table schema_migrations column version (type int8[19]) -> JsonSchemaType({type=number})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table schema_migrations column dirty (type bool[1]) -> JsonSchemaType({type=boolean})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column bank_config_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column bank_id (type int2[5]) -> JsonSchemaType({type=number})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column vendor_bank_id (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column name (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column outbound_upload_path (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column inbound_upload_path (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column timestamp_cr (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column timestamp_ch (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column hold_amount_percentage (type int4[10]) -> JsonSchemaType({type=number})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table bank_config column hold_duration (type int4[10]) -> JsonSchemaType({type=number})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table inbound_file_metadata column inbound_file_metadata_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table inbound_file_metadata column file_name (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table inbound_file_metadata column file_hash (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table inbound_file_metadata column timestamp_cr (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table inbound_file_metadata column timestamp_ch (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table vendor_config column vendor_config_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table vendor_config column name (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table vendor_config column outbound_upload_path (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table vendor_config column inbound_upload_path (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table vendor_config column timestamp_cr (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table vendor_config column timestamp_ch (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column deposit_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column bank_id (type int2[5]) -> JsonSchemaType({type=number})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column partner_id (type int2[5]) -> JsonSchemaType({type=number})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column account_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column transaction_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column party_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column party_type (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column account_number (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column ocr_account_number (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column check_number (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column status (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column vendor_reference_id (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column vendor_info (type jsonb[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column amount (type int8[19]) -> JsonSchemaType({type=number})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column check_amount (type int8[19]) -> JsonSchemaType({type=number})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column currency (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column date_captured (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column date_processed (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column timestamp_cr (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column timestamp_ch (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column timestamp_de (type timestamptz[35]) -> JsonSchemaType({type=string, format=date-time, airbyte_type=timestamp_with_timezone})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column front_image_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column back_image_id (type uuid[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.j.AbstractJdbcSource(lambda$discoverInternal$5):143 - Table deposit column micr (type text[2147483647]) -> JsonSchemaType({type=string})
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.p.PostgresSource(discoverInternal):148 - Found table: public.schema_migrations
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.p.PostgresSource(discoverInternal):148 - Found table: public.bank_config
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.p.PostgresSource(discoverInternal):148 - Found table: public.inbound_file_metadata
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.p.PostgresSource(discoverInternal):148 - Found table: public.vendor_config
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.p.PostgresSource(discoverInternal):148 - Found table: public.deposit
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.p.PostgresSource(isCdc):258 - using CDC: true
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.s.p.PostgresCdcTargetPosition(targetPosition):45 - identified target lsn: PgLsn{lsn=360862248624}
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.a.i.d.AirbyteDebeziumHandler(getIncrementalIterators):72 - using CDC: true
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO o.a.k.c.c.AbstractConfig(logAll):354 - EmbeddedConfig values: 
2022-06-20 16:23:05 source > 	access.control.allow.methods = 
2022-06-20 16:23:05 source > 	access.control.allow.origin = 
2022-06-20 16:23:05 source > 	admin.listeners = null
2022-06-20 16:23:05 source > 	bootstrap.servers = [localhost:9092]
2022-06-20 16:23:05 source > 	client.dns.lookup = use_all_dns_ips
2022-06-20 16:23:05 source > 	config.providers = []
2022-06-20 16:23:05 source > 	connector.client.config.override.policy = None
2022-06-20 16:23:05 source > 	header.converter = class org.apache.kafka.connect.storage.SimpleHeaderConverter
2022-06-20 16:23:05 source > 	internal.key.converter = class org.apache.kafka.connect.json.JsonConverter
2022-06-20 16:23:05 source > 	internal.value.converter = class org.apache.kafka.connect.json.JsonConverter
2022-06-20 16:23:05 source > 	key.converter = class org.apache.kafka.connect.json.JsonConverter
2022-06-20 16:23:05 source > 	listeners = null
2022-06-20 16:23:05 source > 	metric.reporters = []
2022-06-20 16:23:05 source > 	metrics.num.samples = 2
2022-06-20 16:23:05 source > 	metrics.recording.level = INFO
2022-06-20 16:23:05 source > 	metrics.sample.window.ms = 30000
2022-06-20 16:23:05 source > 	offset.flush.interval.ms = 1000
2022-06-20 16:23:05 source > 	offset.flush.timeout.ms = 5000
2022-06-20 16:23:05 source > 	offset.storage.file.filename = /tmp/cdc-state-offset12626707906728172980/offset.dat
2022-06-20 16:23:05 source > 	offset.storage.partitions = null
2022-06-20 16:23:05 source > 	offset.storage.replication.factor = null
2022-06-20 16:23:05 source > 	offset.storage.topic = 
2022-06-20 16:23:05 source > 	plugin.path = null
2022-06-20 16:23:05 source > 	response.http.headers.config = 
2022-06-20 16:23:05 source > 	rest.advertised.host.name = null
2022-06-20 16:23:05 source > 	rest.advertised.listener = null
2022-06-20 16:23:05 source > 	rest.advertised.port = null
2022-06-20 16:23:05 source > 	rest.extension.classes = []
2022-06-20 16:23:05 source > 	rest.host.name = null
2022-06-20 16:23:05 source > 	rest.port = 8083
2022-06-20 16:23:05 source > 	ssl.cipher.suites = null
2022-06-20 16:23:05 source > 	ssl.client.auth = none
2022-06-20 16:23:05 source > 	ssl.enabled.protocols = [TLSv1.2, TLSv1.3]
2022-06-20 16:23:05 source > 	ssl.endpoint.identification.algorithm = https
2022-06-20 16:23:05 source > 	ssl.engine.factory.class = null
2022-06-20 16:23:05 source > 	ssl.key.password = null
2022-06-20 16:23:05 source > 	ssl.keymanager.algorithm = SunX509
2022-06-20 16:23:05 source > 	ssl.keystore.location = null
2022-06-20 16:23:05 source > 	ssl.keystore.password = null
2022-06-20 16:23:05 source > 	ssl.keystore.type = JKS
2022-06-20 16:23:05 source > 	ssl.protocol = TLSv1.3
2022-06-20 16:23:05 source > 	ssl.provider = null
2022-06-20 16:23:05 source > 	ssl.secure.random.implementation = null
2022-06-20 16:23:05 source > 	ssl.trustmanager.algorithm = PKIX
2022-06-20 16:23:05 source > 	ssl.truststore.location = null
2022-06-20 16:23:05 source > 	ssl.truststore.password = null
2022-06-20 16:23:05 source > 	ssl.truststore.type = JKS
2022-06-20 16:23:05 source > 	task.shutdown.graceful.timeout.ms = 5000
2022-06-20 16:23:05 source > 	topic.creation.enable = true
2022-06-20 16:23:05 source > 	topic.tracking.allow.reset = true
2022-06-20 16:23:05 source > 	topic.tracking.enable = true
2022-06-20 16:23:05 source > 	value.converter = class org.apache.kafka.connect.json.JsonConverter
2022-06-20 16:23:05 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. 
errors: $: unknown found, object expected
2022-06-20 16:23:05 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN o.a.k.c.r.WorkerConfig(logPluginPathConfigProviderWarning):420 - Variables cannot be used in the 'plugin.path' property, since the property is used by plugin scanning before the config providers that replace the variables are initialized. The raw value 'null' was used for plugin scanning, as opposed to the transformed value 'null', and this may cause unexpected results.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "table.blacklist" is deprecated and will be removed in future versions. Please use "table.exclude.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "table.blacklist" is deprecated and will be removed in future versions. Please use "table.exclude.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.whitelist" is deprecated and will be removed in future versions. Please use "schema.include.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.blacklist" is deprecated and will be removed in future versions. Please use "schema.exclude.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.whitelist" is deprecated and will be removed in future versions. Please use "schema.include.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.blacklist" is deprecated and will be removed in future versions. Please use "schema.exclude.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(start):100 - Starting PostgresConnectorTask with configuration:
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    connector.class = io.debezium.connector.postgresql.PostgresConnector
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    max.queue.size = 8192
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    slot.name = airbyte_slot_checkmate
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    publication.name = checkmate_publication
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    offset.storage.file.filename = /tmp/cdc-state-offset12626707906728172980/offset.dat
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    decimal.handling.mode = string
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    converters = datetime
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    datetime.type = io.airbyte.integrations.debezium.internals.PostgresConverter
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    publication.autocreate.mode = disabled
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.user = airbyte_checkmate
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.dbname = checkmate
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    offset.storage = org.apache.kafka.connect.storage.FileOffsetBackingStore
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.server.name = checkmate
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    plugin.name = wal2json
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.port = 5432
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    offset.flush.interval.ms = 1000
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    key.converter.schemas.enable = false
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.hostname = 10.58.160.3
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.password = ********
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    name = checkmate
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    value.converter.schemas.enable = false
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    max.batch.size = 2048
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    table.include.list = public.bank_config,public.deposit,public.inbound_file_metadata,public.vendor_config
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    snapshot.mode = exported
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 INFO i.d.c.c.BaseSourceTask(lambda$start$0):102 -    database.include.list = checkmate
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.whitelist" is deprecated and will be removed in future versions. Please use "schema.include.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.blacklist" is deprecated and will be removed in future versions. Please use "schema.exclude.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "table.blacklist" is deprecated and will be removed in future versions. Please use "table.exclude.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.blacklist" is deprecated and will be removed in future versions. Please use "schema.exclude.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "table.blacklist" is deprecated and will be removed in future versions. Please use "table.exclude.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.whitelist" is deprecated and will be removed in future versions. Please use "schema.include.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2022-06-20 16:23:05 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:23:06 source > 2022-06-20 16:23:05 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.blacklist" is deprecated and will be removed in future versions. Please use "schema.exclude.list" instead.
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "table.blacklist" is deprecated and will be removed in future versions. Please use "table.exclude.list" instead.
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "schema.whitelist" is deprecated and will be removed in future versions. Please use "schema.include.list" instead.
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.whitelist" is deprecated and will be removed in future versions. Please use "column.include.list" instead.
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 WARN i.d.c.Configuration(lambda$getFallbackStringProperty$34):2135 - Using configuration property "column.blacklist" is deprecated and will be removed in future versions. Please use "column.exclude.list" instead.
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.c.p.PostgresConnectorTask(start):97 - user 'airbyte_checkmate' connected to database 'checkmate' on PostgreSQL 12.10 on x86_64-pc-linux-gnu, compiled by Debian clang version 12.0.1, 64-bit with roles:
2022-06-20 16:23:06 source > 	role 'cloudsqlsuperuser' [superuser: false, replication: false, inherit: true, create role: true, create db: true, can log in: true]
2022-06-20 16:23:06 source > 	role 'pg_read_all_settings' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: false]
2022-06-20 16:23:06 source > 	role 'pg_stat_scan_tables' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: false]
2022-06-20 16:23:06 source > 	role 'airbyte_checkmate' [superuser: false, replication: true, inherit: true, create role: true, create db: true, can log in: true]
2022-06-20 16:23:06 source > 	role 'pg_monitor' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: false]
2022-06-20 16:23:06 source > 	role 'pg_read_all_stats' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: false]
2022-06-20 16:23:06 source > 	role 'pg_signal_backend' [superuser: false, replication: false, inherit: true, create role: false, create db: false, can log in: false]
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.c.p.c.PostgresConnection(readReplicationSlotInfo):204 - Obtained valid replication slot ReplicationSlot [active=false, latestFlushedLsn=LSN{53/E11E84E0}, catalogXmin=19514215]
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.c.p.PostgresConnectorTask(start):106 - No previous offset found
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.c.p.s.ExportedSnapshotter(shouldSnapshot):38 - Taking exported snapshot for new datasource
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.u.Threads(threadFactory):270 - Requested thread factory for connector PostgresConnector, id = checkmate named = change-event-source-coordinator
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.u.Threads$3(newThread):287 - Creating thread debezium-postgresconnector-checkmate-change-event-source-coordinator
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.p.ChangeEventSourceCoordinator(lambda$start$0):91 - Metrics registered
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.p.ChangeEventSourceCoordinator(lambda$start$0):94 - Context created
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.c.p.s.ExportedSnapshotter(shouldSnapshot):38 - Taking exported snapshot for new datasource
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.c.p.PostgresSnapshotChangeEventSource(getSnapshottingTask):69 - According to the connector configuration data will be snapshotted
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):95 - Snapshot step 1 - Preparing
2022-06-20 16:23:06 destination > 2022-06-20 16:23:06 INFO i.a.i.d.b.BigQueryGcsOperations(createTmpTableIfNotExists):94 - Creating tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_qis_vendor_config}}
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):104 - Snapshot step 2 - Determining captured tables
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):111 - Snapshot step 3 - Locking captured tables [public.bank_config, public.deposit, public.inbound_file_metadata, public.vendor_config]
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.c.p.PostgresSnapshotChangeEventSource(lockTablesForSchemaSnapshot):122 - Step 2: skipping locking each table in an exported snapshot
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):117 - Snapshot step 4 - Determining snapshot offset
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.c.p.PostgresOffsetContext(initialContext):235 - Creating initial offset context
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.c.p.PostgresOffsetContext(initialContext):238 - Read xlogStart at 'LSN{54/510EEB0}' from transaction '19622788'
2022-06-20 16:23:06 destination > 2022-06-20 16:23:06 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_qis_vendor_config}}
2022-06-20 16:23:06 destination > 2022-06-20 16:23:06 INFO i.a.i.d.b.BigQueryGcsOperations(createStageIfNotExists):101 - Creating staging path for stream vendor_config (dataset raw_checkmate): airbyte/raw_checkmate_vendor_config/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.c.p.PostgresSnapshotChangeEventSource(updateOffsetForSnapshot):155 - Read xlogStart at 'LSN{54/510EEB0}' from transaction '19622788'
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):120 - Snapshot step 5 - Reading structure of captured tables
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.c.p.PostgresSnapshotChangeEventSource(readTableStructure):198 - Reading structure of schema 'checkmate'
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):124 - Snapshot step 6 - Persisting schema history
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.r.RelationalSnapshotChangeEventSource(doExecute):136 - Snapshot step 7 - Snapshotting data
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):306 - 	 Exporting data from table 'public.bank_config'
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):314 - 	 For table 'public.bank_config' using select statement: 'select * from "public"."bank_config"'
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):356 - 	 Finished exporting 0 records for table 'public.bank_config'; total duration '00:00:00.014'
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):306 - 	 Exporting data from table 'public.deposit'
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):314 - 	 For table 'public.deposit' using select statement: 'select * from "public"."deposit"'
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):356 - 	 Finished exporting 18 records for table 'public.deposit'; total duration '00:00:00.13'
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):306 - 	 Exporting data from table 'public.inbound_file_metadata'
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):314 - 	 For table 'public.inbound_file_metadata' using select statement: 'select * from "public"."inbound_file_metadata"'
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):356 - 	 Finished exporting 0 records for table 'public.inbound_file_metadata'; total duration '00:00:00.003'
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):306 - 	 Exporting data from table 'public.vendor_config'
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):314 - 	 For table 'public.vendor_config' using select statement: 'select * from "public"."vendor_config"'
2022-06-20 16:23:06 destination > 2022-06-20 16:23:06 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):97 - Storage Object synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/ does not exist in bucket; creating...
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.r.RelationalSnapshotChangeEventSource(createDataEventsForTable):356 - 	 Finished exporting 1 records for table 'public.vendor_config'; total duration '00:00:00.013'
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.p.s.AbstractSnapshotChangeEventSource(execute):85 - Snapshot - Final stage
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.p.ChangeEventSourceCoordinator(lambda$start$0):106 - Snapshot ended with SnapshotResult [status=COMPLETED, offset=PostgresOffsetContext [sourceInfoSchema=Schema{io.debezium.connector.postgresql.Source:STRUCT}, sourceInfo=source_info[server='checkmate'db='checkmate', lsn=LSN{54/510EEB0}, txId=19622788, timestamp=2022-06-20T16:23:06.752Z, snapshot=FALSE, schema=public, table=vendor_config], partition={server=checkmate}, lastSnapshotRecord=true, lastCompletelyProcessedLsn=null, lastCommitLsn=null, transactionContext=TransactionContext [currentTransactionId=null, perTableEventCount={}, totalEventCount=0]]]
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.p.m.StreamingChangeEventSourceMetrics(connected):60 - Connected metrics set to 'true'
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.p.ChangeEventSourceCoordinator(streamEvents):139 - Starting streaming
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.c.p.PostgresStreamingChangeEventSource(execute):104 - Retrieved latest position from stored offset 'LSN{54/510EEB0}'
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.c.p.c.WalPositionLocator(<init>):40 - Looking for WAL restart position for last commit LSN 'null' and last change LSN 'LSN{54/510EEB0}'
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.c.p.c.PostgresConnection(readReplicationSlotInfo):204 - Obtained valid replication slot ReplicationSlot [active=false, latestFlushedLsn=LSN{53/E11E84E0}, catalogXmin=19514215]
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.j.JdbcConnection(lambda$doClose$3):945 - Connection gracefully closed
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):116 - REPLICA IDENTITY for 'public.bank_config' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):116 - REPLICA IDENTITY for 'public.deposit' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):116 - REPLICA IDENTITY for 'public.vendor_config' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.c.p.PostgresSchema(printReplicaIdentityInfo):116 - REPLICA IDENTITY for 'public.inbound_file_metadata' is 'DEFAULT'; UPDATE and DELETE events will contain previous values only for PK columns
2022-06-20 16:23:06 source > 2022-06-20 16:23:06 INFO i.d.c.p.PostgresStreamingChangeEventSource(searchWalPosition):268 - Searching for WAL resume position
2022-06-20 16:23:07 destination > 2022-06-20 16:23:07 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):99 - Storage Object synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/ has been created in bucket.
2022-06-20 16:23:07 destination > 2022-06-20 16:23:07 INFO i.a.i.d.b.BigQueryGcsOperations(createTmpTableIfNotExists):94 - Creating tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_jtj_inbound_file_metadata}}
2022-06-20 16:23:07 destination > 2022-06-20 16:23:07 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_jtj_inbound_file_metadata}}
2022-06-20 16:23:07 destination > 2022-06-20 16:23:07 INFO i.a.i.d.b.BigQueryGcsOperations(createStageIfNotExists):101 - Creating staging path for stream inbound_file_metadata (dataset raw_checkmate): airbyte/raw_checkmate_inbound_file_metadata/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/
2022-06-20 16:23:07 source > 2022-06-20 16:23:07 INFO i.d.e.EmbeddedEngine(stop):996 - Stopping the embedded engine
2022-06-20 16:23:07 source > 2022-06-20 16:23:07 INFO i.d.e.EmbeddedEngine(stop):1004 - Waiting for PT5M for connector to stop
2022-06-20 16:23:07 destination > 2022-06-20 16:23:07 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):97 - Storage Object synctera-data-staging/airbyte/raw_checkmate_inbound_file_metadata/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/ does not exist in bucket; creating...
2022-06-20 16:23:07 destination > 2022-06-20 16:23:07 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):99 - Storage Object synctera-data-staging/airbyte/raw_checkmate_inbound_file_metadata/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/ has been created in bucket.
2022-06-20 16:23:07 destination > 2022-06-20 16:23:07 INFO i.a.i.d.b.BigQueryGcsOperations(createTmpTableIfNotExists):94 - Creating tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_nre_deposit}}
2022-06-20 16:23:07 destination > 2022-06-20 16:23:07 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_nre_deposit}}
2022-06-20 16:23:07 destination > 2022-06-20 16:23:07 INFO i.a.i.d.b.BigQueryGcsOperations(createStageIfNotExists):101 - Creating staging path for stream deposit (dataset raw_checkmate): airbyte/raw_checkmate_deposit/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/
2022-06-20 16:23:07 destination > 2022-06-20 16:23:07 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):97 - Storage Object synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/ does not exist in bucket; creating...
2022-06-20 16:23:07 destination > 2022-06-20 16:23:07 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):99 - Storage Object synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/ has been created in bucket.
2022-06-20 16:23:07 destination > 2022-06-20 16:23:07 INFO i.a.i.d.b.BigQueryGcsOperations(createTmpTableIfNotExists):94 - Creating tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_pyv_bank_config}}
2022-06-20 16:23:08 destination > 2022-06-20 16:23:08 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_pyv_bank_config}}
2022-06-20 16:23:08 destination > 2022-06-20 16:23:08 INFO i.a.i.d.b.BigQueryGcsOperations(createStageIfNotExists):101 - Creating staging path for stream bank_config (dataset raw_checkmate): airbyte/raw_checkmate_bank_config/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/
2022-06-20 16:23:08 source > 2022-06-20 16:23:08 INFO i.d.c.c.BaseSourceTask(stop):192 - Stopping down connector
2022-06-20 16:23:08 destination > 2022-06-20 16:23:08 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):97 - Storage Object synctera-data-staging/airbyte/raw_checkmate_bank_config/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/ does not exist in bucket; creating...
2022-06-20 16:23:08 destination > 2022-06-20 16:23:08 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):99 - Storage Object synctera-data-staging/airbyte/raw_checkmate_bank_config/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/ has been created in bucket.
2022-06-20 16:23:08 destination > 2022-06-20 16:23:08 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):107 - Preparing tmp tables in destination completed.
2022-06-20 16:23:08 destination > 2022-06-20 16:23:08 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):55 - Starting a new buffer for stream deposit (current state: 0 bytes in 0 buffers)
2022-06-20 16:23:08 destination > 2022-06-20 16:23:08 INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 - Default schema.
2022-06-20 16:23:08 source > 2022-06-20 16:23:08 INFO i.d.c.p.PostgresStreamingChangeEventSource(searchWalPosition):287 - WAL resume position 'null' discovered
2022-06-20 16:23:08 source > 2022-06-20 16:23:08 INFO i.d.j.JdbcConnection(lambda$doClose$3):945 - Connection gracefully closed
2022-06-20 16:23:08 source > 2022-06-20 16:23:08 INFO i.d.c.p.PostgresStreamingChangeEventSource(processMessages):180 - Processing messages
2022-06-20 16:23:08 source > 2022-06-20 16:23:08 INFO i.d.j.JdbcConnection(lambda$doClose$3):945 - Connection gracefully closed
2022-06-20 16:23:08 source > 2022-06-20 16:23:08 INFO i.d.p.ChangeEventSourceCoordinator(streamEvents):141 - Finished streaming
2022-06-20 16:23:08 source > 2022-06-20 16:23:08 INFO i.d.p.m.StreamingChangeEventSourceMetrics(connected):60 - Connected metrics set to 'false'
2022-06-20 16:23:08 source > 2022-06-20 16:23:08 INFO i.d.j.JdbcConnection(lambda$doClose$3):945 - Connection gracefully closed
2022-06-20 16:23:08 source > 2022-06-20 16:23:08 INFO i.a.i.d.i.DebeziumRecordPublisher(lambda$start$1):85 - Debezium engine shutdown.
2022-06-20 16:23:08 source > 2022-06-20 16:23:08 INFO i.a.i.s.p.PostgresCdcStateHandler(saveState):31 - debezium state: {"{\"schema\":null,\"payload\":[\"checkmate\",{\"server\":\"checkmate\"}]}":"{\"last_snapshot_record\":true,\"lsn\":360862248624,\"txId\":19622788,\"ts_usec\":1655742186752000,\"snapshot\":true}"}
2022-06-20 16:23:08 source > 2022-06-20 16:23:08 INFO i.a.i.s.r.AbstractDbSource(lambda$read$2):130 - Closing database connection pool.
2022-06-20 16:23:08 source > 2022-06-20 16:23:08 INFO c.z.h.HikariDataSource(close):350 - HikariPool-2 - Shutdown initiated...
2022-06-20 16:23:08 source > 2022-06-20 16:23:08 INFO c.z.h.HikariDataSource(close):352 - HikariPool-2 - Shutdown completed.
2022-06-20 16:23:08 source > 2022-06-20 16:23:08 INFO i.a.i.s.r.AbstractDbSource(lambda$read$2):132 - Closed database connection pool.
2022-06-20 16:23:08 source > 2022-06-20 16:23:08 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2022-06-20 16:23:08 source > 2022-06-20 16:23:08 INFO i.a.i.s.p.PostgresSource(main):411 - completed source: class io.airbyte.integrations.source.postgres.PostgresSource
2022-06-20 16:23:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):347 - Source has no more messages, closing connection.
2022-06-20 16:23:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):355 - Total records read: 20 (419 KB)
2022-06-20 16:23:08 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):358 - Schema validation errors found for stream publicdeposit. Error messages: [$.micr is of an incorrect type. Expected it to be string, $.timestamp_de is of an incorrect type. Expected it to be string, $.date_processed is of an incorrect type. Expected it to be date-time, $._ab_cdc_deleted_at is of an incorrect type. Expected it to be string]
2022-06-20 16:23:08 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):358 - Schema validation errors found for stream publicvendor_config. Error messages: [$._ab_cdc_deleted_at is of an incorrect type. Expected it to be string]
2022-06-20 16:23:08 INFO i.a.w.g.DefaultReplicationWorker(run):174 - One of source or destination thread complete. Waiting on the other.
2022-06-20 16:23:08 destination > 2022-06-20 16:23:08 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):55 - Starting a new buffer for stream vendor_config (current state: 419 KB in 1 buffers)
2022-06-20 16:23:08 destination > 2022-06-20 16:23:08 INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 - Default schema.
2022-06-20 16:23:09 destination > 2022-06-20 16:23:09 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded.
2022-06-20 16:23:09 destination > 2022-06-20 16:23:09 INFO i.a.i.d.b.BufferedStreamConsumer(close):170 - executing on success close procedure.
2022-06-20 16:23:09 destination > 2022-06-20 16:23:09 INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):92 - Flushing all 2 current buffers (419 KB in total)
2022-06-20 16:23:09 destination > 2022-06-20 16:23:09 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$flushAll$2):95 - Flushing buffer of stream vendor_config (331 bytes)
2022-06-20 16:23:09 destination > 2022-06-20 16:23:09 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):115 - Flushing buffer for stream vendor_config (331 bytes) to staging
2022-06-20 16:23:09 destination > 2022-06-20 16:23:09 INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 - Finished writing data to 23ffd399-7458-4098-8188-2b4c255bc3252263188665302954589.avro (772 bytes)
2022-06-20 16:23:09 destination > 2022-06-20 16:23:09 INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):108 - Uploading records to staging for stream vendor_config (dataset raw_checkmate): airbyte/raw_checkmate_vendor_config/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/
2022-06-20 16:23:09 destination > 2022-06-20 16:23:09 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro with full ID ABPnzm5XcmkvahVNz5sTiz89_n9iXxrHMs9-okOTYDXUuxADuQdzs3QCPOMFgO0fNQy1760
2022-06-20 16:23:09 destination > 2022-06-20 16:23:09 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000]
2022-06-20 16:23:09 destination > 2022-06-20 16:23:09 INFO a.m.s.StreamTransferManager(complete):367 - [Manager uploading to synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro with id ABPnzm5Xc...0fNQy1760]: Uploading leftover stream [Part number 1 containing 0.00 MB]
2022-06-20 16:23:09 destination > 2022-06-20 16:23:09 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro with id ABPnzm5Xc...0fNQy1760]: Finished uploading [Part number 1 containing 0.00 MB]
2022-06-20 16:23:09 destination > 2022-06-20 16:23:09 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro with id ABPnzm5Xc...0fNQy1760]: Completed
2022-06-20 16:23:09 destination > 2022-06-20 16:23:09 INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):178 - Uploaded buffer file to storage: 23ffd399-7458-4098-8188-2b4c255bc3252263188665302954589.avro -> airbyte/raw_checkmate_vendor_config/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro (filename: 1.avro)
2022-06-20 16:23:09 destination > 2022-06-20 16:23:09 INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):53 - Added staged file: 1.avro
2022-06-20 16:23:09 destination > 2022-06-20 16:23:09 INFO i.a.i.d.r.FileBuffer(deleteFile):81 - Deleting tempFile data 23ffd399-7458-4098-8188-2b4c255bc3252263188665302954589.avro
2022-06-20 16:23:09 destination > 2022-06-20 16:23:09 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$flushAll$2):95 - Flushing buffer of stream deposit (420 KB)
2022-06-20 16:23:09 destination > 2022-06-20 16:23:09 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):115 - Flushing buffer for stream deposit (420 KB) to staging
2022-06-20 16:23:09 destination > 2022-06-20 16:23:09 INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 - Finished writing data to 5f5fe2a3-7b75-4a96-aa0e-17785a45030f15880440188429063389.avro (420 KB)
2022-06-20 16:23:09 destination > 2022-06-20 16:23:09 INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):108 - Uploading records to staging for stream deposit (dataset raw_checkmate): airbyte/raw_checkmate_deposit/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/
2022-06-20 16:23:10 destination > 2022-06-20 16:23:10 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro with full ID ABPnzm7n38dB3ay-9U6JcmgSQxVTJQHEBBiAIxqo4Xurc1W-AuJ4ACj37pIgFJEjnau_tOw
2022-06-20 16:23:10 destination > 2022-06-20 16:23:10 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000]
2022-06-20 16:23:10 destination > 2022-06-20 16:23:10 INFO a.m.s.StreamTransferManager(complete):367 - [Manager uploading to synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro with id ABPnzm7n3...Ejnau_tOw]: Uploading leftover stream [Part number 1 containing 0.41 MB]
2022-06-20 16:23:10 destination > 2022-06-20 16:23:10 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro with id ABPnzm7n3...Ejnau_tOw]: Finished uploading [Part number 1 containing 0.41 MB]
2022-06-20 16:23:10 destination > 2022-06-20 16:23:10 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro with id ABPnzm7n3...Ejnau_tOw]: Completed
2022-06-20 16:23:10 destination > 2022-06-20 16:23:10 INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):178 - Uploaded buffer file to storage: 5f5fe2a3-7b75-4a96-aa0e-17785a45030f15880440188429063389.avro -> airbyte/raw_checkmate_deposit/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro (filename: 1.avro)
2022-06-20 16:23:10 destination > 2022-06-20 16:23:10 INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):53 - Added staged file: 1.avro
2022-06-20 16:23:10 destination > 2022-06-20 16:23:10 INFO i.a.i.d.r.FileBuffer(deleteFile):81 - Deleting tempFile data 5f5fe2a3-7b75-4a96-aa0e-17785a45030f15880440188429063389.avro
2022-06-20 16:23:10 destination > 2022-06-20 16:23:10 INFO i.a.i.d.r.SerializedBufferingStrategy(close):119 - Closing buffer for stream vendor_config
2022-06-20 16:23:10 destination > 2022-06-20 16:23:10 INFO i.a.i.d.r.SerializedBufferingStrategy(close):119 - Closing buffer for stream deposit
2022-06-20 16:23:10 destination > 2022-06-20 16:23:10 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):137 - Copying into tables in destination started for 4 streams
2022-06-20 16:23:10 destination > 2022-06-20 16:23:10 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTmpTableFromStage):122 - Uploading records from staging files to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_qis_vendor_config}} (dataset raw_checkmate): [1.avro]
2022-06-20 16:23:10 destination > 2022-06-20 16:23:10 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):126 - Uploading staged file: gs://synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro
2022-06-20 16:23:11 destination > 2022-06-20 16:23:11 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):135 - [JobId{project=mainapi-282501, job=04fa26d8-5741-4582-b398-cc331e3a5280, location=US}] Created a new job to upload records to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_qis_vendor_config}} (dataset raw_checkmate): Job{job=JobId{project=mainapi-282501, job=04fa26d8-5741-4582-b398-cc331e3a5280, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655742190857, endTime=null, startTime=1655742190969, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@mainapi-282501.iam.gserviceaccount.com, etag=qYuTzFdUYCIgG9kLaqu0yw==, generatedId=mainapi-282501:US.04fa26d8-5741-4582-b398-cc331e3a5280, selfLink=https://www.googleapis.com/bigquery/v2/projects/mainapi-282501/jobs/04fa26d8-5741-4582-b398-cc331e3a5280?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, projectId=mainapi-282501, tableId=_airbyte_tmp_qis_vendor_config}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}
2022-06-20 16:23:11 destination > 2022-06-20 16:23:11 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Waiting for job finish Job{job=JobId{project=mainapi-282501, job=04fa26d8-5741-4582-b398-cc331e3a5280, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655742190857, endTime=null, startTime=1655742190969, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@mainapi-282501.iam.gserviceaccount.com, etag=qYuTzFdUYCIgG9kLaqu0yw==, generatedId=mainapi-282501:US.04fa26d8-5741-4582-b398-cc331e3a5280, selfLink=https://www.googleapis.com/bigquery/v2/projects/mainapi-282501/jobs/04fa26d8-5741-4582-b398-cc331e3a5280?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, projectId=mainapi-282501, tableId=_airbyte_tmp_qis_vendor_config}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null}
2022-06-20 16:23:15 destination > 2022-06-20 16:23:15 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):329 - Job finish Job{job=JobId{project=mainapi-282501, job=04fa26d8-5741-4582-b398-cc331e3a5280, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655742190857, endTime=null, startTime=1655742190969, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@mainapi-282501.iam.gserviceaccount.com, etag=qYuTzFdUYCIgG9kLaqu0yw==, generatedId=mainapi-282501:US.04fa26d8-5741-4582-b398-cc331e3a5280, selfLink=https://www.googleapis.com/bigquery/v2/projects/mainapi-282501/jobs/04fa26d8-5741-4582-b398-cc331e3a5280?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, projectId=mainapi-282501, tableId=_airbyte_tmp_qis_vendor_config}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://synctera-data-staging/airbyte/raw_checkmate_vendor_config/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null}
2022-06-20 16:23:15 destination > 2022-06-20 16:23:15 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):139 - [JobId{project=mainapi-282501, job=04fa26d8-5741-4582-b398-cc331e3a5280, location=US}] Tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_qis_vendor_config}} (dataset raw_checkmate) is successfully appended with staging files
2022-06-20 16:23:15 destination > 2022-06-20 16:23:15 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTargetTable):162 - Copying data from tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_qis_vendor_config}} to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_vendor_config}} (dataset raw_checkmate, sync mode append_dedup)
2022-06-20 16:23:20 destination > 2022-06-20 16:23:20 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_qis_vendor_config}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_vendor_config}}
2022-06-20 16:23:20 destination > 2022-06-20 16:23:20 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTmpTableFromStage):122 - Uploading records from staging files to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_jtj_inbound_file_metadata}} (dataset raw_checkmate): []
2022-06-20 16:23:20 destination > 2022-06-20 16:23:20 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTargetTable):162 - Copying data from tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_jtj_inbound_file_metadata}} to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_inbound_file_metadata}} (dataset raw_checkmate, sync mode append_dedup)
2022-06-20 16:23:24 destination > 2022-06-20 16:23:24 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_jtj_inbound_file_metadata}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_inbound_file_metadata}}
2022-06-20 16:23:24 destination > 2022-06-20 16:23:24 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTmpTableFromStage):122 - Uploading records from staging files to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_nre_deposit}} (dataset raw_checkmate): [1.avro]
2022-06-20 16:23:24 destination > 2022-06-20 16:23:24 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):126 - Uploading staged file: gs://synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro
2022-06-20 16:23:24 destination > 2022-06-20 16:23:24 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):135 - [JobId{project=mainapi-282501, job=904d016b-dae7-4333-a981-9cce882b482b, location=US}] Created a new job to upload records to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_nre_deposit}} (dataset raw_checkmate): Job{job=JobId{project=mainapi-282501, job=904d016b-dae7-4333-a981-9cce882b482b, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655742204089, endTime=null, startTime=1655742204196, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@mainapi-282501.iam.gserviceaccount.com, etag=dovdFnwhtfxp5R6MU/S9pA==, generatedId=mainapi-282501:US.904d016b-dae7-4333-a981-9cce882b482b, selfLink=https://www.googleapis.com/bigquery/v2/projects/mainapi-282501/jobs/904d016b-dae7-4333-a981-9cce882b482b?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, projectId=mainapi-282501, tableId=_airbyte_tmp_nre_deposit}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}
2022-06-20 16:23:24 destination > 2022-06-20 16:23:24 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Waiting for job finish Job{job=JobId{project=mainapi-282501, job=904d016b-dae7-4333-a981-9cce882b482b, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655742204089, endTime=null, startTime=1655742204196, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@mainapi-282501.iam.gserviceaccount.com, etag=dovdFnwhtfxp5R6MU/S9pA==, generatedId=mainapi-282501:US.904d016b-dae7-4333-a981-9cce882b482b, selfLink=https://www.googleapis.com/bigquery/v2/projects/mainapi-282501/jobs/904d016b-dae7-4333-a981-9cce882b482b?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, projectId=mainapi-282501, tableId=_airbyte_tmp_nre_deposit}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null}
2022-06-20 16:23:31 destination > 2022-06-20 16:23:31 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):329 - Job finish Job{job=JobId{project=mainapi-282501, job=904d016b-dae7-4333-a981-9cce882b482b, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1655742204089, endTime=null, startTime=1655742204196, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte@mainapi-282501.iam.gserviceaccount.com, etag=dovdFnwhtfxp5R6MU/S9pA==, generatedId=mainapi-282501:US.904d016b-dae7-4333-a981-9cce882b482b, selfLink=https://www.googleapis.com/bigquery/v2/projects/mainapi-282501/jobs/904d016b-dae7-4333-a981-9cce882b482b?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, projectId=mainapi-282501, tableId=_airbyte_tmp_nre_deposit}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://synctera-data-staging/airbyte/raw_checkmate_deposit/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null}
2022-06-20 16:23:31 destination > 2022-06-20 16:23:31 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):139 - [JobId{project=mainapi-282501, job=904d016b-dae7-4333-a981-9cce882b482b, location=US}] Tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_nre_deposit}} (dataset raw_checkmate) is successfully appended with staging files
2022-06-20 16:23:31 destination > 2022-06-20 16:23:31 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTargetTable):162 - Copying data from tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_nre_deposit}} to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_deposit}} (dataset raw_checkmate, sync mode append_dedup)
2022-06-20 16:23:34 destination > 2022-06-20 16:23:34 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_nre_deposit}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_deposit}}
2022-06-20 16:23:34 destination > 2022-06-20 16:23:34 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTmpTableFromStage):122 - Uploading records from staging files to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_pyv_bank_config}} (dataset raw_checkmate): []
2022-06-20 16:23:34 destination > 2022-06-20 16:23:34 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTargetTable):162 - Copying data from tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_pyv_bank_config}} to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_bank_config}} (dataset raw_checkmate, sync mode append_dedup)
2022-06-20 16:23:35 destination > 2022-06-20 16:23:35 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_pyv_bank_config}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_raw_bank_config}}
2022-06-20 16:23:35 destination > 2022-06-20 16:23:35 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):156 - Finalizing tables in destination completed
2022-06-20 16:23:35 destination > 2022-06-20 16:23:35 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):159 - Cleaning up destination started for 4 streams
2022-06-20 16:23:35 destination > 2022-06-20 16:23:35 INFO i.a.i.d.b.BigQueryGcsOperations(dropTableIfExists):172 - Deleting tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_qis_vendor_config}} (dataset raw_checkmate)
2022-06-20 16:23:35 destination > 2022-06-20 16:23:35 INFO i.a.i.d.b.BigQueryGcsOperations(dropStageIfExists):183 - Cleaning up staging path for stream vendor_config (dataset raw_checkmate): airbyte/raw_checkmate_vendor_config
2022-06-20 16:23:35 destination > 2022-06-20 16:23:35 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object airbyte/raw_checkmate_vendor_config/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/
2022-06-20 16:23:36 destination > 2022-06-20 16:23:36 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object airbyte/raw_checkmate_vendor_config/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro
2022-06-20 16:23:36 destination > 2022-06-20 16:23:36 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):270 - Storage bucket airbyte/raw_checkmate_vendor_config has been cleaned-up (2 objects were deleted)...
2022-06-20 16:23:36 destination > 2022-06-20 16:23:36 INFO i.a.i.d.b.BigQueryGcsOperations(dropTableIfExists):172 - Deleting tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_jtj_inbound_file_metadata}} (dataset raw_checkmate)
2022-06-20 16:23:36 destination > 2022-06-20 16:23:36 INFO i.a.i.d.b.BigQueryGcsOperations(dropStageIfExists):183 - Cleaning up staging path for stream inbound_file_metadata (dataset raw_checkmate): airbyte/raw_checkmate_inbound_file_metadata
2022-06-20 16:23:36 destination > 2022-06-20 16:23:36 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object airbyte/raw_checkmate_inbound_file_metadata/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/
2022-06-20 16:23:36 destination > 2022-06-20 16:23:36 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):270 - Storage bucket airbyte/raw_checkmate_inbound_file_metadata has been cleaned-up (1 objects were deleted)...
2022-06-20 16:23:36 destination > 2022-06-20 16:23:36 INFO i.a.i.d.b.BigQueryGcsOperations(dropTableIfExists):172 - Deleting tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_nre_deposit}} (dataset raw_checkmate)
2022-06-20 16:23:36 destination > 2022-06-20 16:23:36 INFO i.a.i.d.b.BigQueryGcsOperations(dropStageIfExists):183 - Cleaning up staging path for stream deposit (dataset raw_checkmate): airbyte/raw_checkmate_deposit
2022-06-20 16:23:36 destination > 2022-06-20 16:23:36 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object airbyte/raw_checkmate_deposit/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/
2022-06-20 16:23:36 destination > 2022-06-20 16:23:36 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object airbyte/raw_checkmate_deposit/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/1.avro
2022-06-20 16:23:37 destination > 2022-06-20 16:23:37 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):270 - Storage bucket airbyte/raw_checkmate_deposit has been cleaned-up (2 objects were deleted)...
2022-06-20 16:23:37 destination > 2022-06-20 16:23:37 INFO i.a.i.d.b.BigQueryGcsOperations(dropTableIfExists):172 - Deleting tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_checkmate, tableId=_airbyte_tmp_pyv_bank_config}} (dataset raw_checkmate)
2022-06-20 16:23:37 destination > 2022-06-20 16:23:37 INFO i.a.i.d.b.BigQueryGcsOperations(dropStageIfExists):183 - Cleaning up staging path for stream bank_config (dataset raw_checkmate): airbyte/raw_checkmate_bank_config
2022-06-20 16:23:37 destination > 2022-06-20 16:23:37 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object airbyte/raw_checkmate_bank_config/2022/06/20/16/6b09b80c-cbe3-4447-afee-1cd731139aab/
2022-06-20 16:23:37 destination > 2022-06-20 16:23:37 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):270 - Storage bucket airbyte/raw_checkmate_bank_config has been cleaned-up (1 objects were deleted)...
2022-06-20 16:23:37 destination > 2022-06-20 16:23:37 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):164 - Cleaning up destination completed.
2022-06-20 16:23:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):405 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@5bd90366[type=STATE,log=<null>,spec=<null>,connectionStatus=<null>,catalog=<null>,record=<null>,state=io.airbyte.protocol.models.AirbyteStateMessage@551ee66d[stateType=<null>,stream=<null>,global=<null>,data={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"checkmate\",{\"server\":\"checkmate\"}]}":"{\"last_snapshot_record\":true,\"lsn\":360862248624,\"txId\":19622788,\"ts_usec\":1655742186752000,\"snapshot\":true}"}},"streams":[{"stream_name":"bank_config","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"deposit","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"inbound_file_metadata","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"vendor_config","stream_namespace":"public","cursor_field":["timestamp_ch"]}]},additionalProperties={streams=[]}],trace=<null>,additionalProperties={}]
2022-06-20 16:23:37 destination > 2022-06-20 16:23:37 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2022-06-20 16:23:37 INFO i.a.w.g.DefaultReplicationWorker(run):176 - Source and destination threads complete.
2022-06-20 16:23:37 INFO i.a.w.g.DefaultReplicationWorker(run):239 - sync summary: io.airbyte.config.ReplicationAttemptSummary@f8128a3[status=completed,recordsSynced=19,bytesSynced=429449,startTime=1655742179611,endTime=1655742217634,totalStats=io.airbyte.config.SyncStats@5baf4837[recordsEmitted=19,bytesEmitted=429449,stateMessagesEmitted=1,recordsCommitted=19],streamStats=[io.airbyte.config.StreamSyncStats@2d2057d4[streamName=vendor_config,stats=io.airbyte.config.SyncStats@5fe269f4[recordsEmitted=1,bytesEmitted=377,stateMessagesEmitted=<null>,recordsCommitted=1]], io.airbyte.config.StreamSyncStats@59a0869b[streamName=deposit,stats=io.airbyte.config.SyncStats@78ef9368[recordsEmitted=18,bytesEmitted=429072,stateMessagesEmitted=<null>,recordsCommitted=18]]]]
2022-06-20 16:23:37 INFO i.a.w.g.DefaultReplicationWorker(run):266 - Source output at least one state message
2022-06-20 16:23:37 INFO i.a.w.g.DefaultReplicationWorker(run):272 - State capture: Updated state to: Optional[io.airbyte.config.State@57dee556[state={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"checkmate\",{\"server\":\"checkmate\"}]}":"{\"last_snapshot_record\":true,\"lsn\":360862248624,\"txId\":19622788,\"ts_usec\":1655742186752000,\"snapshot\":true}"}},"streams":[{"stream_name":"bank_config","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"deposit","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"inbound_file_metadata","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"vendor_config","stream_namespace":"public","cursor_field":["timestamp_ch"]}]}]]
2022-06-20 16:23:37 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling...
2022-06-20 16:23:37 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):157 - sync summary: io.airbyte.config.StandardSyncOutput@f144e7e[standardSyncSummary=io.airbyte.config.StandardSyncSummary@4a16c1f8[status=completed,recordsSynced=19,bytesSynced=429449,startTime=1655742179611,endTime=1655742217634,totalStats=io.airbyte.config.SyncStats@5baf4837[recordsEmitted=19,bytesEmitted=429449,stateMessagesEmitted=1,recordsCommitted=19],streamStats=[io.airbyte.config.StreamSyncStats@2d2057d4[streamName=vendor_config,stats=io.airbyte.config.SyncStats@5fe269f4[recordsEmitted=1,bytesEmitted=377,stateMessagesEmitted=<null>,recordsCommitted=1]], io.airbyte.config.StreamSyncStats@59a0869b[streamName=deposit,stats=io.airbyte.config.SyncStats@78ef9368[recordsEmitted=18,bytesEmitted=429072,stateMessagesEmitted=<null>,recordsCommitted=18]]]],normalizationSummary=<null>,state=io.airbyte.config.State@57dee556[state={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"checkmate\",{\"server\":\"checkmate\"}]}":"{\"last_snapshot_record\":true,\"lsn\":360862248624,\"txId\":19622788,\"ts_usec\":1655742186752000,\"snapshot\":true}"}},"streams":[{"stream_name":"bank_config","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"deposit","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"inbound_file_metadata","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"vendor_config","stream_namespace":"public","cursor_field":["timestamp_ch"]}]}],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@2e3659e1[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@7b16ea37[stream=io.airbyte.protocol.models.AirbyteStream@56dc2c95[name=bank_config,jsonSchema={"type":"object","properties":{"name":{"type":"string"},"bank_id":{"type":"number"},"_ab_cdc_lsn":{"type":"number"},"timestamp_ch":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"timestamp_cr":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"hold_duration":{"type":"number"},"bank_config_id":{"type":"string"},"vendor_bank_id":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"inbound_upload_path":{"type":"string"},"outbound_upload_path":{"type":"string"},"hold_amount_percentage":{"type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[bank_config_id]],namespace=raw_checkmate,additionalProperties={}],syncMode=incremental,cursorField=[timestamp_ch],destinationSyncMode=append_dedup,primaryKey=[[bank_config_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@2a393eb7[stream=io.airbyte.protocol.models.AirbyteStream@36dc8340[name=deposit,jsonSchema={"type":"object","properties":{"micr":{"type":"string"},"amount":{"type":"number"},"status":{"type":"string"},"bank_id":{"type":"number"},"currency":{"type":"string"},"party_id":{"type":"string"},"account_id":{"type":"string"},"deposit_id":{"type":"string"},"partner_id":{"type":"number"},"party_type":{"type":"string"},"_ab_cdc_lsn":{"type":"number"},"vendor_info":{"type":"string"},"check_amount":{"type":"number"},"check_number":{"type":"string"},"timestamp_ch":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"timestamp_cr":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"timestamp_de":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"back_image_id":{"type":"string"},"date_captured":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"account_number":{"type":"string"},"date_processed":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"front_image_id":{"type":"string"},"transaction_id":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"ocr_account_number":{"type":"string"},"vendor_reference_id":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[deposit_id]],namespace=raw_checkmate,additionalProperties={}],syncMode=incremental,cursorField=[timestamp_ch],destinationSyncMode=append_dedup,primaryKey=[[deposit_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@7ad780fe[stream=io.airbyte.protocol.models.AirbyteStream@4dd8a3b5[name=inbound_file_metadata,jsonSchema={"type":"object","properties":{"file_hash":{"type":"string"},"file_name":{"type":"string"},"_ab_cdc_lsn":{"type":"number"},"timestamp_ch":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"timestamp_cr":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"inbound_file_metadata_id":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[inbound_file_metadata_id]],namespace=raw_checkmate,additionalProperties={}],syncMode=incremental,cursorField=[timestamp_ch],destinationSyncMode=append_dedup,primaryKey=[[inbound_file_metadata_id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@2e77e03f[stream=io.airbyte.protocol.models.AirbyteStream@7ce3a032[name=vendor_config,jsonSchema={"type":"object","properties":{"name":{"type":"string"},"_ab_cdc_lsn":{"type":"number"},"timestamp_ch":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"timestamp_cr":{"type":"string","format":"date-time","airbyte_type":"timestamp_with_timezone"},"vendor_config_id":{"type":"string"},"_ab_cdc_deleted_at":{"type":"string"},"_ab_cdc_updated_at":{"type":"string"},"inbound_upload_path":{"type":"string"},"outbound_upload_path":{"type":"string"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[],sourceDefinedPrimaryKey=[[vendor_config_id]],namespace=raw_checkmate,additionalProperties={}],syncMode=incremental,cursorField=[timestamp_ch],destinationSyncMode=append_dedup,primaryKey=[[vendor_config_id]],additionalProperties={}]],additionalProperties={}],failures=[]]
2022-06-20 16:23:37 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):236 - Stopping temporal heartbeating...
2022-06-20 16:23:37 INFO i.a.c.p.ConfigRepository(updateConnectionState):775 - Updating connection 8b0bff81-e1b7-4b56-a2ee-9c2092d4763a state: io.airbyte.config.State@23dfbeb0[state={"cdc":false,"cdc_state":{"state":{"{\"schema\":null,\"payload\":[\"checkmate\",{\"server\":\"checkmate\"}]}":"{\"last_snapshot_record\":true,\"lsn\":360862248624,\"txId\":19622788,\"ts_usec\":1655742186752000,\"snapshot\":true}"}},"streams":[{"stream_name":"bank_config","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"deposit","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"inbound_file_metadata","stream_namespace":"public","cursor_field":["timestamp_ch"]},{"stream_name":"vendor_config","stream_namespace":"public","cursor_field":["timestamp_ch"]}]}]
2022-06-20 16:23:37 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/81417/2/logs.log
2022-06-20 16:23:37 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.19-alpha
2022-06-20 16:23:37 INFO i.a.w.g.DefaultNormalizationWorker(run):49 - Running normalization.
2022-06-20 16:23:37 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):122 - Running with normalization version: airbyte/normalization:0.2.4
2022-06-20 16:23:37 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/normalization:0.2.4 exists...
2022-06-20 16:23:37 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/normalization:0.2.4 was found locally.
2022-06-20 16:23:37 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 81417
2022-06-20 16:23:37 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/81417/2/normalize --log-driver none --name normalization-normalize-81417-2-ggavt --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.39.19-alpha airbyte/normalization:0.2.4 run --integration-type bigquery --config destination_config.json --catalog destination_catalog.json
2022-06-20 16:23:38 normalization > Running: transform-config --config destination_config.json --integration-type bigquery --out /data/81417/2/normalize
2022-06-20 16:23:38 normalization > Namespace(config='destination_config.json', integration_type=<DestinationType.BIGQUERY: 'bigquery'>, out='/data/81417/2/normalize')
2022-06-20 16:23:38 normalization > transform_bigquery
2022-06-20 16:23:38 normalization > Running: transform-catalog --integration-type bigquery --profile-config-dir /data/81417/2/normalize --catalog destination_catalog.json --out /data/81417/2/normalize/models/generated/ --json-column _airbyte_data
2022-06-20 16:23:39 normalization > Processing destination_catalog.json...
2022-06-20 16:23:39 normalization >   Generating airbyte_ctes/raw_checkmate/bank_config_ab1.sql from bank_config
2022-06-20 16:23:39 normalization >   Generating airbyte_ctes/raw_checkmate/bank_config_ab2.sql from bank_config
2022-06-20 16:23:39 normalization >   Generating airbyte_views/raw_checkmate/bank_config_stg.sql from bank_config
2022-06-20 16:23:39 normalization >   Generating airbyte_incremental/scd/raw_checkmate/bank_config_scd.sql from bank_config
2022-06-20 16:23:39 normalization >   Generating airbyte_incremental/raw_checkmate/bank_config.sql from bank_config
2022-06-20 16:23:39 normalization >   Generating airbyte_ctes/raw_checkmate/deposit_ab1.sql from deposit
2022-06-20 16:23:39 normalization >   Generating airbyte_ctes/raw_checkmate/deposit_ab2.sql from deposit
2022-06-20 16:23:39 normalization >   Generating airbyte_views/raw_checkmate/deposit_stg.sql from deposit
2022-06-20 16:23:39 normalization >   Generating airbyte_incremental/scd/raw_checkmate/deposit_scd.sql from deposit
2022-06-20 16:23:39 normalization >   Generating airbyte_incremental/raw_checkmate/deposit.sql from deposit
2022-06-20 16:23:39 normalization >   Generating airbyte_ctes/raw_checkmate/inbound_file_metadata_ab1.sql from inbound_file_metadata
2022-06-20 16:23:39 normalization >   Generating airbyte_ctes/raw_checkmate/inbound_file_metadata_ab2.sql from inbound_file_metadata
2022-06-20 16:23:39 normalization >   Generating airbyte_views/raw_checkmate/inbound_file_metadata_stg.sql from inbound_file_metadata
2022-06-20 16:23:39 normalization >   Generating airbyte_incremental/scd/raw_checkmate/inbound_file_metadata_scd.sql from inbound_file_metadata
2022-06-20 16:23:39 normalization >   Generating airbyte_incremental/raw_checkmate/inbound_file_metadata.sql from inbound_file_metadata
2022-06-20 16:23:39 normalization >   Generating airbyte_ctes/raw_checkmate/vendor_config_ab1.sql from vendor_config
2022-06-20 16:23:39 normalization >   Generating airbyte_ctes/raw_checkmate/vendor_config_ab2.sql from vendor_config
2022-06-20 16:23:39 normalization >   Generating airbyte_views/raw_checkmate/vendor_config_stg.sql from vendor_config
2022-06-20 16:23:39 normalization >   Generating airbyte_incremental/scd/raw_checkmate/vendor_config_scd.sql from vendor_config
2022-06-20 16:23:39 normalization >   Generating airbyte_incremental/raw_checkmate/vendor_config.sql from vendor_config
2022-06-20 16:23:39 normalization > detected no config file for ssh, assuming ssh is off.
2022-06-20 16:23:43 normalization >            [--event-buffer-size EVENT_BUFFER_SIZE]
2022-06-20 16:23:43 normalization >   --event-buffer-size EVENT_BUFFER_SIZE
2022-06-20 16:23:43 normalization > 
2022-06-20 16:23:43 normalization > DBT >=1.0.0 detected; using 10K event buffer size
2022-06-20 16:23:43 normalization > 
2022-06-20 16:23:47 normalization > 16:23:47  Running with dbt=1.0.0
2022-06-20 16:23:47 normalization > 16:23:47  Partial parse save file not found. Starting full parse.
2022-06-20 16:23:50 normalization > 16:23:50  [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources.
2022-06-20 16:23:50 normalization > There are 1 unused configuration paths:
2022-06-20 16:23:50 normalization > - models.airbyte_utils.generated.airbyte_tables
2022-06-20 16:23:50 normalization > 
2022-06-20 16:23:50 normalization > 16:23:50  Found 20 models, 0 tests, 0 snapshots, 0 analyses, 548 macros, 0 operations, 0 seed files, 4 sources, 0 exposures, 0 metrics
2022-06-20 16:23:50 normalization > 16:23:50  
2022-06-20 16:23:51 normalization > 16:23:51  Concurrency: 8 threads (target='prod')
2022-06-20 16:23:51 normalization > 16:23:51  
2022-06-20 16:23:51 normalization > 16:23:51  1 of 12 START view model _airbyte_raw_checkmate.vendor_config_stg....................................................... [RUN]
2022-06-20 16:23:51 normalization > 16:23:51  2 of 12 START view model _airbyte_raw_checkmate.deposit_stg............................................................. [RUN]
2022-06-20 16:23:51 normalization > 16:23:51  3 of 12 START view model _airbyte_raw_checkmate.bank_config_stg......................................................... [RUN]
2022-06-20 16:23:51 normalization > 16:23:51  4 of 12 START view model _airbyte_raw_checkmate.inbound_file_metadata_stg............................................... [RUN]
2022-06-20 16:23:52 normalization > 16:23:52  4 of 12 OK created view model _airbyte_raw_checkmate.inbound_file_metadata_stg.......................................... [OK in 0.91s]
2022-06-20 16:23:52 normalization > 16:23:52  5 of 12 START incremental model raw_checkmate.inbound_file_metadata_scd................................................. [RUN]
2022-06-20 16:23:52 normalization > 16:23:52  1 of 12 OK created view model _airbyte_raw_checkmate.vendor_config_stg.................................................. [OK in 1.03s]
2022-06-20 16:23:52 normalization > 16:23:52  6 of 12 START incremental model raw_checkmate.vendor_config_scd......................................................... [RUN]
2022-06-20 16:23:52 normalization > 16:23:52  2 of 12 OK created view model _airbyte_raw_checkmate.deposit_stg........................................................ [OK in 1.13s]
2022-06-20 16:23:52 normalization > 16:23:52  3 of 12 OK created view model _airbyte_raw_checkmate.bank_config_stg.................................................... [OK in 1.13s]
2022-06-20 16:23:52 normalization > 16:23:52  7 of 12 START incremental model raw_checkmate.deposit_scd............................................................... [RUN]
2022-06-20 16:23:52 normalization > 16:23:52  8 of 12 START incremental model raw_checkmate.bank_config_scd........................................................... [RUN]
2022-06-20 16:23:52 normalization > 16:23:52  16:23:52 + `mainapi-282501`.raw_checkmate.`deposit_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-06-20 16:23:59 normalization > 16:23:59  7 of 12 ERROR creating incremental model raw_checkmate.deposit_scd...................................................... [ERROR in 6.49s]
2022-06-20 16:23:59 normalization > 16:23:59  9 of 12 SKIP relation raw_checkmate.deposit............................................................................. [SKIP]
2022-06-20 16:24:04 normalization > 16:24:04  5 of 12 OK created incremental model raw_checkmate.inbound_file_metadata_scd............................................ [MERGE (0.0 rows, 0 processed) in 11.75s]
2022-06-20 16:24:04 normalization > 16:24:04  10 of 12 START incremental model raw_checkmate.inbound_file_metadata.................................................... [RUN]
2022-06-20 16:24:04 normalization > 16:24:04  8 of 12 OK created incremental model raw_checkmate.bank_config_scd...................................................... [MERGE (0.0 rows, 0 processed) in 12.03s]
2022-06-20 16:24:04 normalization > 16:24:04  11 of 12 START incremental model raw_checkmate.bank_config.............................................................. [RUN]
2022-06-20 16:24:06 normalization > 16:24:06  6 of 12 OK created incremental model raw_checkmate.vendor_config_scd.................................................... [MERGE (2.0 rows, 1.0 KB processed) in 14.13s]
2022-06-20 16:24:06 normalization > 16:24:06  12 of 12 START incremental model raw_checkmate.vendor_config............................................................ [RUN]
2022-06-20 16:24:09 normalization > 16:24:09  10 of 12 OK created incremental model raw_checkmate.inbound_file_metadata............................................... [MERGE (0.0 rows, 0 processed) in 5.63s]
2022-06-20 16:24:12 normalization > 16:24:12  11 of 12 OK created incremental model raw_checkmate.bank_config......................................................... [MERGE (0.0 rows, 0 processed) in 7.63s]
2022-06-20 16:24:12 normalization > 16:24:12  12 of 12 OK created incremental model raw_checkmate.vendor_config....................................................... [MERGE (1.0 rows, 564.0 Bytes processed) in 5.85s]
2022-06-20 16:24:12 normalization > 16:24:12  
2022-06-20 16:24:12 normalization > 16:24:12  Finished running 4 view models, 8 incremental models in 22.11s.
2022-06-20 16:24:12 normalization > 16:24:12  
2022-06-20 16:24:12 normalization > 16:24:12  Completed with 1 error and 0 warnings:
2022-06-20 16:24:12 normalization > 16:24:12  
2022-06-20 16:24:12 normalization > 16:24:12  Database Error in model deposit_scd (models/generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql)
2022-06-20 16:24:12 normalization > 16:24:12    Invalid timestamp string "0000-12-30T00:00:00Z"
2022-06-20 16:24:12 normalization > 16:24:12    compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql
2022-06-20 16:24:12 normalization > 16:24:12  
2022-06-20 16:24:12 normalization > 16:24:12  Done. PASS=10 WARN=0 ERROR=1 SKIP=1 TOTAL=12
2022-06-20 16:24:12 normalization > 
2022-06-20 16:24:12 normalization > Diagnosing dbt debug to check if destination is available for dbt and well configured (1):
2022-06-20 16:24:12 normalization > 
2022-06-20 16:24:16 normalization > 16:24:16  Running with dbt=1.0.0
2022-06-20 16:24:16 normalization > dbt version: 1.0.0
2022-06-20 16:24:16 normalization > python version: 3.9.9
2022-06-20 16:24:16 normalization > python path: /usr/local/bin/python
2022-06-20 16:24:16 normalization > os info: Linux-5.13.0-1024-gcp-x86_64-with-glibc2.31
2022-06-20 16:24:16 normalization > Using profiles.yml file at /data/81417/2/normalize/profiles.yml
2022-06-20 16:24:16 normalization > Using dbt_project.yml file at /data/81417/2/normalize/dbt_project.yml
2022-06-20 16:24:16 normalization > 
2022-06-20 16:24:16 normalization > Configuration:
2022-06-20 16:24:16 normalization >   profiles.yml file [OK found and valid]
2022-06-20 16:24:16 normalization >   dbt_project.yml file [OK found and valid]
2022-06-20 16:24:16 normalization > 
2022-06-20 16:24:16 normalization > Required dependencies:
2022-06-20 16:24:16 normalization >  - git [OK found]
2022-06-20 16:24:16 normalization > 
2022-06-20 16:24:16 normalization > Connection:
2022-06-20 16:24:16 normalization >   method: service-account-json
2022-06-20 16:24:16 normalization >   database: mainapi-282501
2022-06-20 16:24:16 normalization >   schema: airbyte
2022-06-20 16:24:16 normalization >   location: US
2022-06-20 16:24:16 normalization >   priority: interactive
2022-06-20 16:24:16 normalization >   timeout_seconds: 300
2022-06-20 16:24:16 normalization >   maximum_bytes_billed: None
2022-06-20 16:24:16 normalization >   execution_project: mainapi-282501
2022-06-20 16:24:17 normalization >   Connection test: [OK connection ok]
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > All checks passed!
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > Forward dbt output logs to diagnose/debug errors (0):
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > ============================== 2022-06-20 16:23:47.599726 | a71976de-b539-4847-a810-cbe132ab101e ==============================
2022-06-20 16:24:17 normalization > 16:23:47.599726 [info ] [MainThread]: Running with dbt=1.0.0
2022-06-20 16:24:17 normalization > 16:23:47.600502 [debug] [MainThread]: running dbt with arguments Namespace(record_timing_info=None, debug=None, log_format=None, write_json=None, use_colors=None, printer_width=None, warn_error=None, version_check=None, partial_parse=None, single_threaded=False, use_experimental_parser=None, static_parser=None, profiles_dir='/data/81417/2/normalize', send_anonymous_usage_stats=None, fail_fast=None, event_buffer_size='10000', project_dir='/data/81417/2/normalize', profile=None, target=None, vars='{}', log_cache_events=False, threads=None, select=None, exclude=None, selector_name=None, state=None, defer=None, full_refresh=False, cls=<class 'dbt.task.run.RunTask'>, which='run', rpc_method='run')
2022-06-20 16:24:17 normalization > 16:23:47.600919 [debug] [MainThread]: Tracking: do not track
2022-06-20 16:24:17 normalization > 16:23:47.639548 [info ] [MainThread]: Partial parse save file not found. Starting full parse.
2022-06-20 16:24:17 normalization > 16:23:47.684823 [debug] [MainThread]: Parsing macros/configuration.sql
2022-06-20 16:24:17 normalization > 16:23:47.689699 [debug] [MainThread]: Parsing macros/should_full_refresh.sql
2022-06-20 16:24:17 normalization > 16:23:47.699017 [debug] [MainThread]: Parsing macros/incremental.sql
2022-06-20 16:24:17 normalization > 16:23:47.710934 [debug] [MainThread]: Parsing macros/get_custom_schema.sql
2022-06-20 16:24:17 normalization > 16:23:47.712047 [debug] [MainThread]: Parsing macros/star_intersect.sql
2022-06-20 16:24:17 normalization > 16:23:47.722565 [debug] [MainThread]: Parsing macros/schema_tests/equal_rowcount.sql
2022-06-20 16:24:17 normalization > 16:23:47.724703 [debug] [MainThread]: Parsing macros/schema_tests/equality.sql
2022-06-20 16:24:17 normalization > 16:23:47.736964 [debug] [MainThread]: Parsing macros/cross_db_utils/except.sql
2022-06-20 16:24:17 normalization > 16:23:47.738821 [debug] [MainThread]: Parsing macros/cross_db_utils/current_timestamp.sql
2022-06-20 16:24:17 normalization > 16:23:47.739881 [debug] [MainThread]: Parsing macros/cross_db_utils/columns.sql
2022-06-20 16:24:17 normalization > 16:23:47.744738 [debug] [MainThread]: Parsing macros/cross_db_utils/hash.sql
2022-06-20 16:24:17 normalization > 16:23:47.745849 [debug] [MainThread]: Parsing macros/cross_db_utils/json_operations.sql
2022-06-20 16:24:17 normalization > 16:23:47.815105 [debug] [MainThread]: Parsing macros/cross_db_utils/quote.sql
2022-06-20 16:24:17 normalization > 16:23:47.817828 [debug] [MainThread]: Parsing macros/cross_db_utils/type_conversions.sql
2022-06-20 16:24:17 normalization > 16:23:47.832412 [debug] [MainThread]: Parsing macros/cross_db_utils/surrogate_key.sql
2022-06-20 16:24:17 normalization > 16:23:47.836040 [debug] [MainThread]: Parsing macros/cross_db_utils/datatypes.sql
2022-06-20 16:24:17 normalization > 16:23:47.854285 [debug] [MainThread]: Parsing macros/cross_db_utils/concat.sql
2022-06-20 16:24:17 normalization > 16:23:47.857886 [debug] [MainThread]: Parsing macros/cross_db_utils/array.sql
2022-06-20 16:24:17 normalization > 16:23:47.883802 [debug] [MainThread]: Parsing macros/adapters.sql
2022-06-20 16:24:17 normalization > 16:23:47.929098 [debug] [MainThread]: Parsing macros/catalog.sql
2022-06-20 16:24:17 normalization > 16:23:47.942049 [debug] [MainThread]: Parsing macros/etc.sql
2022-06-20 16:24:17 normalization > 16:23:47.945762 [debug] [MainThread]: Parsing macros/materializations/table.sql
2022-06-20 16:24:17 normalization > 16:23:47.953223 [debug] [MainThread]: Parsing macros/materializations/copy.sql
2022-06-20 16:24:17 normalization > 16:23:47.958921 [debug] [MainThread]: Parsing macros/materializations/seed.sql
2022-06-20 16:24:17 normalization > 16:23:47.963585 [debug] [MainThread]: Parsing macros/materializations/incremental.sql
2022-06-20 16:24:17 normalization > 16:23:47.992219 [debug] [MainThread]: Parsing macros/materializations/view.sql
2022-06-20 16:24:17 normalization > 16:23:47.997486 [debug] [MainThread]: Parsing macros/materializations/snapshot.sql
2022-06-20 16:24:17 normalization > 16:23:48.000823 [debug] [MainThread]: Parsing macros/etc/statement.sql
2022-06-20 16:24:17 normalization > 16:23:48.009647 [debug] [MainThread]: Parsing macros/etc/datetime.sql
2022-06-20 16:24:17 normalization > 16:23:48.026384 [debug] [MainThread]: Parsing macros/materializations/configs.sql
2022-06-20 16:24:17 normalization > 16:23:48.030595 [debug] [MainThread]: Parsing macros/materializations/hooks.sql
2022-06-20 16:24:17 normalization > 16:23:48.037579 [debug] [MainThread]: Parsing macros/materializations/tests/where_subquery.sql
2022-06-20 16:24:17 normalization > 16:23:48.040988 [debug] [MainThread]: Parsing macros/materializations/tests/helpers.sql
2022-06-20 16:24:17 normalization > 16:23:48.044273 [debug] [MainThread]: Parsing macros/materializations/tests/test.sql
2022-06-20 16:24:17 normalization > 16:23:48.053580 [debug] [MainThread]: Parsing macros/materializations/seeds/seed.sql
2022-06-20 16:24:17 normalization > 16:23:48.065979 [debug] [MainThread]: Parsing macros/materializations/seeds/helpers.sql
2022-06-20 16:24:17 normalization > 16:23:48.099273 [debug] [MainThread]: Parsing macros/materializations/models/table/table.sql
2022-06-20 16:24:17 normalization > 16:23:48.113405 [debug] [MainThread]: Parsing macros/materializations/models/table/create_table_as.sql
2022-06-20 16:24:17 normalization > 16:23:48.118764 [debug] [MainThread]: Parsing macros/materializations/models/incremental/incremental.sql
2022-06-20 16:24:17 normalization > 16:23:48.138436 [debug] [MainThread]: Parsing macros/materializations/models/incremental/column_helpers.sql
2022-06-20 16:24:17 normalization > 16:23:48.148089 [debug] [MainThread]: Parsing macros/materializations/models/incremental/merge.sql
2022-06-20 16:24:17 normalization > 16:23:48.171409 [debug] [MainThread]: Parsing macros/materializations/models/incremental/on_schema_change.sql
2022-06-20 16:24:17 normalization > 16:23:48.203373 [debug] [MainThread]: Parsing macros/materializations/models/incremental/is_incremental.sql
2022-06-20 16:24:17 normalization > 16:23:48.206366 [debug] [MainThread]: Parsing macros/materializations/models/view/create_or_replace_view.sql
2022-06-20 16:24:17 normalization > 16:23:48.211614 [debug] [MainThread]: Parsing macros/materializations/models/view/create_view_as.sql
2022-06-20 16:24:17 normalization > 16:23:48.216655 [debug] [MainThread]: Parsing macros/materializations/models/view/view.sql
2022-06-20 16:24:17 normalization > 16:23:48.230044 [debug] [MainThread]: Parsing macros/materializations/models/view/helpers.sql
2022-06-20 16:24:17 normalization > 16:23:48.232598 [debug] [MainThread]: Parsing macros/materializations/snapshots/snapshot_merge.sql
2022-06-20 16:24:17 normalization > 16:23:48.235594 [debug] [MainThread]: Parsing macros/materializations/snapshots/snapshot.sql
2022-06-20 16:24:17 normalization > 16:23:48.259217 [debug] [MainThread]: Parsing macros/materializations/snapshots/helpers.sql
2022-06-20 16:24:17 normalization > 16:23:48.281582 [debug] [MainThread]: Parsing macros/materializations/snapshots/strategies.sql
2022-06-20 16:24:17 normalization > 16:23:48.316818 [debug] [MainThread]: Parsing macros/adapters/persist_docs.sql
2022-06-20 16:24:17 normalization > 16:23:48.325332 [debug] [MainThread]: Parsing macros/adapters/columns.sql
2022-06-20 16:24:17 normalization > 16:23:48.345600 [debug] [MainThread]: Parsing macros/adapters/indexes.sql
2022-06-20 16:24:17 normalization > 16:23:48.351022 [debug] [MainThread]: Parsing macros/adapters/relation.sql
2022-06-20 16:24:17 normalization > 16:23:48.371606 [debug] [MainThread]: Parsing macros/adapters/schema.sql
2022-06-20 16:24:17 normalization > 16:23:48.376461 [debug] [MainThread]: Parsing macros/adapters/freshness.sql
2022-06-20 16:24:17 normalization > 16:23:48.382094 [debug] [MainThread]: Parsing macros/adapters/metadata.sql
2022-06-20 16:24:17 normalization > 16:23:48.396525 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_database.sql
2022-06-20 16:24:17 normalization > 16:23:48.399690 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_schema.sql
2022-06-20 16:24:17 normalization > 16:23:48.404588 [debug] [MainThread]: Parsing macros/get_custom_name/get_custom_alias.sql
2022-06-20 16:24:17 normalization > 16:23:48.407518 [debug] [MainThread]: Parsing macros/generic_test_sql/not_null.sql
2022-06-20 16:24:17 normalization > 16:23:48.408719 [debug] [MainThread]: Parsing macros/generic_test_sql/accepted_values.sql
2022-06-20 16:24:17 normalization > 16:23:48.411267 [debug] [MainThread]: Parsing macros/generic_test_sql/unique.sql
2022-06-20 16:24:17 normalization > 16:23:48.412531 [debug] [MainThread]: Parsing macros/generic_test_sql/relationships.sql
2022-06-20 16:24:17 normalization > 16:23:48.414227 [debug] [MainThread]: Parsing tests/generic/builtin.sql
2022-06-20 16:24:17 normalization > 16:23:48.419803 [debug] [MainThread]: Parsing macros/web/get_url_path.sql
2022-06-20 16:24:17 normalization > 16:23:48.425160 [debug] [MainThread]: Parsing macros/web/get_url_host.sql
2022-06-20 16:24:17 normalization > 16:23:48.429080 [debug] [MainThread]: Parsing macros/web/get_url_parameter.sql
2022-06-20 16:24:17 normalization > 16:23:48.432086 [debug] [MainThread]: Parsing macros/materializations/insert_by_period_materialization.sql
2022-06-20 16:24:17 normalization > 16:23:48.480367 [debug] [MainThread]: Parsing macros/schema_tests/test_not_null_where.sql
2022-06-20 16:24:17 normalization > 16:23:48.483229 [debug] [MainThread]: Parsing macros/schema_tests/test_unique_where.sql
2022-06-20 16:24:17 normalization > 16:23:48.485725 [debug] [MainThread]: Parsing macros/schema_tests/at_least_one.sql
2022-06-20 16:24:17 normalization > 16:23:48.487923 [debug] [MainThread]: Parsing macros/schema_tests/not_constant.sql
2022-06-20 16:24:17 normalization > 16:23:48.490039 [debug] [MainThread]: Parsing macros/schema_tests/expression_is_true.sql
2022-06-20 16:24:17 normalization > 16:23:48.494511 [debug] [MainThread]: Parsing macros/schema_tests/recency.sql
2022-06-20 16:24:17 normalization > 16:23:48.497813 [debug] [MainThread]: Parsing macros/schema_tests/equal_rowcount.sql
2022-06-20 16:24:17 normalization > 16:23:48.501367 [debug] [MainThread]: Parsing macros/schema_tests/not_null_proportion.sql
2022-06-20 16:24:17 normalization > 16:23:48.505963 [debug] [MainThread]: Parsing macros/schema_tests/accepted_range.sql
2022-06-20 16:24:17 normalization > 16:23:48.511606 [debug] [MainThread]: Parsing macros/schema_tests/not_accepted_values.sql
2022-06-20 16:24:17 normalization > 16:23:48.515684 [debug] [MainThread]: Parsing macros/schema_tests/cardinality_equality.sql
2022-06-20 16:24:17 normalization > 16:23:48.519711 [debug] [MainThread]: Parsing macros/schema_tests/unique_combination_of_columns.sql
2022-06-20 16:24:17 normalization > 16:23:48.525137 [debug] [MainThread]: Parsing macros/schema_tests/mutually_exclusive_ranges.sql
2022-06-20 16:24:17 normalization > 16:23:48.544214 [debug] [MainThread]: Parsing macros/schema_tests/fewer_rows_than.sql
2022-06-20 16:24:17 normalization > 16:23:48.547679 [debug] [MainThread]: Parsing macros/schema_tests/equality.sql
2022-06-20 16:24:17 normalization > 16:23:48.554538 [debug] [MainThread]: Parsing macros/schema_tests/relationships_where.sql
2022-06-20 16:24:17 normalization > 16:23:48.559494 [debug] [MainThread]: Parsing macros/schema_tests/sequential_values.sql
2022-06-20 16:24:17 normalization > 16:23:48.565673 [debug] [MainThread]: Parsing macros/cross_db_utils/except.sql
2022-06-20 16:24:17 normalization > 16:23:48.568247 [debug] [MainThread]: Parsing macros/cross_db_utils/length.sql
2022-06-20 16:24:17 normalization > 16:23:48.570924 [debug] [MainThread]: Parsing macros/cross_db_utils/position.sql
2022-06-20 16:24:17 normalization > 16:23:48.573803 [debug] [MainThread]: Parsing macros/cross_db_utils/current_timestamp.sql
2022-06-20 16:24:17 normalization > 16:23:48.580299 [debug] [MainThread]: Parsing macros/cross_db_utils/intersect.sql
2022-06-20 16:24:17 normalization > 16:23:48.582673 [debug] [MainThread]: Parsing macros/cross_db_utils/replace.sql
2022-06-20 16:24:17 normalization > 16:23:48.584954 [debug] [MainThread]: Parsing macros/cross_db_utils/escape_single_quotes.sql
2022-06-20 16:24:17 normalization > 16:23:48.588485 [debug] [MainThread]: Parsing macros/cross_db_utils/any_value.sql
2022-06-20 16:24:17 normalization > 16:23:48.591497 [debug] [MainThread]: Parsing macros/cross_db_utils/last_day.sql
2022-06-20 16:24:17 normalization > 16:23:48.598062 [debug] [MainThread]: Parsing macros/cross_db_utils/cast_bool_to_text.sql
2022-06-20 16:24:17 normalization > 16:23:48.600680 [debug] [MainThread]: Parsing macros/cross_db_utils/dateadd.sql
2022-06-20 16:24:17 normalization > 16:23:48.606164 [debug] [MainThread]: Parsing macros/cross_db_utils/literal.sql
2022-06-20 16:24:17 normalization > 16:23:48.607925 [debug] [MainThread]: Parsing macros/cross_db_utils/safe_cast.sql
2022-06-20 16:24:17 normalization > 16:23:48.611215 [debug] [MainThread]: Parsing macros/cross_db_utils/date_trunc.sql
2022-06-20 16:24:17 normalization > 16:23:48.613782 [debug] [MainThread]: Parsing macros/cross_db_utils/bool_or.sql
2022-06-20 16:24:17 normalization > 16:23:48.616689 [debug] [MainThread]: Parsing macros/cross_db_utils/width_bucket.sql
2022-06-20 16:24:17 normalization > 16:23:48.627532 [debug] [MainThread]: Parsing macros/cross_db_utils/hash.sql
2022-06-20 16:24:17 normalization > 16:23:48.630040 [debug] [MainThread]: Parsing macros/cross_db_utils/_is_ephemeral.sql
2022-06-20 16:24:17 normalization > 16:23:48.633460 [debug] [MainThread]: Parsing macros/cross_db_utils/_is_relation.sql
2022-06-20 16:24:17 normalization > 16:23:48.635397 [debug] [MainThread]: Parsing macros/cross_db_utils/right.sql
2022-06-20 16:24:17 normalization > 16:23:48.639418 [debug] [MainThread]: Parsing macros/cross_db_utils/split_part.sql
2022-06-20 16:24:17 normalization > 16:23:48.642917 [debug] [MainThread]: Parsing macros/cross_db_utils/datediff.sql
2022-06-20 16:24:17 normalization > 16:23:48.663832 [debug] [MainThread]: Parsing macros/cross_db_utils/datatypes.sql
2022-06-20 16:24:17 normalization > 16:23:48.674624 [debug] [MainThread]: Parsing macros/cross_db_utils/concat.sql
2022-06-20 16:24:17 normalization > 16:23:48.676522 [debug] [MainThread]: Parsing macros/cross_db_utils/identifier.sql
2022-06-20 16:24:17 normalization > 16:23:48.679387 [debug] [MainThread]: Parsing macros/sql/get_tables_by_prefix_sql.sql
2022-06-20 16:24:17 normalization > 16:23:48.682266 [debug] [MainThread]: Parsing macros/sql/get_column_values.sql
2022-06-20 16:24:17 normalization > 16:23:48.691917 [debug] [MainThread]: Parsing macros/sql/get_query_results_as_dict.sql
2022-06-20 16:24:17 normalization > 16:23:48.696091 [debug] [MainThread]: Parsing macros/sql/get_relations_by_pattern.sql
2022-06-20 16:24:17 normalization > 16:23:48.702079 [debug] [MainThread]: Parsing macros/sql/get_relations_by_prefix.sql
2022-06-20 16:24:17 normalization > 16:23:48.708382 [debug] [MainThread]: Parsing macros/sql/haversine_distance.sql
2022-06-20 16:24:17 normalization > 16:23:48.719436 [debug] [MainThread]: Parsing macros/sql/get_tables_by_pattern_sql.sql
2022-06-20 16:24:17 normalization > 16:23:48.731560 [debug] [MainThread]: Parsing macros/sql/pivot.sql
2022-06-20 16:24:17 normalization > 16:23:48.740198 [debug] [MainThread]: Parsing macros/sql/date_spine.sql
2022-06-20 16:24:17 normalization > 16:23:48.747862 [debug] [MainThread]: Parsing macros/sql/star.sql
2022-06-20 16:24:17 normalization > 16:23:48.755611 [debug] [MainThread]: Parsing macros/sql/union.sql
2022-06-20 16:24:17 normalization > 16:23:48.775821 [debug] [MainThread]: Parsing macros/sql/get_table_types_sql.sql
2022-06-20 16:24:17 normalization > 16:23:48.778416 [debug] [MainThread]: Parsing macros/sql/safe_add.sql
2022-06-20 16:24:17 normalization > 16:23:48.781951 [debug] [MainThread]: Parsing macros/sql/surrogate_key.sql
2022-06-20 16:24:17 normalization > 16:23:48.788140 [debug] [MainThread]: Parsing macros/sql/groupby.sql
2022-06-20 16:24:17 normalization > 16:23:48.790499 [debug] [MainThread]: Parsing macros/sql/generate_series.sql
2022-06-20 16:24:17 normalization > 16:23:48.798183 [debug] [MainThread]: Parsing macros/sql/nullcheck.sql
2022-06-20 16:24:17 normalization > 16:23:48.801133 [debug] [MainThread]: Parsing macros/sql/unpivot.sql
2022-06-20 16:24:17 normalization > 16:23:48.816060 [debug] [MainThread]: Parsing macros/sql/nullcheck_table.sql
2022-06-20 16:24:17 normalization > 16:23:48.819084 [debug] [MainThread]: Parsing macros/jinja_helpers/log_info.sql
2022-06-20 16:24:17 normalization > 16:23:48.820932 [debug] [MainThread]: Parsing macros/jinja_helpers/pretty_time.sql
2022-06-20 16:24:17 normalization > 16:23:48.822952 [debug] [MainThread]: Parsing macros/jinja_helpers/slugify.sql
2022-06-20 16:24:17 normalization > 16:23:48.824886 [debug] [MainThread]: Parsing macros/jinja_helpers/pretty_log_format.sql
2022-06-20 16:24:17 normalization > 16:23:49.587010 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/raw_checkmate/vendor_config_scd.sql
2022-06-20 16:24:17 normalization > 16:23:49.668548 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/raw_checkmate/vendor_config_scd.sql
2022-06-20 16:24:17 normalization > 16:23:49.671596 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/raw_checkmate/bank_config_scd.sql
2022-06-20 16:24:17 normalization > 16:23:49.705544 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/raw_checkmate/bank_config_scd.sql
2022-06-20 16:24:17 normalization > 16:23:49.708398 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql
2022-06-20 16:24:17 normalization > 16:23:49.744176 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql
2022-06-20 16:24:17 normalization > 16:23:49.747017 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/scd/raw_checkmate/inbound_file_metadata_scd.sql
2022-06-20 16:24:17 normalization > 16:23:49.851041 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/scd/raw_checkmate/inbound_file_metadata_scd.sql
2022-06-20 16:24:17 normalization > 16:23:49.853351 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/raw_checkmate/inbound_file_metadata.sql
2022-06-20 16:24:17 normalization > 16:23:49.869493 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/raw_checkmate/inbound_file_metadata.sql
2022-06-20 16:24:17 normalization > 16:23:49.871683 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/raw_checkmate/bank_config.sql
2022-06-20 16:24:17 normalization > 16:23:49.883287 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/raw_checkmate/bank_config.sql
2022-06-20 16:24:17 normalization > 16:23:49.885556 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/raw_checkmate/deposit.sql
2022-06-20 16:24:17 normalization > 16:23:49.897066 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/raw_checkmate/deposit.sql
2022-06-20 16:24:17 normalization > 16:23:49.899179 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_incremental/raw_checkmate/vendor_config.sql
2022-06-20 16:24:17 normalization > 16:23:49.910536 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_incremental/raw_checkmate/vendor_config.sql
2022-06-20 16:24:17 normalization > 16:23:49.915036 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/bank_config_ab2.sql
2022-06-20 16:24:17 normalization > 16:23:49.944980 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/bank_config_ab2.sql
2022-06-20 16:24:17 normalization > 16:23:49.947312 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/inbound_file_metadata_ab2.sql
2022-06-20 16:24:17 normalization > 16:23:49.964622 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/inbound_file_metadata_ab2.sql
2022-06-20 16:24:17 normalization > 16:23:49.967010 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/bank_config_ab1.sql
2022-06-20 16:24:17 normalization > 16:23:50.006105 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/bank_config_ab1.sql
2022-06-20 16:24:17 normalization > 16:23:50.008645 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/deposit_ab1.sql
2022-06-20 16:24:17 normalization > 16:23:50.058077 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/deposit_ab1.sql
2022-06-20 16:24:17 normalization > 16:23:50.060403 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/vendor_config_ab2.sql
2022-06-20 16:24:17 normalization > 16:23:50.078545 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/vendor_config_ab2.sql
2022-06-20 16:24:17 normalization > 16:23:50.081094 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/deposit_ab2.sql
2022-06-20 16:24:17 normalization > 16:23:50.113109 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/deposit_ab2.sql
2022-06-20 16:24:17 normalization > 16:23:50.115384 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/inbound_file_metadata_ab1.sql
2022-06-20 16:24:17 normalization > 16:23:50.138275 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/inbound_file_metadata_ab1.sql
2022-06-20 16:24:17 normalization > 16:23:50.140564 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_ctes/raw_checkmate/vendor_config_ab1.sql
2022-06-20 16:24:17 normalization > 16:23:50.163967 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_ctes/raw_checkmate/vendor_config_ab1.sql
2022-06-20 16:24:17 normalization > 16:23:50.166152 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/raw_checkmate/vendor_config_stg.sql
2022-06-20 16:24:17 normalization > 16:23:50.182988 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/raw_checkmate/vendor_config_stg.sql
2022-06-20 16:24:17 normalization > 16:23:50.185268 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/raw_checkmate/deposit_stg.sql
2022-06-20 16:24:17 normalization > 16:23:50.209203 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/raw_checkmate/deposit_stg.sql
2022-06-20 16:24:17 normalization > 16:23:50.211962 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/raw_checkmate/bank_config_stg.sql
2022-06-20 16:24:17 normalization > 16:23:50.229098 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/raw_checkmate/bank_config_stg.sql
2022-06-20 16:24:17 normalization > 16:23:50.231378 [debug] [MainThread]: 1603: static parser failed on generated/airbyte_views/raw_checkmate/inbound_file_metadata_stg.sql
2022-06-20 16:24:17 normalization > 16:23:50.249726 [debug] [MainThread]: 1602: parser fallback to jinja rendering on generated/airbyte_views/raw_checkmate/inbound_file_metadata_stg.sql
2022-06-20 16:24:17 normalization > 16:23:50.370952 [warn ] [MainThread]: [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources.
2022-06-20 16:24:17 normalization > There are 1 unused configuration paths:
2022-06-20 16:24:17 normalization > - models.airbyte_utils.generated.airbyte_tables
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 16:23:50.403283 [info ] [MainThread]: Found 20 models, 0 tests, 0 snapshots, 0 analyses, 548 macros, 0 operations, 0 seed files, 4 sources, 0 exposures, 0 metrics
2022-06-20 16:24:17 normalization > 16:23:50.406801 [info ] [MainThread]: 
2022-06-20 16:24:17 normalization > 16:23:50.408094 [debug] [MainThread]: Acquiring new bigquery connection "master"
2022-06-20 16:24:17 normalization > 16:23:50.410678 [debug] [ThreadPool]: Acquiring new bigquery connection "list_mainapi-282501"
2022-06-20 16:24:17 normalization > 16:23:50.411067 [debug] [ThreadPool]: Opening a new connection, currently in state init
2022-06-20 16:24:17 normalization > 16:23:50.413131 [debug] [ThreadPool]: Acquiring new bigquery connection "list_mainapi-282501"
2022-06-20 16:24:17 normalization > 16:23:50.413660 [debug] [ThreadPool]: Opening a new connection, currently in state init
2022-06-20 16:24:17 normalization > 16:23:50.669065 [debug] [ThreadPool]: Acquiring new bigquery connection "create_mainapi-282501__airbyte_raw_checkmate"
2022-06-20 16:24:17 normalization > 16:23:50.669969 [debug] [ThreadPool]: Acquiring new bigquery connection "create_mainapi-282501__airbyte_raw_checkmate"
2022-06-20 16:24:17 normalization > 16:23:50.670195 [debug] [ThreadPool]: BigQuery adapter: Creating schema "mainapi-282501._airbyte_raw_checkmate".
2022-06-20 16:24:17 normalization > 16:23:50.670425 [debug] [ThreadPool]: Opening a new connection, currently in state closed
2022-06-20 16:24:17 normalization > 16:23:50.925224 [debug] [ThreadPool]: Acquiring new bigquery connection "list_mainapi-282501_raw_checkmate"
2022-06-20 16:24:17 normalization > 16:23:50.926532 [debug] [ThreadPool]: Acquiring new bigquery connection "list_mainapi-282501__airbyte_raw_checkmate"
2022-06-20 16:24:17 normalization > 16:23:50.926817 [debug] [ThreadPool]: Opening a new connection, currently in state closed
2022-06-20 16:24:17 normalization > 16:23:50.927302 [debug] [ThreadPool]: Opening a new connection, currently in state closed
2022-06-20 16:24:17 normalization > 16:23:51.083629 [info ] [MainThread]: Concurrency: 8 threads (target='prod')
2022-06-20 16:24:17 normalization > 16:23:51.084219 [info ] [MainThread]: 
2022-06-20 16:24:17 normalization > 16:23:51.111190 [debug] [Thread-1  ]: Began running node model.airbyte_utils.bank_config_ab1
2022-06-20 16:24:17 normalization > 16:23:51.111671 [debug] [Thread-2  ]: Began running node model.airbyte_utils.deposit_ab1
2022-06-20 16:24:17 normalization > 16:23:51.112652 [debug] [Thread-1  ]: Acquiring new bigquery connection "model.airbyte_utils.bank_config_ab1"
2022-06-20 16:24:17 normalization > 16:23:51.112978 [debug] [Thread-3  ]: Began running node model.airbyte_utils.inbound_file_metadata_ab1
2022-06-20 16:24:17 normalization > 16:23:51.113387 [debug] [Thread-4  ]: Began running node model.airbyte_utils.vendor_config_ab1
2022-06-20 16:24:17 normalization > 16:23:51.114389 [debug] [Thread-2  ]: Acquiring new bigquery connection "model.airbyte_utils.deposit_ab1"
2022-06-20 16:24:17 normalization > 16:23:51.114769 [debug] [Thread-1  ]: Began compiling node model.airbyte_utils.bank_config_ab1
2022-06-20 16:24:17 normalization > 16:23:51.115971 [debug] [Thread-3  ]: Acquiring new bigquery connection "model.airbyte_utils.inbound_file_metadata_ab1"
2022-06-20 16:24:17 normalization > 16:23:51.116884 [debug] [Thread-4  ]: Acquiring new bigquery connection "model.airbyte_utils.vendor_config_ab1"
2022-06-20 16:24:17 normalization > 16:23:51.117178 [debug] [Thread-2  ]: Began compiling node model.airbyte_utils.deposit_ab1
2022-06-20 16:24:17 normalization > 16:23:51.117527 [debug] [Thread-1  ]: Compiling model.airbyte_utils.bank_config_ab1
2022-06-20 16:24:17 normalization > 16:23:51.117865 [debug] [Thread-3  ]: Began compiling node model.airbyte_utils.inbound_file_metadata_ab1
2022-06-20 16:24:17 normalization > 16:23:51.118308 [debug] [Thread-4  ]: Began compiling node model.airbyte_utils.vendor_config_ab1
2022-06-20 16:24:17 normalization > 16:23:51.118639 [debug] [Thread-2  ]: Compiling model.airbyte_utils.deposit_ab1
2022-06-20 16:24:17 normalization > 16:23:51.147643 [debug] [Thread-1  ]: Writing injected SQL for node "model.airbyte_utils.bank_config_ab1"
2022-06-20 16:24:17 normalization > 16:23:51.148022 [debug] [Thread-3  ]: Compiling model.airbyte_utils.inbound_file_metadata_ab1
2022-06-20 16:24:17 normalization > 16:23:51.148373 [debug] [Thread-4  ]: Compiling model.airbyte_utils.vendor_config_ab1
2022-06-20 16:24:17 normalization > 16:23:51.203040 [debug] [Thread-2  ]: Writing injected SQL for node "model.airbyte_utils.deposit_ab1"
2022-06-20 16:24:17 normalization > 16:23:51.227488 [debug] [Thread-4  ]: Writing injected SQL for node "model.airbyte_utils.vendor_config_ab1"
2022-06-20 16:24:17 normalization > 16:23:51.229952 [debug] [Thread-4  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:51.231009 [debug] [Thread-4  ]: Finished running node model.airbyte_utils.vendor_config_ab1
2022-06-20 16:24:17 normalization > 16:23:51.248235 [debug] [Thread-2  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:51.254796 [debug] [Thread-2  ]: Finished running node model.airbyte_utils.deposit_ab1
2022-06-20 16:24:17 normalization > 16:23:51.255114 [debug] [Thread-1  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:51.258519 [debug] [Thread-3  ]: Writing injected SQL for node "model.airbyte_utils.inbound_file_metadata_ab1"
2022-06-20 16:24:17 normalization > 16:23:51.259084 [debug] [Thread-6  ]: Began running node model.airbyte_utils.vendor_config_ab2
2022-06-20 16:24:17 normalization > 16:23:51.260100 [debug] [Thread-8  ]: Began running node model.airbyte_utils.deposit_ab2
2022-06-20 16:24:17 normalization > 16:23:51.261242 [debug] [Thread-1  ]: Finished running node model.airbyte_utils.bank_config_ab1
2022-06-20 16:24:17 normalization > 16:23:51.262513 [debug] [Thread-6  ]: Acquiring new bigquery connection "model.airbyte_utils.vendor_config_ab2"
2022-06-20 16:24:17 normalization > 16:23:51.263532 [debug] [Thread-8  ]: Acquiring new bigquery connection "model.airbyte_utils.deposit_ab2"
2022-06-20 16:24:17 normalization > 16:23:51.263762 [debug] [Thread-3  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:51.264680 [debug] [Thread-6  ]: Began compiling node model.airbyte_utils.vendor_config_ab2
2022-06-20 16:24:17 normalization > 16:23:51.264951 [debug] [Thread-4  ]: Began running node model.airbyte_utils.bank_config_ab2
2022-06-20 16:24:17 normalization > 16:23:51.265284 [debug] [Thread-8  ]: Began compiling node model.airbyte_utils.deposit_ab2
2022-06-20 16:24:17 normalization > 16:23:51.266171 [debug] [Thread-3  ]: Finished running node model.airbyte_utils.inbound_file_metadata_ab1
2022-06-20 16:24:17 normalization > 16:23:51.266632 [debug] [Thread-6  ]: Compiling model.airbyte_utils.vendor_config_ab2
2022-06-20 16:24:17 normalization > 16:23:51.267575 [debug] [Thread-4  ]: Acquiring new bigquery connection "model.airbyte_utils.bank_config_ab2"
2022-06-20 16:24:17 normalization > 16:23:51.267942 [debug] [Thread-8  ]: Compiling model.airbyte_utils.deposit_ab2
2022-06-20 16:24:17 normalization > 16:23:51.268900 [debug] [Thread-2  ]: Began running node model.airbyte_utils.inbound_file_metadata_ab2
2022-06-20 16:24:17 normalization > 16:23:51.284961 [debug] [Thread-4  ]: Began compiling node model.airbyte_utils.bank_config_ab2
2022-06-20 16:24:17 normalization > 16:23:51.321022 [debug] [Thread-6  ]: Writing injected SQL for node "model.airbyte_utils.vendor_config_ab2"
2022-06-20 16:24:17 normalization > 16:23:51.342998 [debug] [Thread-2  ]: Acquiring new bigquery connection "model.airbyte_utils.inbound_file_metadata_ab2"
2022-06-20 16:24:17 normalization > 16:23:51.368447 [debug] [Thread-4  ]: Compiling model.airbyte_utils.bank_config_ab2
2022-06-20 16:24:17 normalization > 16:23:51.401431 [debug] [Thread-8  ]: Writing injected SQL for node "model.airbyte_utils.deposit_ab2"
2022-06-20 16:24:17 normalization > 16:23:51.401945 [debug] [Thread-2  ]: Began compiling node model.airbyte_utils.inbound_file_metadata_ab2
2022-06-20 16:24:17 normalization > 16:23:51.402385 [debug] [Thread-6  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:51.445185 [debug] [Thread-2  ]: Compiling model.airbyte_utils.inbound_file_metadata_ab2
2022-06-20 16:24:17 normalization > 16:23:51.450497 [debug] [Thread-4  ]: Writing injected SQL for node "model.airbyte_utils.bank_config_ab2"
2022-06-20 16:24:17 normalization > 16:23:51.451084 [debug] [Thread-8  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:51.452144 [debug] [Thread-6  ]: Finished running node model.airbyte_utils.vendor_config_ab2
2022-06-20 16:24:17 normalization > 16:23:51.487802 [debug] [Thread-2  ]: Writing injected SQL for node "model.airbyte_utils.inbound_file_metadata_ab2"
2022-06-20 16:24:17 normalization > 16:23:51.488277 [debug] [Thread-4  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:51.489323 [debug] [Thread-8  ]: Finished running node model.airbyte_utils.deposit_ab2
2022-06-20 16:24:17 normalization > 16:23:51.490491 [debug] [Thread-1  ]: Began running node model.airbyte_utils.vendor_config_stg
2022-06-20 16:24:17 normalization > 16:23:51.491022 [debug] [Thread-2  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:51.491810 [debug] [Thread-4  ]: Finished running node model.airbyte_utils.bank_config_ab2
2022-06-20 16:24:17 normalization > 16:23:51.492485 [info ] [Thread-1  ]: 1 of 12 START view model _airbyte_raw_checkmate.vendor_config_stg....................................................... [RUN]
2022-06-20 16:24:17 normalization > 16:23:51.493589 [debug] [Thread-2  ]: Finished running node model.airbyte_utils.inbound_file_metadata_ab2
2022-06-20 16:24:17 normalization > 16:23:51.494026 [debug] [Thread-3  ]: Began running node model.airbyte_utils.deposit_stg
2022-06-20 16:24:17 normalization > 16:23:51.494854 [debug] [Thread-6  ]: Began running node model.airbyte_utils.bank_config_stg
2022-06-20 16:24:17 normalization > 16:23:51.496168 [debug] [Thread-1  ]: Acquiring new bigquery connection "model.airbyte_utils.vendor_config_stg"
2022-06-20 16:24:17 normalization > 16:23:51.497341 [info ] [Thread-3  ]: 2 of 12 START view model _airbyte_raw_checkmate.deposit_stg............................................................. [RUN]
2022-06-20 16:24:17 normalization > 16:23:51.500414 [debug] [Thread-3  ]: Acquiring new bigquery connection "model.airbyte_utils.deposit_stg"
2022-06-20 16:24:17 normalization > 16:23:51.498268 [info ] [Thread-6  ]: 3 of 12 START view model _airbyte_raw_checkmate.bank_config_stg......................................................... [RUN]
2022-06-20 16:24:17 normalization > 16:23:51.498771 [debug] [Thread-1  ]: Began compiling node model.airbyte_utils.vendor_config_stg
2022-06-20 16:24:17 normalization > 16:23:51.500698 [debug] [Thread-3  ]: Began compiling node model.airbyte_utils.deposit_stg
2022-06-20 16:24:17 normalization > 16:23:51.497685 [debug] [Thread-8  ]: Began running node model.airbyte_utils.inbound_file_metadata_stg
2022-06-20 16:24:17 normalization > 16:23:51.502131 [debug] [Thread-6  ]: Acquiring new bigquery connection "model.airbyte_utils.bank_config_stg"
2022-06-20 16:24:17 normalization > 16:23:51.502579 [debug] [Thread-1  ]: Compiling model.airbyte_utils.vendor_config_stg
2022-06-20 16:24:17 normalization > 16:23:51.502922 [debug] [Thread-3  ]: Compiling model.airbyte_utils.deposit_stg
2022-06-20 16:24:17 normalization > 16:23:51.503483 [info ] [Thread-8  ]: 4 of 12 START view model _airbyte_raw_checkmate.inbound_file_metadata_stg............................................... [RUN]
2022-06-20 16:24:17 normalization > 16:23:51.503830 [debug] [Thread-6  ]: Began compiling node model.airbyte_utils.bank_config_stg
2022-06-20 16:24:17 normalization > 16:23:51.559412 [debug] [Thread-8  ]: Acquiring new bigquery connection "model.airbyte_utils.inbound_file_metadata_stg"
2022-06-20 16:24:17 normalization > 16:23:51.585155 [debug] [Thread-1  ]: Writing injected SQL for node "model.airbyte_utils.vendor_config_stg"
2022-06-20 16:24:17 normalization > 16:23:51.590949 [debug] [Thread-6  ]: Compiling model.airbyte_utils.bank_config_stg
2022-06-20 16:24:17 normalization > 16:23:51.617092 [debug] [Thread-8  ]: Began compiling node model.airbyte_utils.inbound_file_metadata_stg
2022-06-20 16:24:17 normalization > 16:23:51.641280 [debug] [Thread-3  ]: Writing injected SQL for node "model.airbyte_utils.deposit_stg"
2022-06-20 16:24:17 normalization > 16:23:51.674402 [debug] [Thread-8  ]: Compiling model.airbyte_utils.inbound_file_metadata_stg
2022-06-20 16:24:17 normalization > 16:23:51.684783 [debug] [Thread-1  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:51.695979 [debug] [Thread-6  ]: Writing injected SQL for node "model.airbyte_utils.bank_config_stg"
2022-06-20 16:24:17 normalization > 16:23:51.717870 [debug] [Thread-3  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:51.733507 [debug] [Thread-1  ]: Began executing node model.airbyte_utils.vendor_config_stg
2022-06-20 16:24:17 normalization > 16:23:51.734126 [debug] [Thread-8  ]: Writing injected SQL for node "model.airbyte_utils.inbound_file_metadata_stg"
2022-06-20 16:24:17 normalization > 16:23:51.734888 [debug] [Thread-3  ]: Began executing node model.airbyte_utils.deposit_stg
2022-06-20 16:24:17 normalization > 16:23:51.740593 [debug] [Thread-6  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:51.783841 [debug] [Thread-6  ]: Began executing node model.airbyte_utils.bank_config_stg
2022-06-20 16:24:17 normalization > 16:23:51.819793 [debug] [Thread-1  ]: Writing runtime SQL for node "model.airbyte_utils.vendor_config_stg"
2022-06-20 16:24:17 normalization > 16:23:51.822022 [debug] [Thread-3  ]: Writing runtime SQL for node "model.airbyte_utils.deposit_stg"
2022-06-20 16:24:17 normalization > 16:23:51.828563 [debug] [Thread-6  ]: Writing runtime SQL for node "model.airbyte_utils.bank_config_stg"
2022-06-20 16:24:17 normalization > 16:23:51.828872 [debug] [Thread-8  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:51.831300 [debug] [Thread-8  ]: Began executing node model.airbyte_utils.inbound_file_metadata_stg
2022-06-20 16:24:17 normalization > 16:23:51.837611 [debug] [Thread-8  ]: Writing runtime SQL for node "model.airbyte_utils.inbound_file_metadata_stg"
2022-06-20 16:24:17 normalization > 16:23:51.838872 [debug] [Thread-8  ]: Opening a new connection, currently in state closed
2022-06-20 16:24:17 normalization > 16:23:51.839501 [debug] [Thread-1  ]: Opening a new connection, currently in state closed
2022-06-20 16:24:17 normalization > 16:23:51.840199 [debug] [Thread-3  ]: Opening a new connection, currently in state closed
2022-06-20 16:24:17 normalization > 16:23:51.841098 [debug] [Thread-6  ]: Opening a new connection, currently in state closed
2022-06-20 16:24:17 normalization > 16:23:51.849665 [debug] [Thread-8  ]: On model.airbyte_utils.inbound_file_metadata_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.inbound_file_metadata_stg"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   create or replace view `mainapi-282501`._airbyte_raw_checkmate.`inbound_file_metadata_stg`
2022-06-20 16:24:17 normalization >   OPTIONS()
2022-06-20 16:24:17 normalization >   as 
2022-06-20 16:24:17 normalization > with __dbt__cte__inbound_file_metadata_ab1 as (
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema
2022-06-20 16:24:17 normalization > -- depends_on: `mainapi-282501`.raw_checkmate._airbyte_raw_inbound_file_metadata
2022-06-20 16:24:17 normalization > select
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['file_hash']") as file_hash,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['file_name']") as file_name,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_ch']") as timestamp_ch,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_cr']") as timestamp_cr,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['inbound_file_metadata_id']") as inbound_file_metadata_id,
2022-06-20 16:24:17 normalization >     _airbyte_ab_id,
2022-06-20 16:24:17 normalization >     _airbyte_emitted_at,
2022-06-20 16:24:17 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:24:17 normalization > from `mainapi-282501`.raw_checkmate._airbyte_raw_inbound_file_metadata as table_alias
2022-06-20 16:24:17 normalization > -- inbound_file_metadata
2022-06-20 16:24:17 normalization > where 1 = 1
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > ),  __dbt__cte__inbound_file_metadata_ab2 as (
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type
2022-06-20 16:24:17 normalization > -- depends_on: __dbt__cte__inbound_file_metadata_ab1
2022-06-20 16:24:17 normalization > select
2022-06-20 16:24:17 normalization >     cast(file_hash as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as file_hash,
2022-06-20 16:24:17 normalization >     cast(file_name as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as file_name,
2022-06-20 16:24:17 normalization >     cast(_ab_cdc_lsn as 
2022-06-20 16:24:17 normalization >     float64
2022-06-20 16:24:17 normalization > ) as _ab_cdc_lsn,
2022-06-20 16:24:17 normalization >     cast(nullif(timestamp_ch, '') as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) as timestamp_ch,
2022-06-20 16:24:17 normalization >     cast(nullif(timestamp_cr, '') as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) as timestamp_cr,
2022-06-20 16:24:17 normalization >     cast(_ab_cdc_deleted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as _ab_cdc_deleted_at,
2022-06-20 16:24:17 normalization >     cast(_ab_cdc_updated_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as _ab_cdc_updated_at,
2022-06-20 16:24:17 normalization >     cast(inbound_file_metadata_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as inbound_file_metadata_id,
2022-06-20 16:24:17 normalization >     _airbyte_ab_id,
2022-06-20 16:24:17 normalization >     _airbyte_emitted_at,
2022-06-20 16:24:17 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:24:17 normalization > from __dbt__cte__inbound_file_metadata_ab1
2022-06-20 16:24:17 normalization > -- inbound_file_metadata
2022-06-20 16:24:17 normalization > where 1 = 1
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > )-- SQL model to build a hash column based on the values of this record
2022-06-20 16:24:17 normalization > -- depends_on: __dbt__cte__inbound_file_metadata_ab2
2022-06-20 16:24:17 normalization > select
2022-06-20 16:24:17 normalization >     to_hex(md5(cast(concat(coalesce(cast(file_hash as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(file_name as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(timestamp_ch as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(timestamp_cr as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(inbound_file_metadata_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), '')) as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ))) as _airbyte_inbound_file_metadata_hashid,
2022-06-20 16:24:17 normalization >     tmp.*
2022-06-20 16:24:17 normalization > from __dbt__cte__inbound_file_metadata_ab2 tmp
2022-06-20 16:24:17 normalization > -- inbound_file_metadata
2022-06-20 16:24:17 normalization > where 1 = 1
2022-06-20 16:24:17 normalization > ;
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 16:23:51.850351 [debug] [Thread-3  ]: On model.airbyte_utils.deposit_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.deposit_stg"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   create or replace view `mainapi-282501`._airbyte_raw_checkmate.`deposit_stg`
2022-06-20 16:24:17 normalization >   OPTIONS()
2022-06-20 16:24:17 normalization >   as 
2022-06-20 16:24:17 normalization > with __dbt__cte__deposit_ab1 as (
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema
2022-06-20 16:24:17 normalization > -- depends_on: `mainapi-282501`.raw_checkmate._airbyte_raw_deposit
2022-06-20 16:24:17 normalization > select
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['micr']") as micr,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['amount']") as amount,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['status']") as status,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['bank_id']") as bank_id,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['currency']") as currency,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['party_id']") as party_id,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['account_id']") as account_id,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['deposit_id']") as deposit_id,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['partner_id']") as partner_id,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['party_type']") as party_type,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['vendor_info']") as vendor_info,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['check_amount']") as check_amount,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['check_number']") as check_number,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_ch']") as timestamp_ch,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_cr']") as timestamp_cr,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_de']") as timestamp_de,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['back_image_id']") as back_image_id,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['date_captured']") as date_captured,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['account_number']") as account_number,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['date_processed']") as date_processed,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['front_image_id']") as front_image_id,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['transaction_id']") as transaction_id,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['ocr_account_number']") as ocr_account_number,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['vendor_reference_id']") as vendor_reference_id,
2022-06-20 16:24:17 normalization >     _airbyte_ab_id,
2022-06-20 16:24:17 normalization >     _airbyte_emitted_at,
2022-06-20 16:24:17 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:24:17 normalization > from `mainapi-282501`.raw_checkmate._airbyte_raw_deposit as table_alias
2022-06-20 16:24:17 normalization > -- deposit
2022-06-20 16:24:17 normalization > where 1 = 1
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > ),  __dbt__cte__deposit_ab2 as (
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type
2022-06-20 16:24:17 normalization > -- depends_on: __dbt__cte__deposit_ab1
2022-06-20 16:24:17 normalization > select
2022-06-20 16:24:17 normalization >     cast(micr as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as micr,
2022-06-20 16:24:17 normalization >     cast(amount as 
2022-06-20 16:24:17 normalization >     float64
2022-06-20 16:24:17 normalization > ) as amount,
2022-06-20 16:24:17 normalization >     cast(status as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as status,
2022-06-20 16:24:17 normalization >     cast(bank_id as 
2022-06-20 16:24:17 normalization >     float64
2022-06-20 16:24:17 normalization > ) as bank_id,
2022-06-20 16:24:17 normalization >     cast(currency as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as currency,
2022-06-20 16:24:17 normalization >     cast(party_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as party_id,
2022-06-20 16:24:17 normalization >     cast(account_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as account_id,
2022-06-20 16:24:17 normalization >     cast(deposit_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as deposit_id,
2022-06-20 16:24:17 normalization >     cast(partner_id as 
2022-06-20 16:24:17 normalization >     float64
2022-06-20 16:24:17 normalization > ) as partner_id,
2022-06-20 16:24:17 normalization >     cast(party_type as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as party_type,
2022-06-20 16:24:17 normalization >     cast(_ab_cdc_lsn as 
2022-06-20 16:24:17 normalization >     float64
2022-06-20 16:24:17 normalization > ) as _ab_cdc_lsn,
2022-06-20 16:24:17 normalization >     cast(vendor_info as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as vendor_info,
2022-06-20 16:24:17 normalization >     cast(check_amount as 
2022-06-20 16:24:17 normalization >     float64
2022-06-20 16:24:17 normalization > ) as check_amount,
2022-06-20 16:24:17 normalization >     cast(check_number as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as check_number,
2022-06-20 16:24:17 normalization >     cast(nullif(timestamp_ch, '') as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) as timestamp_ch,
2022-06-20 16:24:17 normalization >     cast(nullif(timestamp_cr, '') as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) as timestamp_cr,
2022-06-20 16:24:17 normalization >     cast(nullif(timestamp_de, '') as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) as timestamp_de,
2022-06-20 16:24:17 normalization >     cast(back_image_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as back_image_id,
2022-06-20 16:24:17 normalization >     cast(nullif(date_captured, '') as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) as date_captured,
2022-06-20 16:24:17 normalization >     cast(account_number as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as account_number,
2022-06-20 16:24:17 normalization >     cast(nullif(date_processed, '') as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) as date_processed,
2022-06-20 16:24:17 normalization >     cast(front_image_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as front_image_id,
2022-06-20 16:24:17 normalization >     cast(transaction_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as transaction_id,
2022-06-20 16:24:17 normalization >     cast(_ab_cdc_deleted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as _ab_cdc_deleted_at,
2022-06-20 16:24:17 normalization >     cast(_ab_cdc_updated_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as _ab_cdc_updated_at,
2022-06-20 16:24:17 normalization >     cast(ocr_account_number as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as ocr_account_number,
2022-06-20 16:24:17 normalization >     cast(vendor_reference_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as vendor_reference_id,
2022-06-20 16:24:17 normalization >     _airbyte_ab_id,
2022-06-20 16:24:17 normalization >     _airbyte_emitted_at,
2022-06-20 16:24:17 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:24:17 normalization > from __dbt__cte__deposit_ab1
2022-06-20 16:24:17 normalization > -- deposit
2022-06-20 16:24:17 normalization > where 1 = 1
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > )-- SQL model to build a hash column based on the values of this record
2022-06-20 16:24:17 normalization > -- depends_on: __dbt__cte__deposit_ab2
2022-06-20 16:24:17 normalization > select
2022-06-20 16:24:17 normalization >     to_hex(md5(cast(concat(coalesce(cast(micr as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(amount as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(status as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(bank_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(currency as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(party_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(account_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(deposit_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(partner_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(party_type as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(vendor_info as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(check_amount as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(check_number as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(timestamp_ch as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(timestamp_cr as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(timestamp_de as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(back_image_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(date_captured as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(account_number as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(date_processed as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(front_image_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(transaction_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(ocr_account_number as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(vendor_reference_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), '')) as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ))) as _airbyte_deposit_hashid,
2022-06-20 16:24:17 normalization >     tmp.*
2022-06-20 16:24:17 normalization > from __dbt__cte__deposit_ab2 tmp
2022-06-20 16:24:17 normalization > -- deposit
2022-06-20 16:24:17 normalization > where 1 = 1
2022-06-20 16:24:17 normalization > ;
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 16:23:51.850933 [debug] [Thread-1  ]: On model.airbyte_utils.vendor_config_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.vendor_config_stg"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   create or replace view `mainapi-282501`._airbyte_raw_checkmate.`vendor_config_stg`
2022-06-20 16:24:17 normalization >   OPTIONS()
2022-06-20 16:24:17 normalization >   as 
2022-06-20 16:24:17 normalization > with __dbt__cte__vendor_config_ab1 as (
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema
2022-06-20 16:24:17 normalization > -- depends_on: `mainapi-282501`.raw_checkmate._airbyte_raw_vendor_config
2022-06-20 16:24:17 normalization > select
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['name']") as name,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_ch']") as timestamp_ch,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_cr']") as timestamp_cr,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['vendor_config_id']") as vendor_config_id,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['inbound_upload_path']") as inbound_upload_path,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['outbound_upload_path']") as outbound_upload_path,
2022-06-20 16:24:17 normalization >     _airbyte_ab_id,
2022-06-20 16:24:17 normalization >     _airbyte_emitted_at,
2022-06-20 16:24:17 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:24:17 normalization > from `mainapi-282501`.raw_checkmate._airbyte_raw_vendor_config as table_alias
2022-06-20 16:24:17 normalization > -- vendor_config
2022-06-20 16:24:17 normalization > where 1 = 1
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > ),  __dbt__cte__vendor_config_ab2 as (
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type
2022-06-20 16:24:17 normalization > -- depends_on: __dbt__cte__vendor_config_ab1
2022-06-20 16:24:17 normalization > select
2022-06-20 16:24:17 normalization >     cast(name as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as name,
2022-06-20 16:24:17 normalization >     cast(_ab_cdc_lsn as 
2022-06-20 16:24:17 normalization >     float64
2022-06-20 16:24:17 normalization > ) as _ab_cdc_lsn,
2022-06-20 16:24:17 normalization >     cast(nullif(timestamp_ch, '') as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) as timestamp_ch,
2022-06-20 16:24:17 normalization >     cast(nullif(timestamp_cr, '') as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) as timestamp_cr,
2022-06-20 16:24:17 normalization >     cast(vendor_config_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as vendor_config_id,
2022-06-20 16:24:17 normalization >     cast(_ab_cdc_deleted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as _ab_cdc_deleted_at,
2022-06-20 16:24:17 normalization >     cast(_ab_cdc_updated_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as _ab_cdc_updated_at,
2022-06-20 16:24:17 normalization >     cast(inbound_upload_path as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as inbound_upload_path,
2022-06-20 16:24:17 normalization >     cast(outbound_upload_path as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as outbound_upload_path,
2022-06-20 16:24:17 normalization >     _airbyte_ab_id,
2022-06-20 16:24:17 normalization >     _airbyte_emitted_at,
2022-06-20 16:24:17 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:24:17 normalization > from __dbt__cte__vendor_config_ab1
2022-06-20 16:24:17 normalization > -- vendor_config
2022-06-20 16:24:17 normalization > where 1 = 1
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > )-- SQL model to build a hash column based on the values of this record
2022-06-20 16:24:17 normalization > -- depends_on: __dbt__cte__vendor_config_ab2
2022-06-20 16:24:17 normalization > select
2022-06-20 16:24:17 normalization >     to_hex(md5(cast(concat(coalesce(cast(name as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(timestamp_ch as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(timestamp_cr as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(vendor_config_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(inbound_upload_path as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(outbound_upload_path as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), '')) as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ))) as _airbyte_vendor_config_hashid,
2022-06-20 16:24:17 normalization >     tmp.*
2022-06-20 16:24:17 normalization > from __dbt__cte__vendor_config_ab2 tmp
2022-06-20 16:24:17 normalization > -- vendor_config
2022-06-20 16:24:17 normalization > where 1 = 1
2022-06-20 16:24:17 normalization > ;
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 16:23:51.851294 [debug] [Thread-6  ]: On model.airbyte_utils.bank_config_stg: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.bank_config_stg"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   create or replace view `mainapi-282501`._airbyte_raw_checkmate.`bank_config_stg`
2022-06-20 16:24:17 normalization >   OPTIONS()
2022-06-20 16:24:17 normalization >   as 
2022-06-20 16:24:17 normalization > with __dbt__cte__bank_config_ab1 as (
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > -- SQL model to parse JSON blob stored in a single column and extract into separated field columns as described by the JSON Schema
2022-06-20 16:24:17 normalization > -- depends_on: `mainapi-282501`.raw_checkmate._airbyte_raw_bank_config
2022-06-20 16:24:17 normalization > select
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['name']") as name,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['bank_id']") as bank_id,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_lsn']") as _ab_cdc_lsn,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_ch']") as timestamp_ch,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['timestamp_cr']") as timestamp_cr,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['hold_duration']") as hold_duration,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['bank_config_id']") as bank_config_id,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['vendor_bank_id']") as vendor_bank_id,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_deleted_at']") as _ab_cdc_deleted_at,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['_ab_cdc_updated_at']") as _ab_cdc_updated_at,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['inbound_upload_path']") as inbound_upload_path,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['outbound_upload_path']") as outbound_upload_path,
2022-06-20 16:24:17 normalization >     json_extract_scalar(_airbyte_data, "$['hold_amount_percentage']") as hold_amount_percentage,
2022-06-20 16:24:17 normalization >     _airbyte_ab_id,
2022-06-20 16:24:17 normalization >     _airbyte_emitted_at,
2022-06-20 16:24:17 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:24:17 normalization > from `mainapi-282501`.raw_checkmate._airbyte_raw_bank_config as table_alias
2022-06-20 16:24:17 normalization > -- bank_config
2022-06-20 16:24:17 normalization > where 1 = 1
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > ),  __dbt__cte__bank_config_ab2 as (
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > -- SQL model to cast each column to its adequate SQL type converted from the JSON schema type
2022-06-20 16:24:17 normalization > -- depends_on: __dbt__cte__bank_config_ab1
2022-06-20 16:24:17 normalization > select
2022-06-20 16:24:17 normalization >     cast(name as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as name,
2022-06-20 16:24:17 normalization >     cast(bank_id as 
2022-06-20 16:24:17 normalization >     float64
2022-06-20 16:24:17 normalization > ) as bank_id,
2022-06-20 16:24:17 normalization >     cast(_ab_cdc_lsn as 
2022-06-20 16:24:17 normalization >     float64
2022-06-20 16:24:17 normalization > ) as _ab_cdc_lsn,
2022-06-20 16:24:17 normalization >     cast(nullif(timestamp_ch, '') as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) as timestamp_ch,
2022-06-20 16:24:17 normalization >     cast(nullif(timestamp_cr, '') as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) as timestamp_cr,
2022-06-20 16:24:17 normalization >     cast(hold_duration as 
2022-06-20 16:24:17 normalization >     float64
2022-06-20 16:24:17 normalization > ) as hold_duration,
2022-06-20 16:24:17 normalization >     cast(bank_config_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as bank_config_id,
2022-06-20 16:24:17 normalization >     cast(vendor_bank_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as vendor_bank_id,
2022-06-20 16:24:17 normalization >     cast(_ab_cdc_deleted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as _ab_cdc_deleted_at,
2022-06-20 16:24:17 normalization >     cast(_ab_cdc_updated_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as _ab_cdc_updated_at,
2022-06-20 16:24:17 normalization >     cast(inbound_upload_path as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as inbound_upload_path,
2022-06-20 16:24:17 normalization >     cast(outbound_upload_path as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ) as outbound_upload_path,
2022-06-20 16:24:17 normalization >     cast(hold_amount_percentage as 
2022-06-20 16:24:17 normalization >     float64
2022-06-20 16:24:17 normalization > ) as hold_amount_percentage,
2022-06-20 16:24:17 normalization >     _airbyte_ab_id,
2022-06-20 16:24:17 normalization >     _airbyte_emitted_at,
2022-06-20 16:24:17 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at
2022-06-20 16:24:17 normalization > from __dbt__cte__bank_config_ab1
2022-06-20 16:24:17 normalization > -- bank_config
2022-06-20 16:24:17 normalization > where 1 = 1
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > )-- SQL model to build a hash column based on the values of this record
2022-06-20 16:24:17 normalization > -- depends_on: __dbt__cte__bank_config_ab2
2022-06-20 16:24:17 normalization > select
2022-06-20 16:24:17 normalization >     to_hex(md5(cast(concat(coalesce(cast(name as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(bank_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_lsn as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(timestamp_ch as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(timestamp_cr as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(hold_duration as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(bank_config_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(vendor_bank_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(inbound_upload_path as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(outbound_upload_path as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(hold_amount_percentage as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), '')) as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ))) as _airbyte_bank_config_hashid,
2022-06-20 16:24:17 normalization >     tmp.*
2022-06-20 16:24:17 normalization > from __dbt__cte__bank_config_ab2 tmp
2022-06-20 16:24:17 normalization > -- bank_config
2022-06-20 16:24:17 normalization > where 1 = 1
2022-06-20 16:24:17 normalization > ;
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 16:23:52.467399 [debug] [Thread-8  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:52.468728 [info ] [Thread-8  ]: 4 of 12 OK created view model _airbyte_raw_checkmate.inbound_file_metadata_stg.......................................... [OK in 0.91s]
2022-06-20 16:24:17 normalization > 16:23:52.471202 [debug] [Thread-8  ]: Finished running node model.airbyte_utils.inbound_file_metadata_stg
2022-06-20 16:24:17 normalization > 16:23:52.472448 [debug] [Thread-4  ]: Began running node model.airbyte_utils.inbound_file_metadata_scd
2022-06-20 16:24:17 normalization > 16:23:52.472914 [info ] [Thread-4  ]: 5 of 12 START incremental model raw_checkmate.inbound_file_metadata_scd................................................. [RUN]
2022-06-20 16:24:17 normalization > 16:23:52.474305 [debug] [Thread-4  ]: Acquiring new bigquery connection "model.airbyte_utils.inbound_file_metadata_scd"
2022-06-20 16:24:17 normalization > 16:23:52.474562 [debug] [Thread-4  ]: Began compiling node model.airbyte_utils.inbound_file_metadata_scd
2022-06-20 16:24:17 normalization > 16:23:52.474787 [debug] [Thread-4  ]: Compiling model.airbyte_utils.inbound_file_metadata_scd
2022-06-20 16:24:17 normalization > 16:23:52.514000 [debug] [Thread-4  ]: Opening a new connection, currently in state closed
2022-06-20 16:24:17 normalization > 16:23:52.519817 [debug] [Thread-1  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:52.521432 [info ] [Thread-1  ]: 1 of 12 OK created view model _airbyte_raw_checkmate.vendor_config_stg.................................................. [OK in 1.03s]
2022-06-20 16:24:17 normalization > 16:23:52.525740 [debug] [Thread-1  ]: Finished running node model.airbyte_utils.vendor_config_stg
2022-06-20 16:24:17 normalization > 16:23:52.530357 [debug] [Thread-2  ]: Began running node model.airbyte_utils.vendor_config_scd
2022-06-20 16:24:17 normalization > 16:23:52.531154 [info ] [Thread-2  ]: 6 of 12 START incremental model raw_checkmate.vendor_config_scd......................................................... [RUN]
2022-06-20 16:24:17 normalization > 16:23:52.532594 [debug] [Thread-2  ]: Acquiring new bigquery connection "model.airbyte_utils.vendor_config_scd"
2022-06-20 16:24:17 normalization > 16:23:52.535219 [debug] [Thread-2  ]: Began compiling node model.airbyte_utils.vendor_config_scd
2022-06-20 16:24:17 normalization > 16:23:52.537553 [debug] [Thread-2  ]: Compiling model.airbyte_utils.vendor_config_scd
2022-06-20 16:24:17 normalization > 16:23:52.625366 [debug] [Thread-3  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:52.627512 [info ] [Thread-3  ]: 2 of 12 OK created view model _airbyte_raw_checkmate.deposit_stg........................................................ [OK in 1.13s]
2022-06-20 16:24:17 normalization > 16:23:52.629471 [debug] [Thread-3  ]: Finished running node model.airbyte_utils.deposit_stg
2022-06-20 16:24:17 normalization > 16:23:52.634193 [debug] [Thread-6  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:52.635715 [info ] [Thread-6  ]: 3 of 12 OK created view model _airbyte_raw_checkmate.bank_config_stg.................................................... [OK in 1.13s]
2022-06-20 16:24:17 normalization > 16:23:52.636841 [debug] [Thread-6  ]: Finished running node model.airbyte_utils.bank_config_stg
2022-06-20 16:24:17 normalization > 16:23:52.643182 [debug] [Thread-8  ]: Began running node model.airbyte_utils.deposit_scd
2022-06-20 16:24:17 normalization > 16:23:52.666726 [debug] [Thread-1  ]: Began running node model.airbyte_utils.bank_config_scd
2022-06-20 16:24:17 normalization > 16:23:52.669620 [debug] [Thread-2  ]: Opening a new connection, currently in state closed
2022-06-20 16:24:17 normalization > 16:23:52.671071 [info ] [Thread-8  ]: 7 of 12 START incremental model raw_checkmate.deposit_scd............................................................... [RUN]
2022-06-20 16:24:17 normalization > 16:23:52.673444 [info ] [Thread-1  ]: 8 of 12 START incremental model raw_checkmate.bank_config_scd........................................................... [RUN]
2022-06-20 16:24:17 normalization > 16:23:52.676203 [debug] [Thread-8  ]: Acquiring new bigquery connection "model.airbyte_utils.deposit_scd"
2022-06-20 16:24:17 normalization > 16:23:52.677862 [debug] [Thread-1  ]: Acquiring new bigquery connection "model.airbyte_utils.bank_config_scd"
2022-06-20 16:24:17 normalization > 16:23:52.678356 [debug] [Thread-8  ]: Began compiling node model.airbyte_utils.deposit_scd
2022-06-20 16:24:17 normalization > 16:23:52.679101 [debug] [Thread-1  ]: Began compiling node model.airbyte_utils.bank_config_scd
2022-06-20 16:24:17 normalization > 16:23:52.679492 [debug] [Thread-8  ]: Compiling model.airbyte_utils.deposit_scd
2022-06-20 16:24:17 normalization > 16:23:52.679870 [debug] [Thread-1  ]: Compiling model.airbyte_utils.bank_config_scd
2022-06-20 16:24:17 normalization > 16:23:52.718089 [debug] [Thread-1  ]: Opening a new connection, currently in state closed
2022-06-20 16:24:17 normalization > 16:23:52.730745 [debug] [Thread-8  ]: Writing injected SQL for node "model.airbyte_utils.deposit_scd"
2022-06-20 16:24:17 normalization > 16:23:52.734750 [debug] [Thread-8  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:52.735193 [debug] [Thread-8  ]: Began executing node model.airbyte_utils.deposit_scd
2022-06-20 16:24:17 normalization > 16:23:52.771885 [debug] [Thread-8  ]: Opening a new connection, currently in state closed
2022-06-20 16:24:17 normalization > 16:23:52.908305 [debug] [Thread-8  ]: BigQuery adapter: get_columns_in_relation error: 404 GET https://bigquery.googleapis.com/bigquery/v2/projects/mainapi-282501/datasets/raw_checkmate/tables/deposit_scd?prettyPrint=false: Not found: Table mainapi-282501:raw_checkmate.deposit_scd
2022-06-20 16:24:17 normalization > 16:23:52.931014 [info ] [Thread-8  ]: 16:23:52 + `mainapi-282501`.raw_checkmate.`deposit_scd`._airbyte_ab_id does not exist yet. The table will be created or rebuilt with dbt.full_refresh
2022-06-20 16:24:17 normalization > 16:23:52.992473 [debug] [Thread-8  ]: Writing runtime SQL for node "model.airbyte_utils.deposit_scd"
2022-06-20 16:24:17 normalization > 16:23:53.005308 [debug] [Thread-8  ]: On model.airbyte_utils.deposit_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.deposit_scd"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`deposit_scd`
2022-06-20 16:24:17 normalization >   partition by range_bucket(
2022-06-20 16:24:17 normalization >             _airbyte_active_row,
2022-06-20 16:24:17 normalization >             generate_array(0, 1, 1)
2022-06-20 16:24:17 normalization >         )
2022-06-20 16:24:17 normalization >   cluster by _airbyte_unique_key_scd, _airbyte_emitted_at
2022-06-20 16:24:17 normalization >   OPTIONS()
2022-06-20 16:24:17 normalization >   as (
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > -- depends_on: ref('deposit_stg')
2022-06-20 16:24:17 normalization > with
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > input_data as (
2022-06-20 16:24:17 normalization >     select *
2022-06-20 16:24:17 normalization >     from `mainapi-282501`._airbyte_raw_checkmate.`deposit_stg`
2022-06-20 16:24:17 normalization >     -- deposit from `mainapi-282501`.raw_checkmate._airbyte_raw_deposit
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > scd_data as (
2022-06-20 16:24:17 normalization >     -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key
2022-06-20 16:24:17 normalization >     select
2022-06-20 16:24:17 normalization >       to_hex(md5(cast(concat(coalesce(cast(deposit_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), '')) as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ))) as _airbyte_unique_key,
2022-06-20 16:24:17 normalization >       micr,
2022-06-20 16:24:17 normalization >       amount,
2022-06-20 16:24:17 normalization >       status,
2022-06-20 16:24:17 normalization >       bank_id,
2022-06-20 16:24:17 normalization >       currency,
2022-06-20 16:24:17 normalization >       party_id,
2022-06-20 16:24:17 normalization >       account_id,
2022-06-20 16:24:17 normalization >       deposit_id,
2022-06-20 16:24:17 normalization >       partner_id,
2022-06-20 16:24:17 normalization >       party_type,
2022-06-20 16:24:17 normalization >       _ab_cdc_lsn,
2022-06-20 16:24:17 normalization >       vendor_info,
2022-06-20 16:24:17 normalization >       check_amount,
2022-06-20 16:24:17 normalization >       check_number,
2022-06-20 16:24:17 normalization >       timestamp_ch,
2022-06-20 16:24:17 normalization >       timestamp_cr,
2022-06-20 16:24:17 normalization >       timestamp_de,
2022-06-20 16:24:17 normalization >       back_image_id,
2022-06-20 16:24:17 normalization >       date_captured,
2022-06-20 16:24:17 normalization >       account_number,
2022-06-20 16:24:17 normalization >       date_processed,
2022-06-20 16:24:17 normalization >       front_image_id,
2022-06-20 16:24:17 normalization >       transaction_id,
2022-06-20 16:24:17 normalization >       _ab_cdc_deleted_at,
2022-06-20 16:24:17 normalization >       _ab_cdc_updated_at,
2022-06-20 16:24:17 normalization >       ocr_account_number,
2022-06-20 16:24:17 normalization >       vendor_reference_id,
2022-06-20 16:24:17 normalization >       timestamp_ch as _airbyte_start_at,
2022-06-20 16:24:17 normalization >       lag(timestamp_ch) over (
2022-06-20 16:24:17 normalization >         partition by deposit_id
2022-06-20 16:24:17 normalization >         order by
2022-06-20 16:24:17 normalization >             timestamp_ch is null asc,
2022-06-20 16:24:17 normalization >             timestamp_ch desc,
2022-06-20 16:24:17 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:24:17 normalization >             _airbyte_emitted_at desc
2022-06-20 16:24:17 normalization >       ) as _airbyte_end_at,
2022-06-20 16:24:17 normalization >       case when row_number() over (
2022-06-20 16:24:17 normalization >         partition by deposit_id
2022-06-20 16:24:17 normalization >         order by
2022-06-20 16:24:17 normalization >             timestamp_ch is null asc,
2022-06-20 16:24:17 normalization >             timestamp_ch desc,
2022-06-20 16:24:17 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:24:17 normalization >             _airbyte_emitted_at desc
2022-06-20 16:24:17 normalization >       ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row,
2022-06-20 16:24:17 normalization >       _airbyte_ab_id,
2022-06-20 16:24:17 normalization >       _airbyte_emitted_at,
2022-06-20 16:24:17 normalization >       _airbyte_deposit_hashid
2022-06-20 16:24:17 normalization >     from input_data
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 normalization > dedup_data as (
2022-06-20 16:24:17 normalization >     select
2022-06-20 16:24:17 normalization >         -- we need to ensure de-duplicated rows for merge/update queries
2022-06-20 16:24:17 normalization >         -- additionally, we generate a unique key for the scd table
2022-06-20 16:24:17 normalization >         row_number() over (
2022-06-20 16:24:17 normalization >             partition by
2022-06-20 16:24:17 normalization >                 _airbyte_unique_key,
2022-06-20 16:24:17 normalization >                 _airbyte_start_at,
2022-06-20 16:24:17 normalization >                 _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), cast(_ab_cdc_updated_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > )
2022-06-20 16:24:17 normalization >             order by _airbyte_active_row desc, _airbyte_ab_id
2022-06-20 16:24:17 normalization >         ) as _airbyte_row_num,
2022-06-20 16:24:17 normalization >         to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), '')) as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ))) as _airbyte_unique_key_scd,
2022-06-20 16:24:17 normalization >         scd_data.*
2022-06-20 16:24:17 normalization >     from scd_data
2022-06-20 16:24:17 normalization > )
2022-06-20 16:24:17 normalization > select
2022-06-20 16:24:17 normalization >     _airbyte_unique_key,
2022-06-20 16:24:17 normalization >     _airbyte_unique_key_scd,
2022-06-20 16:24:17 normalization >     micr,
2022-06-20 16:24:17 normalization >     amount,
2022-06-20 16:24:17 normalization >     status,
2022-06-20 16:24:17 normalization >     bank_id,
2022-06-20 16:24:17 normalization >     currency,
2022-06-20 16:24:17 normalization >     party_id,
2022-06-20 16:24:17 normalization >     account_id,
2022-06-20 16:24:17 normalization >     deposit_id,
2022-06-20 16:24:17 normalization >     partner_id,
2022-06-20 16:24:17 normalization >     party_type,
2022-06-20 16:24:17 normalization >     _ab_cdc_lsn,
2022-06-20 16:24:17 normalization >     vendor_info,
2022-06-20 16:24:17 normalization >     check_amount,
2022-06-20 16:24:17 normalization >     check_number,
2022-06-20 16:24:17 normalization >     timestamp_ch,
2022-06-20 16:24:17 normalization >     timestamp_cr,
2022-06-20 16:24:17 normalization >     timestamp_de,
2022-06-20 16:24:17 normalization >     back_image_id,
2022-06-20 16:24:17 normalization >     date_captured,
2022-06-20 16:24:17 normalization >     account_number,
2022-06-20 16:24:17 normalization >     date_processed,
2022-06-20 16:24:17 normalization >     front_image_id,
2022-06-20 16:24:17 normalization >     transaction_id,
2022-06-20 16:24:17 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:24:17 normalization >     _ab_cdc_updated_at,
2022-06-20 16:24:17 normalization >     ocr_account_number,
2022-06-20 16:24:17 normalization >     vendor_reference_id,
2022-06-20 16:24:17 normalization >     _airbyte_start_at,
2022-06-20 16:24:17 normalization >     _airbyte_end_at,
2022-06-20 16:24:17 normalization >     _airbyte_active_row,
2022-06-20 16:24:17 normalization >     _airbyte_ab_id,
2022-06-20 16:24:17 normalization >     _airbyte_emitted_at,
2022-06-20 16:24:17 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:24:17 normalization >     _airbyte_deposit_hashid
2022-06-20 16:24:17 normalization > from dedup_data where _airbyte_row_num = 1
2022-06-20 16:24:17 normalization >   );
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 16:23:53.298001 [debug] [Thread-2  ]: Writing injected SQL for node "model.airbyte_utils.vendor_config_scd"
2022-06-20 16:24:17 normalization > 16:23:53.298778 [debug] [Thread-2  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:53.299018 [debug] [Thread-2  ]: Began executing node model.airbyte_utils.vendor_config_scd
2022-06-20 16:24:17 normalization > 16:23:53.330456 [debug] [Thread-1  ]: Writing injected SQL for node "model.airbyte_utils.bank_config_scd"
2022-06-20 16:24:17 normalization > 16:23:53.331121 [debug] [Thread-1  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:53.331349 [debug] [Thread-1  ]: Began executing node model.airbyte_utils.bank_config_scd
2022-06-20 16:24:17 normalization > 16:23:53.361807 [debug] [Thread-4  ]: Writing injected SQL for node "model.airbyte_utils.inbound_file_metadata_scd"
2022-06-20 16:24:17 normalization > 16:23:53.362619 [debug] [Thread-4  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:53.362862 [debug] [Thread-4  ]: Began executing node model.airbyte_utils.inbound_file_metadata_scd
2022-06-20 16:24:17 normalization > 16:23:53.394259 [debug] [Thread-1  ]: On model.airbyte_utils.bank_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.bank_config_scd"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`bank_config_scd__dbt_tmp`
2022-06-20 16:24:17 normalization >   partition by range_bucket(
2022-06-20 16:24:17 normalization >             _airbyte_active_row,
2022-06-20 16:24:17 normalization >             generate_array(0, 1, 1)
2022-06-20 16:24:17 normalization >         )
2022-06-20 16:24:17 normalization >   cluster by _airbyte_unique_key_scd, _airbyte_emitted_at
2022-06-20 16:24:17 normalization >   OPTIONS(
2022-06-20 16:24:17 normalization >       expiration_timestamp=TIMESTAMP_ADD(CURRENT_TIMESTAMP(), INTERVAL 12 hour)
2022-06-20 16:24:17 normalization >     )
2022-06-20 16:24:17 normalization >   as (
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > -- depends_on: ref('bank_config_stg')
2022-06-20 16:24:17 normalization > with
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > new_data as (
2022-06-20 16:24:17 normalization >     -- retrieve incremental "new" data
2022-06-20 16:24:17 normalization >     select
2022-06-20 16:24:17 normalization >         *
2022-06-20 16:24:17 normalization >     from `mainapi-282501`._airbyte_raw_checkmate.`bank_config_stg`
2022-06-20 16:24:17 normalization >     -- bank_config from `mainapi-282501`.raw_checkmate._airbyte_raw_bank_config
2022-06-20 16:24:17 normalization >     where 1 = 1
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > and coalesce(
2022-06-20 16:24:17 normalization >     cast(_airbyte_emitted_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) >= (select max(cast(_airbyte_emitted_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > )) from `mainapi-282501`.raw_checkmate.`bank_config_scd`),
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     true)
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 normalization > new_data_ids as (
2022-06-20 16:24:17 normalization >     -- build a subset of _airbyte_unique_key from rows that are new
2022-06-20 16:24:17 normalization >     select distinct
2022-06-20 16:24:17 normalization >         to_hex(md5(cast(concat(coalesce(cast(bank_config_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), '')) as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ))) as _airbyte_unique_key
2022-06-20 16:24:17 normalization >     from new_data
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 normalization > empty_new_data as (
2022-06-20 16:24:17 normalization >     -- build an empty table to only keep the table's column types
2022-06-20 16:24:17 normalization >     select * from new_data where 1 = 0
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 normalization > previous_active_scd_data as (
2022-06-20 16:24:17 normalization >     -- retrieve "incomplete old" data that needs to be updated with an end date because of new changes
2022-06-20 16:24:17 normalization >     select
2022-06-20 16:24:17 normalization >         this_data.`_airbyte_bank_config_hashid`,
2022-06-20 16:24:17 normalization >   this_data.`name`,
2022-06-20 16:24:17 normalization >   this_data.`bank_id`,
2022-06-20 16:24:17 normalization >   this_data.`_ab_cdc_lsn`,
2022-06-20 16:24:17 normalization >   this_data.`timestamp_ch`,
2022-06-20 16:24:17 normalization >   this_data.`timestamp_cr`,
2022-06-20 16:24:17 normalization >   this_data.`hold_duration`,
2022-06-20 16:24:17 normalization >   this_data.`bank_config_id`,
2022-06-20 16:24:17 normalization >   this_data.`vendor_bank_id`,
2022-06-20 16:24:17 normalization >   this_data.`_ab_cdc_deleted_at`,
2022-06-20 16:24:17 normalization >   this_data.`_ab_cdc_updated_at`,
2022-06-20 16:24:17 normalization >   this_data.`inbound_upload_path`,
2022-06-20 16:24:17 normalization >   this_data.`outbound_upload_path`,
2022-06-20 16:24:17 normalization >   this_data.`hold_amount_percentage`,
2022-06-20 16:24:17 normalization >   this_data.`_airbyte_ab_id`,
2022-06-20 16:24:17 normalization >   this_data.`_airbyte_emitted_at`,
2022-06-20 16:24:17 normalization >   this_data.`_airbyte_normalized_at`
2022-06-20 16:24:17 normalization >     from `mainapi-282501`.raw_checkmate.`bank_config_scd` as this_data
2022-06-20 16:24:17 normalization >     -- make a join with new_data using primary key to filter active data that need to be updated only
2022-06-20 16:24:17 normalization >     join new_data_ids on this_data._airbyte_unique_key = new_data_ids._airbyte_unique_key
2022-06-20 16:24:17 normalization >     -- force left join to NULL values (we just need to transfer column types only for the star_intersect macro on schema changes)
2022-06-20 16:24:17 normalization >     left join empty_new_data as inc_data on this_data._airbyte_ab_id = inc_data._airbyte_ab_id
2022-06-20 16:24:17 normalization >     where _airbyte_active_row = 1
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 normalization > input_data as (
2022-06-20 16:24:17 normalization >     select `_airbyte_bank_config_hashid`,
2022-06-20 16:24:17 normalization >   `name`,
2022-06-20 16:24:17 normalization >   `bank_id`,
2022-06-20 16:24:17 normalization >   `_ab_cdc_lsn`,
2022-06-20 16:24:17 normalization >   `timestamp_ch`,
2022-06-20 16:24:17 normalization >   `timestamp_cr`,
2022-06-20 16:24:17 normalization >   `hold_duration`,
2022-06-20 16:24:17 normalization >   `bank_config_id`,
2022-06-20 16:24:17 normalization >   `vendor_bank_id`,
2022-06-20 16:24:17 normalization >   `_ab_cdc_deleted_at`,
2022-06-20 16:24:17 normalization >   `_ab_cdc_updated_at`,
2022-06-20 16:24:17 normalization >   `inbound_upload_path`,
2022-06-20 16:24:17 normalization >   `outbound_upload_path`,
2022-06-20 16:24:17 normalization >   `hold_amount_percentage`,
2022-06-20 16:24:17 normalization >   `_airbyte_ab_id`,
2022-06-20 16:24:17 normalization >   `_airbyte_emitted_at`,
2022-06-20 16:24:17 normalization >   `_airbyte_normalized_at` from new_data
2022-06-20 16:24:17 normalization >     union all
2022-06-20 16:24:17 normalization >     select `_airbyte_bank_config_hashid`,
2022-06-20 16:24:17 normalization >   `name`,
2022-06-20 16:24:17 normalization >   `bank_id`,
2022-06-20 16:24:17 normalization >   `_ab_cdc_lsn`,
2022-06-20 16:24:17 normalization >   `timestamp_ch`,
2022-06-20 16:24:17 normalization >   `timestamp_cr`,
2022-06-20 16:24:17 normalization >   `hold_duration`,
2022-06-20 16:24:17 normalization >   `bank_config_id`,
2022-06-20 16:24:17 normalization >   `vendor_bank_id`,
2022-06-20 16:24:17 normalization >   `_ab_cdc_deleted_at`,
2022-06-20 16:24:17 normalization >   `_ab_cdc_updated_at`,
2022-06-20 16:24:17 normalization >   `inbound_upload_path`,
2022-06-20 16:24:17 normalization >   `outbound_upload_path`,
2022-06-20 16:24:17 normalization >   `hold_amount_percentage`,
2022-06-20 16:24:17 normalization >   `_airbyte_ab_id`,
2022-06-20 16:24:17 normalization >   `_airbyte_emitted_at`,
2022-06-20 16:24:17 normalization >   `_airbyte_normalized_at` from previous_active_scd_data
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > scd_data as (
2022-06-20 16:24:17 normalization >     -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key
2022-06-20 16:24:17 normalization >     select
2022-06-20 16:24:17 normalization >       to_hex(md5(cast(concat(coalesce(cast(bank_config_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), '')) as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ))) as _airbyte_unique_key,
2022-06-20 16:24:17 normalization >       name,
2022-06-20 16:24:17 normalization >       bank_id,
2022-06-20 16:24:17 normalization >       _ab_cdc_lsn,
2022-06-20 16:24:17 normalization >       timestamp_ch,
2022-06-20 16:24:17 normalization >       timestamp_cr,
2022-06-20 16:24:17 normalization >       hold_duration,
2022-06-20 16:24:17 normalization >       bank_config_id,
2022-06-20 16:24:17 normalization >       vendor_bank_id,
2022-06-20 16:24:17 normalization >       _ab_cdc_deleted_at,
2022-06-20 16:24:17 normalization >       _ab_cdc_updated_at,
2022-06-20 16:24:17 normalization >       inbound_upload_path,
2022-06-20 16:24:17 normalization >       outbound_upload_path,
2022-06-20 16:24:17 normalization >       hold_amount_percentage,
2022-06-20 16:24:17 normalization >       timestamp_ch as _airbyte_start_at,
2022-06-20 16:24:17 normalization >       lag(timestamp_ch) over (
2022-06-20 16:24:17 normalization >         partition by bank_config_id
2022-06-20 16:24:17 normalization >         order by
2022-06-20 16:24:17 normalization >             timestamp_ch is null asc,
2022-06-20 16:24:17 normalization >             timestamp_ch desc,
2022-06-20 16:24:17 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:24:17 normalization >             _airbyte_emitted_at desc
2022-06-20 16:24:17 normalization >       ) as _airbyte_end_at,
2022-06-20 16:24:17 normalization >       case when row_number() over (
2022-06-20 16:24:17 normalization >         partition by bank_config_id
2022-06-20 16:24:17 normalization >         order by
2022-06-20 16:24:17 normalization >             timestamp_ch is null asc,
2022-06-20 16:24:17 normalization >             timestamp_ch desc,
2022-06-20 16:24:17 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:24:17 normalization >             _airbyte_emitted_at desc
2022-06-20 16:24:17 normalization >       ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row,
2022-06-20 16:24:17 normalization >       _airbyte_ab_id,
2022-06-20 16:24:17 normalization >       _airbyte_emitted_at,
2022-06-20 16:24:17 normalization >       _airbyte_bank_config_hashid
2022-06-20 16:24:17 normalization >     from input_data
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 normalization > dedup_data as (
2022-06-20 16:24:17 normalization >     select
2022-06-20 16:24:17 normalization >         -- we need to ensure de-duplicated rows for merge/update queries
2022-06-20 16:24:17 normalization >         -- additionally, we generate a unique key for the scd table
2022-06-20 16:24:17 normalization >         row_number() over (
2022-06-20 16:24:17 normalization >             partition by
2022-06-20 16:24:17 normalization >                 _airbyte_unique_key,
2022-06-20 16:24:17 normalization >                 _airbyte_start_at,
2022-06-20 16:24:17 normalization >                 _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), cast(_ab_cdc_updated_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > )
2022-06-20 16:24:17 normalization >             order by _airbyte_active_row desc, _airbyte_ab_id
2022-06-20 16:24:17 normalization >         ) as _airbyte_row_num,
2022-06-20 16:24:17 normalization >         to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), '')) as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ))) as _airbyte_unique_key_scd,
2022-06-20 16:24:17 normalization >         scd_data.*
2022-06-20 16:24:17 normalization >     from scd_data
2022-06-20 16:24:17 normalization > )
2022-06-20 16:24:17 normalization > select
2022-06-20 16:24:17 normalization >     _airbyte_unique_key,
2022-06-20 16:24:17 normalization >     _airbyte_unique_key_scd,
2022-06-20 16:24:17 normalization >     name,
2022-06-20 16:24:17 normalization >     bank_id,
2022-06-20 16:24:17 normalization >     _ab_cdc_lsn,
2022-06-20 16:24:17 normalization >     timestamp_ch,
2022-06-20 16:24:17 normalization >     timestamp_cr,
2022-06-20 16:24:17 normalization >     hold_duration,
2022-06-20 16:24:17 normalization >     bank_config_id,
2022-06-20 16:24:17 normalization >     vendor_bank_id,
2022-06-20 16:24:17 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:24:17 normalization >     _ab_cdc_updated_at,
2022-06-20 16:24:17 normalization >     inbound_upload_path,
2022-06-20 16:24:17 normalization >     outbound_upload_path,
2022-06-20 16:24:17 normalization >     hold_amount_percentage,
2022-06-20 16:24:17 normalization >     _airbyte_start_at,
2022-06-20 16:24:17 normalization >     _airbyte_end_at,
2022-06-20 16:24:17 normalization >     _airbyte_active_row,
2022-06-20 16:24:17 normalization >     _airbyte_ab_id,
2022-06-20 16:24:17 normalization >     _airbyte_emitted_at,
2022-06-20 16:24:17 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:24:17 normalization >     _airbyte_bank_config_hashid
2022-06-20 16:24:17 normalization > from dedup_data where _airbyte_row_num = 1
2022-06-20 16:24:17 normalization >   );
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 16:23:53.399183 [debug] [Thread-2  ]: On model.airbyte_utils.vendor_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.vendor_config_scd"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`vendor_config_scd__dbt_tmp`
2022-06-20 16:24:17 normalization >   partition by range_bucket(
2022-06-20 16:24:17 normalization >             _airbyte_active_row,
2022-06-20 16:24:17 normalization >             generate_array(0, 1, 1)
2022-06-20 16:24:17 normalization >         )
2022-06-20 16:24:17 normalization >   cluster by _airbyte_unique_key_scd, _airbyte_emitted_at
2022-06-20 16:24:17 normalization >   OPTIONS(
2022-06-20 16:24:17 normalization >       expiration_timestamp=TIMESTAMP_ADD(CURRENT_TIMESTAMP(), INTERVAL 12 hour)
2022-06-20 16:24:17 normalization >     )
2022-06-20 16:24:17 normalization >   as (
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > -- depends_on: ref('vendor_config_stg')
2022-06-20 16:24:17 normalization > with
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > new_data as (
2022-06-20 16:24:17 normalization >     -- retrieve incremental "new" data
2022-06-20 16:24:17 normalization >     select
2022-06-20 16:24:17 normalization >         *
2022-06-20 16:24:17 normalization >     from `mainapi-282501`._airbyte_raw_checkmate.`vendor_config_stg`
2022-06-20 16:24:17 normalization >     -- vendor_config from `mainapi-282501`.raw_checkmate._airbyte_raw_vendor_config
2022-06-20 16:24:17 normalization >     where 1 = 1
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > and coalesce(
2022-06-20 16:24:17 normalization >     cast(_airbyte_emitted_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) >= (select max(cast(_airbyte_emitted_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > )) from `mainapi-282501`.raw_checkmate.`vendor_config_scd`),
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     true)
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 normalization > new_data_ids as (
2022-06-20 16:24:17 normalization >     -- build a subset of _airbyte_unique_key from rows that are new
2022-06-20 16:24:17 normalization >     select distinct
2022-06-20 16:24:17 normalization >         to_hex(md5(cast(concat(coalesce(cast(vendor_config_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), '')) as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ))) as _airbyte_unique_key
2022-06-20 16:24:17 normalization >     from new_data
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 normalization > empty_new_data as (
2022-06-20 16:24:17 normalization >     -- build an empty table to only keep the table's column types
2022-06-20 16:24:17 normalization >     select * from new_data where 1 = 0
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 normalization > previous_active_scd_data as (
2022-06-20 16:24:17 normalization >     -- retrieve "incomplete old" data that needs to be updated with an end date because of new changes
2022-06-20 16:24:17 normalization >     select
2022-06-20 16:24:17 normalization >         this_data.`_airbyte_vendor_config_hashid`,
2022-06-20 16:24:17 normalization >   this_data.`name`,
2022-06-20 16:24:17 normalization >   this_data.`_ab_cdc_lsn`,
2022-06-20 16:24:17 normalization >   this_data.`timestamp_ch`,
2022-06-20 16:24:17 normalization >   this_data.`timestamp_cr`,
2022-06-20 16:24:17 normalization >   this_data.`vendor_config_id`,
2022-06-20 16:24:17 normalization >   this_data.`_ab_cdc_deleted_at`,
2022-06-20 16:24:17 normalization >   this_data.`_ab_cdc_updated_at`,
2022-06-20 16:24:17 normalization >   this_data.`inbound_upload_path`,
2022-06-20 16:24:17 normalization >   this_data.`outbound_upload_path`,
2022-06-20 16:24:17 normalization >   this_data.`_airbyte_ab_id`,
2022-06-20 16:24:17 normalization >   this_data.`_airbyte_emitted_at`,
2022-06-20 16:24:17 normalization >   this_data.`_airbyte_normalized_at`
2022-06-20 16:24:17 normalization >     from `mainapi-282501`.raw_checkmate.`vendor_config_scd` as this_data
2022-06-20 16:24:17 normalization >     -- make a join with new_data using primary key to filter active data that need to be updated only
2022-06-20 16:24:17 normalization >     join new_data_ids on this_data._airbyte_unique_key = new_data_ids._airbyte_unique_key
2022-06-20 16:24:17 normalization >     -- force left join to NULL values (we just need to transfer column types only for the star_intersect macro on schema changes)
2022-06-20 16:24:17 normalization >     left join empty_new_data as inc_data on this_data._airbyte_ab_id = inc_data._airbyte_ab_id
2022-06-20 16:24:17 normalization >     where _airbyte_active_row = 1
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):161 - Completing future exceptionally...
io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:63) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at java.lang.Thread.run(Thread.java:833) [?:?]
Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	... 3 more
	Suppressed: io.airbyte.workers.exception.WorkerException: Normalization process wasn't successful
		at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:162) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:48) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at java.lang.Thread.run(Thread.java:833) [?:?]
2022-06-20 16:24:17 normalization > input_data as (
2022-06-20 16:24:17 normalization >     select `_airbyte_vendor_config_hashid`,
2022-06-20 16:24:17 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling...
2022-06-20 16:24:17 normalization >   `name`,
2022-06-20 16:24:17 normalization >   `_ab_cdc_lsn`,
2022-06-20 16:24:17 normalization >   `timestamp_ch`,
2022-06-20 16:24:17 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):236 - Stopping temporal heartbeating...
2022-06-20 16:24:17 normalization >   `timestamp_cr`,
2022-06-20 16:24:17 normalization >   `vendor_config_id`,
2022-06-20 16:24:17 normalization >   `_ab_cdc_deleted_at`,
2022-06-20 16:24:17 normalization >   `_ab_cdc_updated_at`,
2022-06-20 16:24:17 normalization >   `inbound_upload_path`,
2022-06-20 16:24:17 normalization >   `outbound_upload_path`,
2022-06-20 16:24:17 normalization >   `_airbyte_ab_id`,
2022-06-20 16:24:17 normalization >   `_airbyte_emitted_at`,
2022-06-20 16:24:17 normalization >   `_airbyte_normalized_at` from new_data
2022-06-20 16:24:17 normalization >     union all
2022-06-20 16:24:17 normalization >     select `_airbyte_vendor_config_hashid`,
2022-06-20 16:24:17 WARN i.t.i.a.POJOActivityTaskHandler(activityFailureToResult):307 - Activity failure. ActivityId=454a445e-11e7-352d-86f4-207dba1239aa, activityType=Normalize, attempt=1
java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:234) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.normalize(NormalizationActivityImpl.java:75) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at jdk.internal.reflect.GeneratedMethodAccessor419.invoke(Unknown Source) ~[?:?]
	at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?]
	at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?]
	at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?]
	at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?]
	at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?]
	at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?]
	at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?]
	at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?]
	at java.lang.Thread.run(Thread.java:833) [?:?]
Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:56) ~[temporal-serviceclient-1.8.1.jar:?]
	at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:448) ~[temporal-sdk-1.8.1.jar:?]
	at io.temporal.activity.Activity.wrap(Activity.java:51) ~[temporal-sdk-1.8.1.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:138) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:229) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	... 13 more
Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?]
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:132) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:229) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	... 13 more
Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:63) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	... 1 more
Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
	... 1 more
	Suppressed: io.airbyte.workers.exception.WorkerException: Normalization process wasn't successful
		at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:162) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:48) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.19-alpha.jar:?]
		at java.lang.Thread.run(Thread.java:833) [?:?]
2022-06-20 16:24:17 normalization >   `name`,
2022-06-20 16:24:17 normalization >   `_ab_cdc_lsn`,
2022-06-20 16:24:17 normalization >   `timestamp_ch`,
2022-06-20 16:24:17 normalization >   `timestamp_cr`,
2022-06-20 16:24:17 normalization >   `vendor_config_id`,
2022-06-20 16:24:17 normalization >   `_ab_cdc_deleted_at`,
2022-06-20 16:24:17 normalization >   `_ab_cdc_updated_at`,
2022-06-20 16:24:17 normalization >   `inbound_upload_path`,
2022-06-20 16:24:17 normalization >   `outbound_upload_path`,
2022-06-20 16:24:17 normalization >   `_airbyte_ab_id`,
2022-06-20 16:24:17 normalization >   `_airbyte_emitted_at`,
2022-06-20 16:24:17 normalization >   `_airbyte_normalized_at` from previous_active_scd_data
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > scd_data as (
2022-06-20 16:24:17 normalization >     -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key
2022-06-20 16:24:17 normalization >     select
2022-06-20 16:24:17 normalization >       to_hex(md5(cast(concat(coalesce(cast(vendor_config_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), '')) as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ))) as _airbyte_unique_key,
2022-06-20 16:24:17 normalization >       name,
2022-06-20 16:24:17 normalization >       _ab_cdc_lsn,
2022-06-20 16:24:17 normalization >       timestamp_ch,
2022-06-20 16:24:17 normalization >       timestamp_cr,
2022-06-20 16:24:17 normalization >       vendor_config_id,
2022-06-20 16:24:17 normalization >       _ab_cdc_deleted_at,
2022-06-20 16:24:17 normalization >       _ab_cdc_updated_at,
2022-06-20 16:24:17 normalization >       inbound_upload_path,
2022-06-20 16:24:17 normalization >       outbound_upload_path,
2022-06-20 16:24:17 normalization >       timestamp_ch as _airbyte_start_at,
2022-06-20 16:24:17 normalization >       lag(timestamp_ch) over (
2022-06-20 16:24:17 normalization >         partition by vendor_config_id
2022-06-20 16:24:17 normalization >         order by
2022-06-20 16:24:17 normalization >             timestamp_ch is null asc,
2022-06-20 16:24:17 normalization >             timestamp_ch desc,
2022-06-20 16:24:17 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:24:17 normalization >             _airbyte_emitted_at desc
2022-06-20 16:24:17 normalization >       ) as _airbyte_end_at,
2022-06-20 16:24:17 normalization >       case when row_number() over (
2022-06-20 16:24:17 normalization >         partition by vendor_config_id
2022-06-20 16:24:17 normalization >         order by
2022-06-20 16:24:17 normalization >             timestamp_ch is null asc,
2022-06-20 16:24:17 normalization >             timestamp_ch desc,
2022-06-20 16:24:17 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:24:17 normalization >             _airbyte_emitted_at desc
2022-06-20 16:24:17 normalization >       ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row,
2022-06-20 16:24:17 normalization >       _airbyte_ab_id,
2022-06-20 16:24:17 normalization >       _airbyte_emitted_at,
2022-06-20 16:24:17 normalization >       _airbyte_vendor_config_hashid
2022-06-20 16:24:17 normalization >     from input_data
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 normalization > dedup_data as (
2022-06-20 16:24:17 normalization >     select
2022-06-20 16:24:17 normalization >         -- we need to ensure de-duplicated rows for merge/update queries
2022-06-20 16:24:17 normalization >         -- additionally, we generate a unique key for the scd table
2022-06-20 16:24:17 normalization >         row_number() over (
2022-06-20 16:24:17 normalization >             partition by
2022-06-20 16:24:17 normalization >                 _airbyte_unique_key,
2022-06-20 16:24:17 normalization >                 _airbyte_start_at,
2022-06-20 16:24:17 normalization >                 _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), cast(_ab_cdc_updated_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > )
2022-06-20 16:24:17 normalization >             order by _airbyte_active_row desc, _airbyte_ab_id
2022-06-20 16:24:17 normalization >         ) as _airbyte_row_num,
2022-06-20 16:24:17 normalization >         to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), '')) as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ))) as _airbyte_unique_key_scd,
2022-06-20 16:24:17 normalization >         scd_data.*
2022-06-20 16:24:17 normalization >     from scd_data
2022-06-20 16:24:17 normalization > )
2022-06-20 16:24:17 normalization > select
2022-06-20 16:24:17 normalization >     _airbyte_unique_key,
2022-06-20 16:24:17 normalization >     _airbyte_unique_key_scd,
2022-06-20 16:24:17 normalization >     name,
2022-06-20 16:24:17 normalization >     _ab_cdc_lsn,
2022-06-20 16:24:17 normalization >     timestamp_ch,
2022-06-20 16:24:17 normalization >     timestamp_cr,
2022-06-20 16:24:17 normalization >     vendor_config_id,
2022-06-20 16:24:17 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:24:17 normalization >     _ab_cdc_updated_at,
2022-06-20 16:24:17 normalization >     inbound_upload_path,
2022-06-20 16:24:17 normalization >     outbound_upload_path,
2022-06-20 16:24:17 normalization >     _airbyte_start_at,
2022-06-20 16:24:17 normalization >     _airbyte_end_at,
2022-06-20 16:24:17 normalization >     _airbyte_active_row,
2022-06-20 16:24:17 normalization >     _airbyte_ab_id,
2022-06-20 16:24:17 normalization >     _airbyte_emitted_at,
2022-06-20 16:24:17 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:24:17 normalization >     _airbyte_vendor_config_hashid
2022-06-20 16:24:17 normalization > from dedup_data where _airbyte_row_num = 1
2022-06-20 16:24:17 normalization >   );
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 16:23:53.445509 [debug] [Thread-4  ]: On model.airbyte_utils.inbound_file_metadata_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.inbound_file_metadata_scd"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd__dbt_tmp`
2022-06-20 16:24:17 normalization >   partition by range_bucket(
2022-06-20 16:24:17 normalization >             _airbyte_active_row,
2022-06-20 16:24:17 normalization >             generate_array(0, 1, 1)
2022-06-20 16:24:17 normalization >         )
2022-06-20 16:24:17 normalization >   cluster by _airbyte_unique_key_scd, _airbyte_emitted_at
2022-06-20 16:24:17 normalization >   OPTIONS(
2022-06-20 16:24:17 normalization >       expiration_timestamp=TIMESTAMP_ADD(CURRENT_TIMESTAMP(), INTERVAL 12 hour)
2022-06-20 16:24:17 normalization >     )
2022-06-20 16:24:17 normalization >   as (
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > -- depends_on: ref('inbound_file_metadata_stg')
2022-06-20 16:24:17 normalization > with
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > new_data as (
2022-06-20 16:24:17 normalization >     -- retrieve incremental "new" data
2022-06-20 16:24:17 normalization >     select
2022-06-20 16:24:17 normalization >         *
2022-06-20 16:24:17 normalization >     from `mainapi-282501`._airbyte_raw_checkmate.`inbound_file_metadata_stg`
2022-06-20 16:24:17 normalization >     -- inbound_file_metadata from `mainapi-282501`.raw_checkmate._airbyte_raw_inbound_file_metadata
2022-06-20 16:24:17 normalization >     where 1 = 1
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > and coalesce(
2022-06-20 16:24:17 normalization >     cast(_airbyte_emitted_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) >= (select max(cast(_airbyte_emitted_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > )) from `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd`),
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     true)
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 normalization > new_data_ids as (
2022-06-20 16:24:17 normalization >     -- build a subset of _airbyte_unique_key from rows that are new
2022-06-20 16:24:17 normalization >     select distinct
2022-06-20 16:24:17 normalization >         to_hex(md5(cast(concat(coalesce(cast(inbound_file_metadata_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), '')) as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ))) as _airbyte_unique_key
2022-06-20 16:24:17 normalization >     from new_data
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 normalization > empty_new_data as (
2022-06-20 16:24:17 normalization >     -- build an empty table to only keep the table's column types
2022-06-20 16:24:17 normalization >     select * from new_data where 1 = 0
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 normalization > previous_active_scd_data as (
2022-06-20 16:24:17 normalization >     -- retrieve "incomplete old" data that needs to be updated with an end date because of new changes
2022-06-20 16:24:17 normalization >     select
2022-06-20 16:24:17 normalization >         this_data.`_airbyte_inbound_file_metadata_hashid`,
2022-06-20 16:24:17 normalization >   this_data.`file_hash`,
2022-06-20 16:24:17 normalization >   this_data.`file_name`,
2022-06-20 16:24:17 normalization >   this_data.`_ab_cdc_lsn`,
2022-06-20 16:24:17 normalization >   this_data.`timestamp_ch`,
2022-06-20 16:24:17 normalization >   this_data.`timestamp_cr`,
2022-06-20 16:24:17 normalization >   this_data.`_ab_cdc_deleted_at`,
2022-06-20 16:24:17 normalization >   this_data.`_ab_cdc_updated_at`,
2022-06-20 16:24:17 normalization >   this_data.`inbound_file_metadata_id`,
2022-06-20 16:24:17 normalization >   this_data.`_airbyte_ab_id`,
2022-06-20 16:24:17 normalization >   this_data.`_airbyte_emitted_at`,
2022-06-20 16:24:17 normalization >   this_data.`_airbyte_normalized_at`
2022-06-20 16:24:17 normalization >     from `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd` as this_data
2022-06-20 16:24:17 normalization >     -- make a join with new_data using primary key to filter active data that need to be updated only
2022-06-20 16:24:17 normalization >     join new_data_ids on this_data._airbyte_unique_key = new_data_ids._airbyte_unique_key
2022-06-20 16:24:17 normalization >     -- force left join to NULL values (we just need to transfer column types only for the star_intersect macro on schema changes)
2022-06-20 16:24:17 normalization >     left join empty_new_data as inc_data on this_data._airbyte_ab_id = inc_data._airbyte_ab_id
2022-06-20 16:24:17 normalization >     where _airbyte_active_row = 1
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 normalization > input_data as (
2022-06-20 16:24:17 normalization >     select `_airbyte_inbound_file_metadata_hashid`,
2022-06-20 16:24:17 normalization >   `file_hash`,
2022-06-20 16:24:17 normalization >   `file_name`,
2022-06-20 16:24:17 normalization >   `_ab_cdc_lsn`,
2022-06-20 16:24:17 normalization >   `timestamp_ch`,
2022-06-20 16:24:17 normalization >   `timestamp_cr`,
2022-06-20 16:24:17 normalization >   `_ab_cdc_deleted_at`,
2022-06-20 16:24:17 normalization >   `_ab_cdc_updated_at`,
2022-06-20 16:24:17 normalization >   `inbound_file_metadata_id`,
2022-06-20 16:24:17 normalization >   `_airbyte_ab_id`,
2022-06-20 16:24:17 normalization >   `_airbyte_emitted_at`,
2022-06-20 16:24:17 normalization >   `_airbyte_normalized_at` from new_data
2022-06-20 16:24:17 normalization >     union all
2022-06-20 16:24:17 normalization >     select `_airbyte_inbound_file_metadata_hashid`,
2022-06-20 16:24:17 normalization >   `file_hash`,
2022-06-20 16:24:17 normalization >   `file_name`,
2022-06-20 16:24:17 normalization >   `_ab_cdc_lsn`,
2022-06-20 16:24:17 normalization >   `timestamp_ch`,
2022-06-20 16:24:17 normalization >   `timestamp_cr`,
2022-06-20 16:24:17 normalization >   `_ab_cdc_deleted_at`,
2022-06-20 16:24:17 normalization >   `_ab_cdc_updated_at`,
2022-06-20 16:24:17 normalization >   `inbound_file_metadata_id`,
2022-06-20 16:24:17 normalization >   `_airbyte_ab_id`,
2022-06-20 16:24:17 normalization >   `_airbyte_emitted_at`,
2022-06-20 16:24:17 normalization >   `_airbyte_normalized_at` from previous_active_scd_data
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > scd_data as (
2022-06-20 16:24:17 normalization >     -- SQL model to build a Type 2 Slowly Changing Dimension (SCD) table for each record identified by their primary key
2022-06-20 16:24:17 normalization >     select
2022-06-20 16:24:17 normalization >       to_hex(md5(cast(concat(coalesce(cast(inbound_file_metadata_id as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), '')) as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ))) as _airbyte_unique_key,
2022-06-20 16:24:17 normalization >       file_hash,
2022-06-20 16:24:17 normalization >       file_name,
2022-06-20 16:24:17 normalization >       _ab_cdc_lsn,
2022-06-20 16:24:17 normalization >       timestamp_ch,
2022-06-20 16:24:17 normalization >       timestamp_cr,
2022-06-20 16:24:17 normalization >       _ab_cdc_deleted_at,
2022-06-20 16:24:17 normalization >       _ab_cdc_updated_at,
2022-06-20 16:24:17 normalization >       inbound_file_metadata_id,
2022-06-20 16:24:17 normalization >       timestamp_ch as _airbyte_start_at,
2022-06-20 16:24:17 normalization >       lag(timestamp_ch) over (
2022-06-20 16:24:17 normalization >         partition by inbound_file_metadata_id
2022-06-20 16:24:17 normalization >         order by
2022-06-20 16:24:17 normalization >             timestamp_ch is null asc,
2022-06-20 16:24:17 normalization >             timestamp_ch desc,
2022-06-20 16:24:17 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:24:17 normalization >             _airbyte_emitted_at desc
2022-06-20 16:24:17 normalization >       ) as _airbyte_end_at,
2022-06-20 16:24:17 normalization >       case when row_number() over (
2022-06-20 16:24:17 normalization >         partition by inbound_file_metadata_id
2022-06-20 16:24:17 normalization >         order by
2022-06-20 16:24:17 normalization >             timestamp_ch is null asc,
2022-06-20 16:24:17 normalization >             timestamp_ch desc,
2022-06-20 16:24:17 normalization >             _ab_cdc_updated_at desc,
2022-06-20 16:24:17 normalization >             _airbyte_emitted_at desc
2022-06-20 16:24:17 normalization >       ) = 1 and _ab_cdc_deleted_at is null then 1 else 0 end as _airbyte_active_row,
2022-06-20 16:24:17 normalization >       _airbyte_ab_id,
2022-06-20 16:24:17 normalization >       _airbyte_emitted_at,
2022-06-20 16:24:17 normalization >       _airbyte_inbound_file_metadata_hashid
2022-06-20 16:24:17 normalization >     from input_data
2022-06-20 16:24:17 normalization > ),
2022-06-20 16:24:17 normalization > dedup_data as (
2022-06-20 16:24:17 normalization >     select
2022-06-20 16:24:17 normalization >         -- we need to ensure de-duplicated rows for merge/update queries
2022-06-20 16:24:17 normalization >         -- additionally, we generate a unique key for the scd table
2022-06-20 16:24:17 normalization >         row_number() over (
2022-06-20 16:24:17 normalization >             partition by
2022-06-20 16:24:17 normalization >                 _airbyte_unique_key,
2022-06-20 16:24:17 normalization >                 _airbyte_start_at,
2022-06-20 16:24:17 normalization >                 _airbyte_emitted_at, cast(_ab_cdc_deleted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), cast(_ab_cdc_updated_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > )
2022-06-20 16:24:17 normalization >             order by _airbyte_active_row desc, _airbyte_ab_id
2022-06-20 16:24:17 normalization >         ) as _airbyte_row_num,
2022-06-20 16:24:17 normalization >         to_hex(md5(cast(concat(coalesce(cast(_airbyte_unique_key as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_airbyte_start_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_airbyte_emitted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_deleted_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), ''), '-', coalesce(cast(_ab_cdc_updated_at as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ), '')) as 
2022-06-20 16:24:17 normalization >     string
2022-06-20 16:24:17 normalization > ))) as _airbyte_unique_key_scd,
2022-06-20 16:24:17 normalization >         scd_data.*
2022-06-20 16:24:17 normalization >     from scd_data
2022-06-20 16:24:17 normalization > )
2022-06-20 16:24:17 normalization > select
2022-06-20 16:24:17 normalization >     _airbyte_unique_key,
2022-06-20 16:24:17 normalization >     _airbyte_unique_key_scd,
2022-06-20 16:24:17 normalization >     file_hash,
2022-06-20 16:24:17 normalization >     file_name,
2022-06-20 16:24:17 normalization >     _ab_cdc_lsn,
2022-06-20 16:24:17 normalization >     timestamp_ch,
2022-06-20 16:24:17 normalization >     timestamp_cr,
2022-06-20 16:24:17 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:24:17 normalization >     _ab_cdc_updated_at,
2022-06-20 16:24:17 normalization >     inbound_file_metadata_id,
2022-06-20 16:24:17 normalization >     _airbyte_start_at,
2022-06-20 16:24:17 normalization >     _airbyte_end_at,
2022-06-20 16:24:17 normalization >     _airbyte_active_row,
2022-06-20 16:24:17 normalization >     _airbyte_ab_id,
2022-06-20 16:24:17 normalization >     _airbyte_emitted_at,
2022-06-20 16:24:17 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:24:17 normalization >     _airbyte_inbound_file_metadata_hashid
2022-06-20 16:24:17 normalization > from dedup_data where _airbyte_row_num = 1
2022-06-20 16:24:17 normalization >   );
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 16:23:53.895863 [debug] [Thread-8  ]: BigQuery adapter: Retry attempt 1 of 3 after error: BadRequest('Invalid timestamp string "0000-12-30T00:00:00Z"')
2022-06-20 16:24:17 normalization > 16:23:55.786581 [debug] [Thread-8  ]: BigQuery adapter: Retry attempt 2 of 3 after error: BadRequest('Invalid timestamp string "0000-12-30T00:00:00Z"')
2022-06-20 16:24:17 normalization > 16:23:57.169379 [debug] [Thread-4  ]: 
2022-06-20 16:24:17 normalization >     In `mainapi-282501`.`raw_checkmate`.`inbound_file_metadata_scd`:
2022-06-20 16:24:17 normalization >         Schema changed: False
2022-06-20 16:24:17 normalization >         Source columns not in target: []
2022-06-20 16:24:17 normalization >         Target columns not in source: []
2022-06-20 16:24:17 normalization >         New column types: []
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 16:23:57.204597 [debug] [Thread-4  ]: Writing runtime SQL for node "model.airbyte_utils.inbound_file_metadata_scd"
2022-06-20 16:24:17 normalization > 16:23:57.209228 [debug] [Thread-4  ]: On model.airbyte_utils.inbound_file_metadata_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.inbound_file_metadata_scd"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >         
2022-06-20 16:24:17 normalization >         
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     merge into `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd` as DBT_INTERNAL_DEST
2022-06-20 16:24:17 normalization >         using (
2022-06-20 16:24:17 normalization >           select * from `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd__dbt_tmp`
2022-06-20 16:24:17 normalization >         ) as DBT_INTERNAL_SOURCE
2022-06-20 16:24:17 normalization >         on 
2022-06-20 16:24:17 normalization >             DBT_INTERNAL_SOURCE._airbyte_unique_key_scd = DBT_INTERNAL_DEST._airbyte_unique_key_scd
2022-06-20 16:24:17 normalization >         
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     when matched then update set
2022-06-20 16:24:17 normalization >         `_airbyte_unique_key` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key`,`_airbyte_unique_key_scd` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key_scd`,`file_hash` = DBT_INTERNAL_SOURCE.`file_hash`,`file_name` = DBT_INTERNAL_SOURCE.`file_name`,`_ab_cdc_lsn` = DBT_INTERNAL_SOURCE.`_ab_cdc_lsn`,`timestamp_ch` = DBT_INTERNAL_SOURCE.`timestamp_ch`,`timestamp_cr` = DBT_INTERNAL_SOURCE.`timestamp_cr`,`_ab_cdc_deleted_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_deleted_at`,`_ab_cdc_updated_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_updated_at`,`inbound_file_metadata_id` = DBT_INTERNAL_SOURCE.`inbound_file_metadata_id`,`_airbyte_start_at` = DBT_INTERNAL_SOURCE.`_airbyte_start_at`,`_airbyte_end_at` = DBT_INTERNAL_SOURCE.`_airbyte_end_at`,`_airbyte_active_row` = DBT_INTERNAL_SOURCE.`_airbyte_active_row`,`_airbyte_ab_id` = DBT_INTERNAL_SOURCE.`_airbyte_ab_id`,`_airbyte_emitted_at` = DBT_INTERNAL_SOURCE.`_airbyte_emitted_at`,`_airbyte_normalized_at` = DBT_INTERNAL_SOURCE.`_airbyte_normalized_at`,`_airbyte_inbound_file_metadata_hashid` = DBT_INTERNAL_SOURCE.`_airbyte_inbound_file_metadata_hashid`
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     when not matched then insert
2022-06-20 16:24:17 normalization >         (`_airbyte_unique_key`, `_airbyte_unique_key_scd`, `file_hash`, `file_name`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_file_metadata_id`, `_airbyte_start_at`, `_airbyte_end_at`, `_airbyte_active_row`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_inbound_file_metadata_hashid`)
2022-06-20 16:24:17 normalization >     values
2022-06-20 16:24:17 normalization >         (`_airbyte_unique_key`, `_airbyte_unique_key_scd`, `file_hash`, `file_name`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_file_metadata_id`, `_airbyte_start_at`, `_airbyte_end_at`, `_airbyte_active_row`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_inbound_file_metadata_hashid`)
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 16:23:57.484785 [debug] [Thread-2  ]: 
2022-06-20 16:24:17 normalization >     In `mainapi-282501`.`raw_checkmate`.`vendor_config_scd`:
2022-06-20 16:24:17 normalization >         Schema changed: False
2022-06-20 16:24:17 normalization >         Source columns not in target: []
2022-06-20 16:24:17 normalization >         Target columns not in source: []
2022-06-20 16:24:17 normalization >         New column types: []
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 16:23:57.487233 [debug] [Thread-2  ]: Writing runtime SQL for node "model.airbyte_utils.vendor_config_scd"
2022-06-20 16:24:17 normalization > 16:23:57.487797 [debug] [Thread-2  ]: On model.airbyte_utils.vendor_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.vendor_config_scd"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >         
2022-06-20 16:24:17 normalization >         
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     merge into `mainapi-282501`.raw_checkmate.`vendor_config_scd` as DBT_INTERNAL_DEST
2022-06-20 16:24:17 normalization >         using (
2022-06-20 16:24:17 normalization >           select * from `mainapi-282501`.raw_checkmate.`vendor_config_scd__dbt_tmp`
2022-06-20 16:24:17 normalization >         ) as DBT_INTERNAL_SOURCE
2022-06-20 16:24:17 normalization >         on 
2022-06-20 16:24:17 normalization >             DBT_INTERNAL_SOURCE._airbyte_unique_key_scd = DBT_INTERNAL_DEST._airbyte_unique_key_scd
2022-06-20 16:24:17 normalization >         
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     when matched then update set
2022-06-20 16:24:17 normalization >         `_airbyte_unique_key` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key`,`_airbyte_unique_key_scd` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key_scd`,`name` = DBT_INTERNAL_SOURCE.`name`,`_ab_cdc_lsn` = DBT_INTERNAL_SOURCE.`_ab_cdc_lsn`,`timestamp_ch` = DBT_INTERNAL_SOURCE.`timestamp_ch`,`timestamp_cr` = DBT_INTERNAL_SOURCE.`timestamp_cr`,`vendor_config_id` = DBT_INTERNAL_SOURCE.`vendor_config_id`,`_ab_cdc_deleted_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_deleted_at`,`_ab_cdc_updated_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_updated_at`,`inbound_upload_path` = DBT_INTERNAL_SOURCE.`inbound_upload_path`,`outbound_upload_path` = DBT_INTERNAL_SOURCE.`outbound_upload_path`,`_airbyte_start_at` = DBT_INTERNAL_SOURCE.`_airbyte_start_at`,`_airbyte_end_at` = DBT_INTERNAL_SOURCE.`_airbyte_end_at`,`_airbyte_active_row` = DBT_INTERNAL_SOURCE.`_airbyte_active_row`,`_airbyte_ab_id` = DBT_INTERNAL_SOURCE.`_airbyte_ab_id`,`_airbyte_emitted_at` = DBT_INTERNAL_SOURCE.`_airbyte_emitted_at`,`_airbyte_normalized_at` = DBT_INTERNAL_SOURCE.`_airbyte_normalized_at`,`_airbyte_vendor_config_hashid` = DBT_INTERNAL_SOURCE.`_airbyte_vendor_config_hashid`
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     when not matched then insert
2022-06-20 16:24:17 normalization >         (`_airbyte_unique_key`, `_airbyte_unique_key_scd`, `name`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `vendor_config_id`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_upload_path`, `outbound_upload_path`, `_airbyte_start_at`, `_airbyte_end_at`, `_airbyte_active_row`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_vendor_config_hashid`)
2022-06-20 16:24:17 normalization >     values
2022-06-20 16:24:17 normalization >         (`_airbyte_unique_key`, `_airbyte_unique_key_scd`, `name`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `vendor_config_id`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_upload_path`, `outbound_upload_path`, `_airbyte_start_at`, `_airbyte_end_at`, `_airbyte_active_row`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_vendor_config_hashid`)
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 16:23:57.516430 [debug] [Thread-1  ]: 
2022-06-20 16:24:17 normalization >     In `mainapi-282501`.`raw_checkmate`.`bank_config_scd`:
2022-06-20 16:24:17 normalization >         Schema changed: False
2022-06-20 16:24:17 normalization >         Source columns not in target: []
2022-06-20 16:24:17 normalization >         Target columns not in source: []
2022-06-20 16:24:17 normalization >         New column types: []
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 16:23:57.518920 [debug] [Thread-1  ]: Writing runtime SQL for node "model.airbyte_utils.bank_config_scd"
2022-06-20 16:24:17 normalization > 16:23:57.519616 [debug] [Thread-1  ]: On model.airbyte_utils.bank_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.bank_config_scd"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >         
2022-06-20 16:24:17 normalization >         
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     merge into `mainapi-282501`.raw_checkmate.`bank_config_scd` as DBT_INTERNAL_DEST
2022-06-20 16:24:17 normalization >         using (
2022-06-20 16:24:17 normalization >           select * from `mainapi-282501`.raw_checkmate.`bank_config_scd__dbt_tmp`
2022-06-20 16:24:17 normalization >         ) as DBT_INTERNAL_SOURCE
2022-06-20 16:24:17 normalization >         on 
2022-06-20 16:24:17 normalization >             DBT_INTERNAL_SOURCE._airbyte_unique_key_scd = DBT_INTERNAL_DEST._airbyte_unique_key_scd
2022-06-20 16:24:17 normalization >         
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     when matched then update set
2022-06-20 16:24:17 normalization >         `_airbyte_unique_key` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key`,`_airbyte_unique_key_scd` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key_scd`,`name` = DBT_INTERNAL_SOURCE.`name`,`bank_id` = DBT_INTERNAL_SOURCE.`bank_id`,`_ab_cdc_lsn` = DBT_INTERNAL_SOURCE.`_ab_cdc_lsn`,`timestamp_ch` = DBT_INTERNAL_SOURCE.`timestamp_ch`,`timestamp_cr` = DBT_INTERNAL_SOURCE.`timestamp_cr`,`hold_duration` = DBT_INTERNAL_SOURCE.`hold_duration`,`bank_config_id` = DBT_INTERNAL_SOURCE.`bank_config_id`,`vendor_bank_id` = DBT_INTERNAL_SOURCE.`vendor_bank_id`,`_ab_cdc_deleted_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_deleted_at`,`_ab_cdc_updated_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_updated_at`,`inbound_upload_path` = DBT_INTERNAL_SOURCE.`inbound_upload_path`,`outbound_upload_path` = DBT_INTERNAL_SOURCE.`outbound_upload_path`,`hold_amount_percentage` = DBT_INTERNAL_SOURCE.`hold_amount_percentage`,`_airbyte_start_at` = DBT_INTERNAL_SOURCE.`_airbyte_start_at`,`_airbyte_end_at` = DBT_INTERNAL_SOURCE.`_airbyte_end_at`,`_airbyte_active_row` = DBT_INTERNAL_SOURCE.`_airbyte_active_row`,`_airbyte_ab_id` = DBT_INTERNAL_SOURCE.`_airbyte_ab_id`,`_airbyte_emitted_at` = DBT_INTERNAL_SOURCE.`_airbyte_emitted_at`,`_airbyte_normalized_at` = DBT_INTERNAL_SOURCE.`_airbyte_normalized_at`,`_airbyte_bank_config_hashid` = DBT_INTERNAL_SOURCE.`_airbyte_bank_config_hashid`
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     when not matched then insert
2022-06-20 16:24:17 normalization >         (`_airbyte_unique_key`, `_airbyte_unique_key_scd`, `name`, `bank_id`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `hold_duration`, `bank_config_id`, `vendor_bank_id`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_upload_path`, `outbound_upload_path`, `hold_amount_percentage`, `_airbyte_start_at`, `_airbyte_end_at`, `_airbyte_active_row`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_bank_config_hashid`)
2022-06-20 16:24:17 normalization >     values
2022-06-20 16:24:17 normalization >         (`_airbyte_unique_key`, `_airbyte_unique_key_scd`, `name`, `bank_id`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `hold_duration`, `bank_config_id`, `vendor_bank_id`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_upload_path`, `outbound_upload_path`, `hold_amount_percentage`, `_airbyte_start_at`, `_airbyte_end_at`, `_airbyte_active_row`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_bank_config_hashid`)
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 16:23:57.697754 [debug] [Thread-8  ]: BigQuery adapter: Retry attempt 3 of 3 after error: BadRequest('Invalid timestamp string "0000-12-30T00:00:00Z"')
2022-06-20 16:24:17 normalization > 16:23:59.167657 [debug] [Thread-8  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:23:59.168678 [debug] [Thread-8  ]: Database Error in model deposit_scd (models/generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql)
2022-06-20 16:24:17 normalization >   Invalid timestamp string "0000-12-30T00:00:00Z"
2022-06-20 16:24:17 normalization >   compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql
2022-06-20 16:24:17 normalization > 16:23:59.169273 [error] [Thread-8  ]: 7 of 12 ERROR creating incremental model raw_checkmate.deposit_scd...................................................... [ERROR in 6.49s]
2022-06-20 16:24:17 normalization > 16:23:59.169835 [debug] [Thread-8  ]: Finished running node model.airbyte_utils.deposit_scd
2022-06-20 16:24:17 normalization > 16:23:59.170843 [debug] [Thread-3  ]: Began running node model.airbyte_utils.deposit
2022-06-20 16:24:17 normalization > 16:23:59.171146 [info ] [Thread-3  ]: 9 of 12 SKIP relation raw_checkmate.deposit............................................................................. [SKIP]
2022-06-20 16:24:17 normalization > 16:23:59.171565 [debug] [Thread-3  ]: Finished running node model.airbyte_utils.deposit
2022-06-20 16:24:17 normalization > 16:24:00.105311 [debug] [Thread-4  ]: On model.airbyte_utils.inbound_file_metadata_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.inbound_file_metadata_scd"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >         -- Delete records which are no longer active:
2022-06-20 16:24:17 normalization >                     -- This query is equivalent, but the left join version is more performant:
2022-06-20 16:24:17 normalization >                     -- delete from final_table where unique_key in (
2022-06-20 16:24:17 normalization >                     --     select unique_key from scd_table where 1 = 1 <incremental_clause(normalized_at, final_table)>
2022-06-20 16:24:17 normalization >                     -- ) and unique_key not in (
2022-06-20 16:24:17 normalization >                     --     select unique_key from scd_table where active_row = 1 <incremental_clause(normalized_at, final_table)>
2022-06-20 16:24:17 normalization >                     -- )
2022-06-20 16:24:17 normalization >                     -- We're incremental against normalized_at rather than emitted_at because we need to fetch the SCD
2022-06-20 16:24:17 normalization >                     -- entries that were _updated_ recently. This is because a deleted record will have an SCD record
2022-06-20 16:24:17 normalization >                     -- which was emitted a long time ago, but recently re-normalized to have active_row = 0.
2022-06-20 16:24:17 normalization >                     delete from `mainapi-282501`.`raw_checkmate`.`inbound_file_metadata` final_table where final_table._airbyte_unique_key in (
2022-06-20 16:24:17 normalization >                         select recent_records.unique_key
2022-06-20 16:24:17 normalization >                         from (
2022-06-20 16:24:17 normalization >                                 select distinct _airbyte_unique_key as unique_key
2022-06-20 16:24:17 normalization >                                 from `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd`
2022-06-20 16:24:17 normalization >                                 where 1=1 
2022-06-20 16:24:17 normalization > and coalesce(
2022-06-20 16:24:17 normalization >     cast(_airbyte_normalized_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) >= (select max(cast(_airbyte_normalized_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > )) from raw_checkmate.`inbound_file_metadata`),
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     true)
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >                             ) recent_records
2022-06-20 16:24:17 normalization >                             left join (
2022-06-20 16:24:17 normalization >                                 select _airbyte_unique_key as unique_key, count(_airbyte_unique_key) as active_count
2022-06-20 16:24:17 normalization >                                 from `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd`
2022-06-20 16:24:17 normalization >                                 where _airbyte_active_row = 1 
2022-06-20 16:24:17 normalization > and coalesce(
2022-06-20 16:24:17 normalization >     cast(_airbyte_normalized_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) >= (select max(cast(_airbyte_normalized_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > )) from raw_checkmate.`inbound_file_metadata`),
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     true)
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >                                 group by _airbyte_unique_key
2022-06-20 16:24:17 normalization >                             ) active_counts
2022-06-20 16:24:17 normalization >                             on recent_records.unique_key = active_counts.unique_key
2022-06-20 16:24:17 normalization >                         where active_count is null or active_count = 0
2022-06-20 16:24:17 normalization >                     )
2022-06-20 16:24:17 normalization >       
2022-06-20 16:24:17 normalization > 16:24:00.669107 [debug] [Thread-2  ]: On model.airbyte_utils.vendor_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.vendor_config_scd"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >         -- Delete records which are no longer active:
2022-06-20 16:24:17 normalization >                     -- This query is equivalent, but the left join version is more performant:
2022-06-20 16:24:17 normalization >                     -- delete from final_table where unique_key in (
2022-06-20 16:24:17 normalization >                     --     select unique_key from scd_table where 1 = 1 <incremental_clause(normalized_at, final_table)>
2022-06-20 16:24:17 normalization >                     -- ) and unique_key not in (
2022-06-20 16:24:17 normalization >                     --     select unique_key from scd_table where active_row = 1 <incremental_clause(normalized_at, final_table)>
2022-06-20 16:24:17 normalization >                     -- )
2022-06-20 16:24:17 normalization >                     -- We're incremental against normalized_at rather than emitted_at because we need to fetch the SCD
2022-06-20 16:24:17 normalization >                     -- entries that were _updated_ recently. This is because a deleted record will have an SCD record
2022-06-20 16:24:17 normalization >                     -- which was emitted a long time ago, but recently re-normalized to have active_row = 0.
2022-06-20 16:24:17 normalization >                     delete from `mainapi-282501`.`raw_checkmate`.`vendor_config` final_table where final_table._airbyte_unique_key in (
2022-06-20 16:24:17 normalization >                         select recent_records.unique_key
2022-06-20 16:24:17 normalization >                         from (
2022-06-20 16:24:17 normalization >                                 select distinct _airbyte_unique_key as unique_key
2022-06-20 16:24:17 normalization >                                 from `mainapi-282501`.raw_checkmate.`vendor_config_scd`
2022-06-20 16:24:17 normalization >                                 where 1=1 
2022-06-20 16:24:17 normalization > and coalesce(
2022-06-20 16:24:17 normalization >     cast(_airbyte_normalized_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) >= (select max(cast(_airbyte_normalized_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > )) from raw_checkmate.`vendor_config`),
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     true)
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >                             ) recent_records
2022-06-20 16:24:17 normalization >                             left join (
2022-06-20 16:24:17 normalization >                                 select _airbyte_unique_key as unique_key, count(_airbyte_unique_key) as active_count
2022-06-20 16:24:17 normalization >                                 from `mainapi-282501`.raw_checkmate.`vendor_config_scd`
2022-06-20 16:24:17 normalization >                                 where _airbyte_active_row = 1 
2022-06-20 16:24:17 normalization > and coalesce(
2022-06-20 16:24:17 normalization >     cast(_airbyte_normalized_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) >= (select max(cast(_airbyte_normalized_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > )) from raw_checkmate.`vendor_config`),
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     true)
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >                                 group by _airbyte_unique_key
2022-06-20 16:24:17 normalization >                             ) active_counts
2022-06-20 16:24:17 normalization >                             on recent_records.unique_key = active_counts.unique_key
2022-06-20 16:24:17 normalization >                         where active_count is null or active_count = 0
2022-06-20 16:24:17 normalization >                     )
2022-06-20 16:24:17 normalization >       
2022-06-20 16:24:17 normalization > 16:24:00.719880 [debug] [Thread-1  ]: On model.airbyte_utils.bank_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.bank_config_scd"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >         -- Delete records which are no longer active:
2022-06-20 16:24:17 normalization >                     -- This query is equivalent, but the left join version is more performant:
2022-06-20 16:24:17 normalization >                     -- delete from final_table where unique_key in (
2022-06-20 16:24:17 normalization >                     --     select unique_key from scd_table where 1 = 1 <incremental_clause(normalized_at, final_table)>
2022-06-20 16:24:17 normalization >                     -- ) and unique_key not in (
2022-06-20 16:24:17 normalization >                     --     select unique_key from scd_table where active_row = 1 <incremental_clause(normalized_at, final_table)>
2022-06-20 16:24:17 normalization >                     -- )
2022-06-20 16:24:17 normalization >                     -- We're incremental against normalized_at rather than emitted_at because we need to fetch the SCD
2022-06-20 16:24:17 normalization >                     -- entries that were _updated_ recently. This is because a deleted record will have an SCD record
2022-06-20 16:24:17 normalization >                     -- which was emitted a long time ago, but recently re-normalized to have active_row = 0.
2022-06-20 16:24:17 normalization >                     delete from `mainapi-282501`.`raw_checkmate`.`bank_config` final_table where final_table._airbyte_unique_key in (
2022-06-20 16:24:17 normalization >                         select recent_records.unique_key
2022-06-20 16:24:17 normalization >                         from (
2022-06-20 16:24:17 normalization >                                 select distinct _airbyte_unique_key as unique_key
2022-06-20 16:24:17 normalization >                                 from `mainapi-282501`.raw_checkmate.`bank_config_scd`
2022-06-20 16:24:17 normalization >                                 where 1=1 
2022-06-20 16:24:17 normalization > and coalesce(
2022-06-20 16:24:17 normalization >     cast(_airbyte_normalized_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) >= (select max(cast(_airbyte_normalized_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > )) from raw_checkmate.`bank_config`),
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     true)
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >                             ) recent_records
2022-06-20 16:24:17 normalization >                             left join (
2022-06-20 16:24:17 normalization >                                 select _airbyte_unique_key as unique_key, count(_airbyte_unique_key) as active_count
2022-06-20 16:24:17 normalization >                                 from `mainapi-282501`.raw_checkmate.`bank_config_scd`
2022-06-20 16:24:17 normalization >                                 where _airbyte_active_row = 1 
2022-06-20 16:24:17 normalization > and coalesce(
2022-06-20 16:24:17 normalization >     cast(_airbyte_normalized_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) >= (select max(cast(_airbyte_normalized_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > )) from raw_checkmate.`bank_config`),
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     true)
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >                                 group by _airbyte_unique_key
2022-06-20 16:24:17 normalization >                             ) active_counts
2022-06-20 16:24:17 normalization >                             on recent_records.unique_key = active_counts.unique_key
2022-06-20 16:24:17 normalization >                         where active_count is null or active_count = 0
2022-06-20 16:24:17 normalization >                     )
2022-06-20 16:24:17 normalization >       
2022-06-20 16:24:17 normalization > 16:24:03.684824 [debug] [Thread-4  ]: On model.airbyte_utils.inbound_file_metadata_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.inbound_file_metadata_scd"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >         drop view _airbyte_raw_checkmate.inbound_file_metadata_stg
2022-06-20 16:24:17 normalization >       
2022-06-20 16:24:17 normalization > 16:24:04.180440 [debug] [Thread-1  ]: On model.airbyte_utils.bank_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.bank_config_scd"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >         drop view _airbyte_raw_checkmate.bank_config_stg
2022-06-20 16:24:17 normalization >       
2022-06-20 16:24:17 normalization > 16:24:04.220119 [debug] [Thread-4  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:24:04.221853 [info ] [Thread-4  ]: 5 of 12 OK created incremental model raw_checkmate.inbound_file_metadata_scd............................................ [MERGE (0.0 rows, 0 processed) in 11.75s]
2022-06-20 16:24:17 normalization > 16:24:04.222758 [debug] [Thread-4  ]: Finished running node model.airbyte_utils.inbound_file_metadata_scd
2022-06-20 16:24:17 normalization > 16:24:04.224147 [debug] [Thread-6  ]: Began running node model.airbyte_utils.inbound_file_metadata
2022-06-20 16:24:17 normalization > 16:24:04.224861 [info ] [Thread-6  ]: 10 of 12 START incremental model raw_checkmate.inbound_file_metadata.................................................... [RUN]
2022-06-20 16:24:17 normalization > 16:24:04.226757 [debug] [Thread-6  ]: Acquiring new bigquery connection "model.airbyte_utils.inbound_file_metadata"
2022-06-20 16:24:17 normalization > 16:24:04.227115 [debug] [Thread-6  ]: Began compiling node model.airbyte_utils.inbound_file_metadata
2022-06-20 16:24:17 normalization > 16:24:04.227610 [debug] [Thread-6  ]: Compiling model.airbyte_utils.inbound_file_metadata
2022-06-20 16:24:17 normalization > 16:24:04.247256 [debug] [Thread-6  ]: Opening a new connection, currently in state closed
2022-06-20 16:24:17 normalization > 16:24:04.352556 [debug] [Thread-6  ]: Writing injected SQL for node "model.airbyte_utils.inbound_file_metadata"
2022-06-20 16:24:17 normalization > 16:24:04.353595 [debug] [Thread-6  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:24:04.353914 [debug] [Thread-6  ]: Began executing node model.airbyte_utils.inbound_file_metadata
2022-06-20 16:24:17 normalization > 16:24:04.449481 [debug] [Thread-6  ]: On model.airbyte_utils.inbound_file_metadata: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.inbound_file_metadata"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`inbound_file_metadata__dbt_tmp`
2022-06-20 16:24:17 normalization >   partition by timestamp_trunc(_airbyte_emitted_at, day)
2022-06-20 16:24:17 normalization >   cluster by _airbyte_unique_key, _airbyte_emitted_at
2022-06-20 16:24:17 normalization >   OPTIONS(
2022-06-20 16:24:17 normalization >       expiration_timestamp=TIMESTAMP_ADD(CURRENT_TIMESTAMP(), INTERVAL 12 hour)
2022-06-20 16:24:17 normalization >     )
2022-06-20 16:24:17 normalization >   as (
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > -- Final base SQL model
2022-06-20 16:24:17 normalization > -- depends_on: `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd`
2022-06-20 16:24:17 normalization > select
2022-06-20 16:24:17 normalization >     _airbyte_unique_key,
2022-06-20 16:24:17 normalization >     file_hash,
2022-06-20 16:24:17 normalization >     file_name,
2022-06-20 16:24:17 normalization >     _ab_cdc_lsn,
2022-06-20 16:24:17 normalization >     timestamp_ch,
2022-06-20 16:24:17 normalization >     timestamp_cr,
2022-06-20 16:24:17 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:24:17 normalization >     _ab_cdc_updated_at,
2022-06-20 16:24:17 normalization >     inbound_file_metadata_id,
2022-06-20 16:24:17 normalization >     _airbyte_ab_id,
2022-06-20 16:24:17 normalization >     _airbyte_emitted_at,
2022-06-20 16:24:17 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:24:17 normalization >     _airbyte_inbound_file_metadata_hashid
2022-06-20 16:24:17 normalization > from `mainapi-282501`.raw_checkmate.`inbound_file_metadata_scd`
2022-06-20 16:24:17 normalization > -- inbound_file_metadata from `mainapi-282501`.raw_checkmate._airbyte_raw_inbound_file_metadata
2022-06-20 16:24:17 normalization > where 1 = 1
2022-06-20 16:24:17 normalization > and _airbyte_active_row = 1
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > and coalesce(
2022-06-20 16:24:17 normalization >     cast(_airbyte_emitted_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) >= (select max(cast(_airbyte_emitted_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > )) from `mainapi-282501`.raw_checkmate.`inbound_file_metadata`),
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     true)
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   );
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 16:24:04.708939 [debug] [Thread-1  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:24:04.710063 [info ] [Thread-1  ]: 8 of 12 OK created incremental model raw_checkmate.bank_config_scd...................................................... [MERGE (0.0 rows, 0 processed) in 12.03s]
2022-06-20 16:24:17 normalization > 16:24:04.710699 [debug] [Thread-1  ]: Finished running node model.airbyte_utils.bank_config_scd
2022-06-20 16:24:17 normalization > 16:24:04.711688 [debug] [Thread-8  ]: Began running node model.airbyte_utils.bank_config
2022-06-20 16:24:17 normalization > 16:24:04.712102 [info ] [Thread-8  ]: 11 of 12 START incremental model raw_checkmate.bank_config.............................................................. [RUN]
2022-06-20 16:24:17 normalization > 16:24:04.713243 [debug] [Thread-8  ]: Acquiring new bigquery connection "model.airbyte_utils.bank_config"
2022-06-20 16:24:17 normalization > 16:24:04.713481 [debug] [Thread-8  ]: Began compiling node model.airbyte_utils.bank_config
2022-06-20 16:24:17 normalization > 16:24:04.713685 [debug] [Thread-8  ]: Compiling model.airbyte_utils.bank_config
2022-06-20 16:24:17 normalization > 16:24:04.725107 [debug] [Thread-8  ]: Opening a new connection, currently in state closed
2022-06-20 16:24:17 normalization > 16:24:04.855417 [debug] [Thread-8  ]: Writing injected SQL for node "model.airbyte_utils.bank_config"
2022-06-20 16:24:17 normalization > 16:24:04.855987 [debug] [Thread-8  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:24:04.856217 [debug] [Thread-8  ]: Began executing node model.airbyte_utils.bank_config
2022-06-20 16:24:17 normalization > 16:24:04.916523 [debug] [Thread-8  ]: On model.airbyte_utils.bank_config: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.bank_config"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`bank_config__dbt_tmp`
2022-06-20 16:24:17 normalization >   partition by timestamp_trunc(_airbyte_emitted_at, day)
2022-06-20 16:24:17 normalization >   cluster by _airbyte_unique_key, _airbyte_emitted_at
2022-06-20 16:24:17 normalization >   OPTIONS(
2022-06-20 16:24:17 normalization >       expiration_timestamp=TIMESTAMP_ADD(CURRENT_TIMESTAMP(), INTERVAL 12 hour)
2022-06-20 16:24:17 normalization >     )
2022-06-20 16:24:17 normalization >   as (
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > -- Final base SQL model
2022-06-20 16:24:17 normalization > -- depends_on: `mainapi-282501`.raw_checkmate.`bank_config_scd`
2022-06-20 16:24:17 normalization > select
2022-06-20 16:24:17 normalization >     _airbyte_unique_key,
2022-06-20 16:24:17 normalization >     name,
2022-06-20 16:24:17 normalization >     bank_id,
2022-06-20 16:24:17 normalization >     _ab_cdc_lsn,
2022-06-20 16:24:17 normalization >     timestamp_ch,
2022-06-20 16:24:17 normalization >     timestamp_cr,
2022-06-20 16:24:17 normalization >     hold_duration,
2022-06-20 16:24:17 normalization >     bank_config_id,
2022-06-20 16:24:17 normalization >     vendor_bank_id,
2022-06-20 16:24:17 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:24:17 normalization >     _ab_cdc_updated_at,
2022-06-20 16:24:17 normalization >     inbound_upload_path,
2022-06-20 16:24:17 normalization >     outbound_upload_path,
2022-06-20 16:24:17 normalization >     hold_amount_percentage,
2022-06-20 16:24:17 normalization >     _airbyte_ab_id,
2022-06-20 16:24:17 normalization >     _airbyte_emitted_at,
2022-06-20 16:24:17 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:24:17 normalization >     _airbyte_bank_config_hashid
2022-06-20 16:24:17 normalization > from `mainapi-282501`.raw_checkmate.`bank_config_scd`
2022-06-20 16:24:17 normalization > -- bank_config from `mainapi-282501`.raw_checkmate._airbyte_raw_bank_config
2022-06-20 16:24:17 normalization > where 1 = 1
2022-06-20 16:24:17 normalization > and _airbyte_active_row = 1
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > and coalesce(
2022-06-20 16:24:17 normalization >     cast(_airbyte_emitted_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) >= (select max(cast(_airbyte_emitted_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > )) from `mainapi-282501`.raw_checkmate.`bank_config`),
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     true)
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   );
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 16:24:06.154534 [debug] [Thread-2  ]: On model.airbyte_utils.vendor_config_scd: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.vendor_config_scd"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >         drop view _airbyte_raw_checkmate.vendor_config_stg
2022-06-20 16:24:17 normalization >       
2022-06-20 16:24:17 normalization > 16:24:06.658443 [debug] [Thread-2  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:24:06.659651 [info ] [Thread-2  ]: 6 of 12 OK created incremental model raw_checkmate.vendor_config_scd.................................................... [MERGE (2.0 rows, 1.0 KB processed) in 14.13s]
2022-06-20 16:24:17 normalization > 16:24:06.660306 [debug] [Thread-2  ]: Finished running node model.airbyte_utils.vendor_config_scd
2022-06-20 16:24:17 normalization > 16:24:06.661189 [debug] [Thread-3  ]: Began running node model.airbyte_utils.vendor_config
2022-06-20 16:24:17 normalization > 16:24:06.661625 [info ] [Thread-3  ]: 12 of 12 START incremental model raw_checkmate.vendor_config............................................................ [RUN]
2022-06-20 16:24:17 normalization > 16:24:06.662883 [debug] [Thread-3  ]: Acquiring new bigquery connection "model.airbyte_utils.vendor_config"
2022-06-20 16:24:17 normalization > 16:24:06.663139 [debug] [Thread-3  ]: Began compiling node model.airbyte_utils.vendor_config
2022-06-20 16:24:17 normalization > 16:24:06.663346 [debug] [Thread-3  ]: Compiling model.airbyte_utils.vendor_config
2022-06-20 16:24:17 normalization > 16:24:06.677084 [debug] [Thread-3  ]: Opening a new connection, currently in state closed
2022-06-20 16:24:17 normalization > 16:24:06.779797 [debug] [Thread-3  ]: Writing injected SQL for node "model.airbyte_utils.vendor_config"
2022-06-20 16:24:17 normalization > 16:24:06.780507 [debug] [Thread-3  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:24:06.780744 [debug] [Thread-3  ]: Began executing node model.airbyte_utils.vendor_config
2022-06-20 16:24:17 normalization > 16:24:06.865105 [debug] [Thread-3  ]: On model.airbyte_utils.vendor_config: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.vendor_config"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   create or replace table `mainapi-282501`.raw_checkmate.`vendor_config__dbt_tmp`
2022-06-20 16:24:17 normalization >   partition by timestamp_trunc(_airbyte_emitted_at, day)
2022-06-20 16:24:17 normalization >   cluster by _airbyte_unique_key, _airbyte_emitted_at
2022-06-20 16:24:17 normalization >   OPTIONS(
2022-06-20 16:24:17 normalization >       expiration_timestamp=TIMESTAMP_ADD(CURRENT_TIMESTAMP(), INTERVAL 12 hour)
2022-06-20 16:24:17 normalization >     )
2022-06-20 16:24:17 normalization >   as (
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > -- Final base SQL model
2022-06-20 16:24:17 normalization > -- depends_on: `mainapi-282501`.raw_checkmate.`vendor_config_scd`
2022-06-20 16:24:17 normalization > select
2022-06-20 16:24:17 normalization >     _airbyte_unique_key,
2022-06-20 16:24:17 normalization >     name,
2022-06-20 16:24:17 normalization >     _ab_cdc_lsn,
2022-06-20 16:24:17 normalization >     timestamp_ch,
2022-06-20 16:24:17 normalization >     timestamp_cr,
2022-06-20 16:24:17 normalization >     vendor_config_id,
2022-06-20 16:24:17 normalization >     _ab_cdc_deleted_at,
2022-06-20 16:24:17 normalization >     _ab_cdc_updated_at,
2022-06-20 16:24:17 normalization >     inbound_upload_path,
2022-06-20 16:24:17 normalization >     outbound_upload_path,
2022-06-20 16:24:17 normalization >     _airbyte_ab_id,
2022-06-20 16:24:17 normalization >     _airbyte_emitted_at,
2022-06-20 16:24:17 normalization >     CURRENT_TIMESTAMP() as _airbyte_normalized_at,
2022-06-20 16:24:17 normalization >     _airbyte_vendor_config_hashid
2022-06-20 16:24:17 normalization > from `mainapi-282501`.raw_checkmate.`vendor_config_scd`
2022-06-20 16:24:17 normalization > -- vendor_config from `mainapi-282501`.raw_checkmate._airbyte_raw_vendor_config
2022-06-20 16:24:17 normalization > where 1 = 1
2022-06-20 16:24:17 normalization > and _airbyte_active_row = 1
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > and coalesce(
2022-06-20 16:24:17 normalization >     cast(_airbyte_emitted_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > ) >= (select max(cast(_airbyte_emitted_at as 
2022-06-20 16:24:17 normalization >     timestamp
2022-06-20 16:24:17 normalization > )) from `mainapi-282501`.raw_checkmate.`vendor_config`),
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     true)
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   );
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 16:24:07.235170 [debug] [Thread-6  ]: 
2022-06-20 16:24:17 normalization >     In `mainapi-282501`.`raw_checkmate`.`inbound_file_metadata`:
2022-06-20 16:24:17 normalization >         Schema changed: False
2022-06-20 16:24:17 normalization >         Source columns not in target: []
2022-06-20 16:24:17 normalization >         Target columns not in source: []
2022-06-20 16:24:17 normalization >         New column types: []
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 16:24:07.237223 [debug] [Thread-6  ]: Writing runtime SQL for node "model.airbyte_utils.inbound_file_metadata"
2022-06-20 16:24:17 normalization > 16:24:07.237874 [debug] [Thread-6  ]: On model.airbyte_utils.inbound_file_metadata: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.inbound_file_metadata"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >         
2022-06-20 16:24:17 normalization >         
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     merge into `mainapi-282501`.raw_checkmate.`inbound_file_metadata` as DBT_INTERNAL_DEST
2022-06-20 16:24:17 normalization >         using (
2022-06-20 16:24:17 normalization >           select * from `mainapi-282501`.raw_checkmate.`inbound_file_metadata__dbt_tmp`
2022-06-20 16:24:17 normalization >         ) as DBT_INTERNAL_SOURCE
2022-06-20 16:24:17 normalization >         on 
2022-06-20 16:24:17 normalization >             DBT_INTERNAL_SOURCE._airbyte_unique_key = DBT_INTERNAL_DEST._airbyte_unique_key
2022-06-20 16:24:17 normalization >         
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     when matched then update set
2022-06-20 16:24:17 normalization >         `_airbyte_unique_key` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key`,`file_hash` = DBT_INTERNAL_SOURCE.`file_hash`,`file_name` = DBT_INTERNAL_SOURCE.`file_name`,`_ab_cdc_lsn` = DBT_INTERNAL_SOURCE.`_ab_cdc_lsn`,`timestamp_ch` = DBT_INTERNAL_SOURCE.`timestamp_ch`,`timestamp_cr` = DBT_INTERNAL_SOURCE.`timestamp_cr`,`_ab_cdc_deleted_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_deleted_at`,`_ab_cdc_updated_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_updated_at`,`inbound_file_metadata_id` = DBT_INTERNAL_SOURCE.`inbound_file_metadata_id`,`_airbyte_ab_id` = DBT_INTERNAL_SOURCE.`_airbyte_ab_id`,`_airbyte_emitted_at` = DBT_INTERNAL_SOURCE.`_airbyte_emitted_at`,`_airbyte_normalized_at` = DBT_INTERNAL_SOURCE.`_airbyte_normalized_at`,`_airbyte_inbound_file_metadata_hashid` = DBT_INTERNAL_SOURCE.`_airbyte_inbound_file_metadata_hashid`
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     when not matched then insert
2022-06-20 16:24:17 normalization >         (`_airbyte_unique_key`, `file_hash`, `file_name`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_file_metadata_id`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_inbound_file_metadata_hashid`)
2022-06-20 16:24:17 normalization >     values
2022-06-20 16:24:17 normalization >         (`_airbyte_unique_key`, `file_hash`, `file_name`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_file_metadata_id`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_inbound_file_metadata_hashid`)
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 16:24:09.584177 [debug] [Thread-3  ]: 
2022-06-20 16:24:17 normalization >     In `mainapi-282501`.`raw_checkmate`.`vendor_config`:
2022-06-20 16:24:17 normalization >         Schema changed: False
2022-06-20 16:24:17 normalization >         Source columns not in target: []
2022-06-20 16:24:17 normalization >         Target columns not in source: []
2022-06-20 16:24:17 normalization >         New column types: []
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 16:24:09.586148 [debug] [Thread-3  ]: Writing runtime SQL for node "model.airbyte_utils.vendor_config"
2022-06-20 16:24:17 normalization > 16:24:09.586695 [debug] [Thread-3  ]: On model.airbyte_utils.vendor_config: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.vendor_config"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >         
2022-06-20 16:24:17 normalization >         
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     merge into `mainapi-282501`.raw_checkmate.`vendor_config` as DBT_INTERNAL_DEST
2022-06-20 16:24:17 normalization >         using (
2022-06-20 16:24:17 normalization >           select * from `mainapi-282501`.raw_checkmate.`vendor_config__dbt_tmp`
2022-06-20 16:24:17 normalization >         ) as DBT_INTERNAL_SOURCE
2022-06-20 16:24:17 normalization >         on 
2022-06-20 16:24:17 normalization >             DBT_INTERNAL_SOURCE._airbyte_unique_key = DBT_INTERNAL_DEST._airbyte_unique_key
2022-06-20 16:24:17 normalization >         
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     when matched then update set
2022-06-20 16:24:17 normalization >         `_airbyte_unique_key` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key`,`name` = DBT_INTERNAL_SOURCE.`name`,`_ab_cdc_lsn` = DBT_INTERNAL_SOURCE.`_ab_cdc_lsn`,`timestamp_ch` = DBT_INTERNAL_SOURCE.`timestamp_ch`,`timestamp_cr` = DBT_INTERNAL_SOURCE.`timestamp_cr`,`vendor_config_id` = DBT_INTERNAL_SOURCE.`vendor_config_id`,`_ab_cdc_deleted_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_deleted_at`,`_ab_cdc_updated_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_updated_at`,`inbound_upload_path` = DBT_INTERNAL_SOURCE.`inbound_upload_path`,`outbound_upload_path` = DBT_INTERNAL_SOURCE.`outbound_upload_path`,`_airbyte_ab_id` = DBT_INTERNAL_SOURCE.`_airbyte_ab_id`,`_airbyte_emitted_at` = DBT_INTERNAL_SOURCE.`_airbyte_emitted_at`,`_airbyte_normalized_at` = DBT_INTERNAL_SOURCE.`_airbyte_normalized_at`,`_airbyte_vendor_config_hashid` = DBT_INTERNAL_SOURCE.`_airbyte_vendor_config_hashid`
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     when not matched then insert
2022-06-20 16:24:17 normalization >         (`_airbyte_unique_key`, `name`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `vendor_config_id`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_upload_path`, `outbound_upload_path`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_vendor_config_hashid`)
2022-06-20 16:24:17 normalization >     values
2022-06-20 16:24:17 normalization >         (`_airbyte_unique_key`, `name`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `vendor_config_id`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_upload_path`, `outbound_upload_path`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_vendor_config_hashid`)
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 16:24:09.807028 [debug] [Thread-8  ]: 
2022-06-20 16:24:17 normalization >     In `mainapi-282501`.`raw_checkmate`.`bank_config`:
2022-06-20 16:24:17 normalization >         Schema changed: False
2022-06-20 16:24:17 normalization >         Source columns not in target: []
2022-06-20 16:24:17 normalization >         Target columns not in source: []
2022-06-20 16:24:17 normalization >         New column types: []
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 16:24:09.809280 [debug] [Thread-8  ]: Writing runtime SQL for node "model.airbyte_utils.bank_config"
2022-06-20 16:24:17 normalization > 16:24:09.809795 [debug] [Thread-8  ]: On model.airbyte_utils.bank_config: /* {"app": "dbt", "dbt_version": "1.0.0", "profile_name": "normalize", "target_name": "prod", "node_id": "model.airbyte_utils.bank_config"} */
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >         
2022-06-20 16:24:17 normalization >         
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     merge into `mainapi-282501`.raw_checkmate.`bank_config` as DBT_INTERNAL_DEST
2022-06-20 16:24:17 normalization >         using (
2022-06-20 16:24:17 normalization >           select * from `mainapi-282501`.raw_checkmate.`bank_config__dbt_tmp`
2022-06-20 16:24:17 normalization >         ) as DBT_INTERNAL_SOURCE
2022-06-20 16:24:17 normalization >         on 
2022-06-20 16:24:17 normalization >             DBT_INTERNAL_SOURCE._airbyte_unique_key = DBT_INTERNAL_DEST._airbyte_unique_key
2022-06-20 16:24:17 normalization >         
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization >     when matched then update set
2022-06-20 16:24:17 normalization >         `_airbyte_unique_key` = DBT_INTERNAL_SOURCE.`_airbyte_unique_key`,`name` = DBT_INTERNAL_SOURCE.`name`,`bank_id` = DBT_INTERNAL_SOURCE.`bank_id`,`_ab_cdc_lsn` = DBT_INTERNAL_SOURCE.`_ab_cdc_lsn`,`timestamp_ch` = DBT_INTERNAL_SOURCE.`timestamp_ch`,`timestamp_cr` = DBT_INTERNAL_SOURCE.`timestamp_cr`,`hold_duration` = DBT_INTERNAL_SOURCE.`hold_duration`,`bank_config_id` = DBT_INTERNAL_SOURCE.`bank_config_id`,`vendor_bank_id` = DBT_INTERNAL_SOURCE.`vendor_bank_id`,`_ab_cdc_deleted_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_deleted_at`,`_ab_cdc_updated_at` = DBT_INTERNAL_SOURCE.`_ab_cdc_updated_at`,`inbound_upload_path` = DBT_INTERNAL_SOURCE.`inbound_upload_path`,`outbound_upload_path` = DBT_INTERNAL_SOURCE.`outbound_upload_path`,`hold_amount_percentage` = DBT_INTERNAL_SOURCE.`hold_amount_percentage`,`_airbyte_ab_id` = DBT_INTERNAL_SOURCE.`_airbyte_ab_id`,`_airbyte_emitted_at` = DBT_INTERNAL_SOURCE.`_airbyte_emitted_at`,`_airbyte_normalized_at` = DBT_INTERNAL_SOURCE.`_airbyte_normalized_at`,`_airbyte_bank_config_hashid` = DBT_INTERNAL_SOURCE.`_airbyte_bank_config_hashid`
2022-06-20 16:24:17 normalization >     
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >     when not matched then insert
2022-06-20 16:24:17 normalization >         (`_airbyte_unique_key`, `name`, `bank_id`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `hold_duration`, `bank_config_id`, `vendor_bank_id`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_upload_path`, `outbound_upload_path`, `hold_amount_percentage`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_bank_config_hashid`)
2022-06-20 16:24:17 normalization >     values
2022-06-20 16:24:17 normalization >         (`_airbyte_unique_key`, `name`, `bank_id`, `_ab_cdc_lsn`, `timestamp_ch`, `timestamp_cr`, `hold_duration`, `bank_config_id`, `vendor_bank_id`, `_ab_cdc_deleted_at`, `_ab_cdc_updated_at`, `inbound_upload_path`, `outbound_upload_path`, `hold_amount_percentage`, `_airbyte_ab_id`, `_airbyte_emitted_at`, `_airbyte_normalized_at`, `_airbyte_bank_config_hashid`)
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization > 
2022-06-20 16:24:17 normalization >   
2022-06-20 16:24:17 normalization > 16:24:09.852103 [debug] [Thread-6  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:24:09.853256 [info ] [Thread-6  ]: 10 of 12 OK created incremental model raw_checkmate.inbound_file_metadata............................................... [MERGE (0.0 rows, 0 processed) in 5.63s]
2022-06-20 16:24:17 normalization > 16:24:09.853834 [debug] [Thread-6  ]: Finished running node model.airbyte_utils.inbound_file_metadata
2022-06-20 16:24:17 normalization > 16:24:12.344234 [debug] [Thread-8  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:24:12.345397 [info ] [Thread-8  ]: 11 of 12 OK created incremental model raw_checkmate.bank_config......................................................... [MERGE (0.0 rows, 0 processed) in 7.63s]
2022-06-20 16:24:17 normalization > 16:24:12.345974 [debug] [Thread-8  ]: Finished running node model.airbyte_utils.bank_config
2022-06-20 16:24:17 normalization > 16:24:12.507927 [debug] [Thread-3  ]: finished collecting timing info
2022-06-20 16:24:17 normalization > 16:24:12.509012 [info ] [Thread-3  ]: 12 of 12 OK created incremental model raw_checkmate.vendor_config....................................................... [MERGE (1.0 rows, 564.0 Bytes processed) in 5.85s]
2022-06-20 16:24:17 normalization > 16:24:12.509530 [debug] [Thread-3  ]: Finished running node model.airbyte_utils.vendor_config
2022-06-20 16:24:17 normalization > 16:24:12.512790 [debug] [MainThread]: Acquiring new bigquery connection "master"
2022-06-20 16:24:17 normalization > 16:24:12.513631 [info ] [MainThread]: 
2022-06-20 16:24:17 normalization > 16:24:12.514011 [info ] [MainThread]: Finished running 4 view models, 8 incremental models in 22.11s.
2022-06-20 16:24:17 normalization > 16:24:12.514583 [debug] [MainThread]: Connection 'master' was properly closed.
2022-06-20 16:24:17 normalization > 16:24:12.514907 [debug] [MainThread]: Connection 'model.airbyte_utils.vendor_config_scd' was properly closed.
2022-06-20 16:24:17 normalization > 16:24:12.515164 [debug] [MainThread]: Connection 'model.airbyte_utils.bank_config_scd' was properly closed.
2022-06-20 16:24:17 normalization > 16:24:12.515318 [debug] [MainThread]: Connection 'model.airbyte_utils.vendor_config' was properly closed.
2022-06-20 16:24:17 normalization > 16:24:12.515462 [debug] [MainThread]: Connection 'model.airbyte_utils.inbound_file_metadata_scd' was properly closed.
2022-06-20 16:24:17 normalization > 16:24:12.515604 [debug] [MainThread]: Connection 'model.airbyte_utils.inbound_file_metadata' was properly closed.
2022-06-20 16:24:17 normalization > 16:24:12.515745 [debug] [MainThread]: Connection 'model.airbyte_utils.bank_config' was properly closed.
2022-06-20 16:24:17 normalization > 16:24:12.537896 [info ] [MainThread]: 
2022-06-20 16:24:17 normalization > 16:24:12.538432 [info ] [MainThread]: Completed with 1 error and 0 warnings:
2022-06-20 16:24:17 normalization > 16:24:12.539085 [info ] [MainThread]: 
2022-06-20 16:24:17 normalization > 16:24:12.539571 [error] [MainThread]: Database Error in model deposit_scd (models/generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql)
2022-06-20 16:24:17 normalization > 16:24:12.540151 [error] [MainThread]:   Invalid timestamp string "0000-12-30T00:00:00Z"
2022-06-20 16:24:17 normalization > 16:24:12.540678 [error] [MainThread]:   compiled SQL at ../build/run/airbyte_utils/models/generated/airbyte_incremental/scd/raw_checkmate/deposit_scd.sql
2022-06-20 16:24:17 normalization > 16:24:12.541480 [info ] [MainThread]: 
2022-06-20 16:24:17 normalization > 16:24:12.542013 [info ] [MainThread]: Done. PASS=10 WARN=0 ERROR=1 SKIP=1 TOTAL=12